Pith. sign in

REVIEW 5 major objections 5 minor 34 references

Investigating the Invertibility of Multimodal Latent Spaces: Limitations of Optimization-Based Methods

T0 review · 5 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read Task-specific models hit text targets but can't invert latent spaces.

desk verdict A well-documented negative result that overreaches: the experiments show naive inversion fails, not that latent spaces are non-invertible. read the letter →

arxiv 2507.23010 v1 pith:FURGR5AG submitted 2025-07-30 cs.LG cs.AIcs.CVcs.SDeess.AS

classification cs.LGcs.AIcs.CVcs.SDeess.AS
keywords multimodallatentspacesnetworkinversionoptimization-basedtext-to-imagespeechrecognitionspaceinterpretabilitytask-specificmodelsinverseproblemsindeeplearning
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tests whether multimodal latent spaces of task-specific models can be run backwards by optimization: starting from a desired output and adjusting the input to produce it. It proposes a general inversion objective and applies it in both directions across text-image (BLIP, Flux.1-dev) and text-audio (Whisper-Large-V3, Chatterbox-TTS) models. The central claim is that although optimization can force outputs to match a text target (a caption, a transcription), the perceptual quality of the reconstructions stays chaotic, and inferred text embeddings do not align with semantically meaningful vocabulary tokens. The conclusion is that latent spaces optimized purely for forward tasks do not inherently support robust and interpretable inverse mappings, which matters because invertibility would let practitioners interrogate and reuse these models.

What carries the argument

The carrying mechanism is an optimization-based network-inversion objective: fix the model $f$, treat a raw input $x$ (pixel image, log-mel spectrogram, or token/pooled text embedding) as the parameter, and minimize a loss $L(f(x), y)$ between the model output and a target $y$ with Adam or AdamW and gradients from autograd. For generative-model inversion, the same objective is paired with cosine-similarity matching of the optimized embedding against the model's vocabulary tokens to test whether the latent point is semantically interpretable. This framework lets the paper test invertibility bidirectionally: discriminative models pushed into generation, and generative models pushed into classification.

What would settle it

One concrete test: optimize a text-to-image model's text embedding with the same objective but add a perceptual prior or use a diffusion-based inversion method, then ask human raters whether the generated images match the target; if coherent images appear while nearest-token cosine similarity stays near chance, the paper's conclusion that the latent space lacks interpretable inverse structure is falsified. A second observation-level check is whether the reported token similarities exceed the chance similarity of random embeddings to vocabulary tokens.

Watch

Extended reading notes

Core claim

On the paper's own terms, the discovery is that task-specific multimodal encoders and decoders can be steered toward inverse goals—a captioning model can be made to produce an image its own captioner reads as "a red apple on a wooden table," and a speech recognizer can be made to transcribe an optimized spectrogram as the same phrase—but the resulting image or audio is perceptually incoherent noise. When the direction is reversed, optimizing text embeddings of a text-to-image or text-to-speech model to reproduce a target output yields embeddings whose nearest vocabulary tokens have only low cosine similarity (roughly 0.06–0.08 for token embeddings, up to about 0.15 for the pooled embedding), placing them near random semantic identities. The paper reads this as evidence that forward-task optimization does not endow latent spaces with the structure needed for interpretable inversion.

Load-bearing premise

The conclusion depends on assuming that unconstrained gradient descent with cross-entropy, MSE, or mel-spectrogram loss is a fair test of whether these latent spaces support inverse mappings; if a better inversion method recovered coherent inputs, the central claim would collapse.

Editorial extensions

If this is right

  • Optimization can satisfy text-side targets (captions or transcriptions) without producing perceptually coherent images or audio, so textual agreement is not evidence of true inversion.
  • Generative models' text latents lie near low-similarity vocabulary neighborhoods under this protocol, so interpreting optimized embeddings as discrete tokens is unreliable.
  • Discriminative multimodal models do not acquire implicit generative capacity just because gradients flow to their inputs.
  • The paper's conclusion motivates designing latent spaces explicitly constrained for invertibility, for example with reconstruction priors or cycle-consistency, rather than optimizing forward performance alone.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The result is protocol-conditional: the paper uses unconstrained gradient descent on raw inputs with no priors, regularizers, or established inversion techniques, so the claim "these latent spaces are not invertible" is really "these latent spaces were not invertible under this optimization recipe"; a stronger optimizer or a prior (diffusion guidance, perceptual losses, projection to the data mani
  • A testable extension: run the same inversion objectives with a perceptual or adversarial loss and measure both human-judged coherence and nearest-token cosine score; if those jump, the low token similarities reported here are artifacts of objective choice rather than latent-space structure.
  • The near-chance cosine similarities may partly reflect tokenizer vocabulary size and embedding anisotropy, so the paper's interpretability claim would be strengthened by comparing against chance-level similarity for randomly sampled embeddings.
  • Adversarial examples show that forward-trained latent spaces can be controlled in a shallow, non-semantic way, so the paper's finding draws a line between adversarial controllability and semantic invertibility.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper investigates whether multimodal latent spaces of task-specific models (BLIP, Flux.1-dev, Whisper-Large-V3, Chatterbox-TTS) support inverse mappings obtained by optimization. The authors propose an optimization-based framework (Section 3, Eq. (2)) that performs gradient descent on raw inputs—images, log-mel spectrograms, or text embeddings—to match a target output, and apply it bidirectionally across text-image and text-audio pairs. They report that while optimization can force models to produce outputs that are textually aligned with targets (e.g., BLIP captions match the prompt; Whisper transcribes the target phrase), the resulting images and audio are perceptually incoherent, and the optimized text embeddings from Flux and Chatterbox do not align with meaningful vocabulary tokens. The paper concludes that multimodal latent spaces do not inherently possess the structure required for robust and interpretable inverse mappings.

Significance. If the central claim were established, the paper would contribute to the literature on interpretability, network inversion, and multimodal representation learning, and its use of several widely used public models is timely. However, the evidence presented is anecdotal and methodologically insufficient. The paper does not compare against established inversion techniques, does not report multiple runs, seeds, or hyperparameters, and the quantitative metrics (PESQ, BERTScore, CLIPScore) are not linked to the perceptual and semantic conclusions. The main observation—that naive unconstrained optimization finds out-of-distribution inputs—is already well known from the adversarial-example literature. The paper's strength is that it documents these failures on modern multimodal systems, but as it stands the results do not support the strong claim that the latent spaces themselves are non-invertible.

major comments (5)
  1. [Section 3 and Section 4] The inversion objective in Eq. (2) is solved by unconstrained gradient descent on raw inputs with no prior, regularizer, or in-distribution projection. The failure of this specific protocol does not establish that the latent space is inherently non-invertible; it is well known from the adversarial-example literature (Refs. [2], [7], [29]) that unconstrained optimization finds out-of-distribution solutions that satisfy the model output without semantic meaning. To support the central claim, the paper must compare against established inversion techniques (e.g., natural-image priors, GAN or diffusion priors, projected gradient descent onto token embeddings, vocoder-based audio reconstruction) and show that these also fail to produce meaningful inversions.
  2. [Section 4.1.2 and Section 4.2.2, Tables 5-6 and 8-11] The token-interpretability analysis computes cosine similarity between optimized continuous embeddings and vocabulary embeddings, but the optimization objective contains no term that encourages the optimized embedding to lie near the token manifold. Low cosine similarities are therefore an expected consequence of the protocol, not evidence that the latent space is semantically non-invertible. A meaningful test would either optimize in the discrete token space (e.g., with a Gumbel-softmax or projection step) or compare against the cosine-similarity distribution obtained from in-distribution prompt embeddings that are known to work in the forward model.
  3. [Section 4.1.2] The Flux.1-dev experiments rely on single-step inference from a 4-bit quantized model, and the paper states this is done 'for computational efficiency' without justifying that single-step inference is a faithful proxy for the generative model. Rectified flow models like Flux typically require multiple denoising steps, and optimizing against a single-step output may exploit approximation error rather than the true text-to-image mapping. This is load-bearing because the paper's conclusion about Flux rests on embeddings optimized against this approximate forward pass. At minimum, the authors should verify their findings with multi-step inference or a higher-precision model.
  4. [Section 5, Tables 13-15] The quantitative metrics do not support the paper's qualitative conclusions. PESQ values in Table 14 are essentially constant near 1.0 (the minimum of the scale), and BERTScore in Table 15 is identical across all optimization steps for each category, indicating that the metric is insensitive to the optimization progress. CLIPScore in Table 13 decreases for some categories. No error bars, multiple seeds, statistical tests, or comparison baselines are provided. The paper claims these results 'consistently validate the hypothesis,' but the numbers as reported are at best uninformative and at worst contradict the narrative of progressive convergence.
  5. [Section 6.3] The broad conclusion that task-specific classification models 'show no capacity for generative tasks' is an overgeneralization from two models (BLIP and Whisper) and one optimization recipe each. The same applies to the statement that reconstructed embeddings 'consistently do not align with the model's own discrete vocabulary tokens,' which is based solely on the cosine-similarity analysis discussed above. The claims should be restricted to the specific protocol and models tested, or be supported by evidence that alternative, more powerful inversion methods also fail.
minor comments (5)
  1. [Throughout] There are numerous typos and formatting issues, including 'Quantitatve' in the Section 5.2 heading, 'classifer' in Section 4.1.2, 'T ext-Image' in Section 4, and inconsistent capitalization in the abstract ('multimodal' after a period).
  2. [Section 4.2.2, Tables 8-11] The row for 'step 750' appears twice in each of Tables 8-11, and the row for 'step 1000' appears only in Table 11. This appears to be a copy-and-paste error that should be corrected.
  3. [Section 4.1.2 and Section 4.2.2] The paper does not report the learning rate, optimizer settings, number of optimization runs, random seeds, or other hyperparameters needed to reproduce the experiments. These details are essential for any optimization-based study.
  4. [Section 4.2.1] The Whisper experiment optimizes a log-mel spectrogram and then reconstructs audio with Griffin-Lim, which is a lossy and often poor-quality reconstruction even for natural speech. The poor perceptual quality of the reconstructed audio may be entirely due to the Griffin-Lim inversion, not the latent space. This confound should be explicitly acknowledged or avoided by using a learned vocoder.
  5. [Section 5.3] PESQ is designed for evaluating telephone-band speech codecs and is not an appropriate metric for assessing the perceptual quality of synthesized speech or noise. The authors should justify the metric choice or use a more suitable evaluation (e.g., MOS prediction or a neural speech quality model).

Circularity Check

2 steps flagged · score 6.0 of 10

Central negative claims are built into the unconstrained optimization protocol: low token similarity and chaotic perceptual quality are consequences of the chosen objectives, not independent properties of the latent spaces.

  1. fitted input called prediction [Section 4.1.2 (Tables 5-6) and Section 4.2.2 (Tables 8-11)]
    "Our objective function for this task is formulated as J(x) = L(f(x), y), where x represents the text embeddings (both the token embeddings and the pooled prompt embeddings), y is the target image, and L denotes a suitable loss function. ... We computed cosine similarity for each embedding against every token within its corresponding tokenizer's vocabulary. The tokens with the highest similarity scores are summarized in Table 5 and Table 6."

    The optimized x is produced by minimizing a reconstruction loss only; no term in J(x) encourages the continuous embedding to lie near a discrete vocabulary token. The paper's own measure of 'semantic interpretability' is cosine similarity to vocabulary tokens, so low cosine similarity is a mathematical consequence of unconstrained optimization in a high-dimensional space, not an empirical property of the latent space. The 'prediction' that reconstructed embeddings do not align with vocabulary tokens is therefore forced by the definition of the optimization objective and the evaluation metric; it would occur for any continuous space without a token-alignment constraint, independent of invertibility.

  2. fitted input called prediction [Section 4.1.1 (Figures 1-4), Section 4.2.1 (Figures 13-17; Table 7), interpreted in Sections 6.2-6.3]
    "This optimization aims to minimize the cross-entropy loss with AdamW optimizer between the text transcribed by the model and the target text. ... The reconstructed audio is a strong indicator that the model completely lacks the implicit generative potential required to synthesize coherent audio, despite its remarkable discriminative capabilities for transcription. ... Task-specific classification models (e.g., image captioning, speech recognition) show no capacity for generative tasks, never successfully manipulating their input to achieve a perceptually meaningful output."

    The raw input (pixel image or log-mel spectrogram) is fitted to a text/transcription objective, with no perceptual-coherence prior, no in-distribution constraint, and (for audio) a lossy Griffin-Lim reconstruction added after optimization. Under such an unconstrained inversion objective, out-of-distribution, noise-like solutions are the expected result whenever many inputs satisfy the text loss. The paper then labels this protocol artifact as evidence that task-specific classification models 'show no capacity for generative tasks' and that latent spaces 'do not inherently possess the structure required for robust and interpretable inverse mappings.' The negative finding is entailed by the choice of objective function, not discovered about the latent spaces.

full rationale

There is no formal mathematical circularity, no load-bearing self-citation chain, and no imported uniqueness theorem; the reference list is entirely external, so patterns 3-5 do not apply. The circularity is methodological: the paper's two headline negative results are consequences of the optimization objectives it chose. For generative-model inversion, the objective J(x) contains only reconstruction loss; vocabulary alignment is then measured post hoc, so low cosine similarity is forced by the absence of any token-alignment term. For discriminative-model 'generation,' raw inputs are optimized against a text/transcription loss with no perceptual prior; the resulting noise-like images and audio are therefore artifacts of the unconstrained search, not evidence about latent-space invertibility. The abstract and Section 6.3 promote these protocol artifacts to a structural property of multimodal latent spaces. This is partial circularity: the predictions are built into the experimental definition, though the paper does contain independent empirical observations, such as that text-matching inverses can be found at all. Score 6 reflects that the central negative claims reduce by construction, while the paper retains independent empirical content in its reported optimization trajectories.

Assumptions & free parameters 4 free parameters · 4 assumptions · 0 invented entities

The central claim rests on hand-chosen optimization settings and several domain assumptions about how to interpret the inversion results. None of these assumptions are independently validated, and no new entities are introduced.

free parameters (4)
  • Optimization step counts = 10,000 (BLIP), 200 (Flux), 3,000 (Whisper), 1,000 (Chatterbox)
    Chosen by hand without convergence criteria; results depend on these values.
  • Guidance scale and CFG string for Flux = 3.5 and empty string
    Chosen by hand; affects the single-step inference used as the inversion target.
  • Token counts = 10 tokens (Flux), 23 tokens (Chatterbox)
    Fixed by hand; the search space for inversion depends on these counts.
  • Single-step diffusion approximation = 1 step for optimization, 50 steps for evaluation
    The inversion optimizes a one-step approximation of Flux, not the full generative process; this is a modeling choice that may explain the poor results.
assumptions (4)
  • domain assumption Unconstrained gradient descent in input space is a fair test of inverse mapping
    The entire study evaluates invertibility by running raw gradient descent without priors or regularizers; no justification is given that this is representative of optimization-based inversion.
  • domain assumption Cosine similarity to nearest vocabulary token measures semantic interpretability
    Tables 5-6 and 8-11 interpret low cosine similarity as a lack of semantic meaning, but this metric is never validated against human judgment or downstream tasks.
  • ad hoc to paper Single-step Flux inference approximates the generative model for inversion
    The paper optimizes a one-step inference of Flux to save compute, then uses the optimized embeddings to draw conclusions about Flux's latent space. This approximation is not justified.
  • domain assumption Griffin-Lim reconstruction from a log-mel spectrogram gives perceptually meaningful audio
    The paper reconstructs audio with Griffin-Lim and treats the noisy result as evidence that Whisper's latent space cannot generate coherent audio, but Griffin-Lim is known to produce poor-quality speech.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Investigating the Invertibility of Multimodal Latent Spaces: Limitations of Optimization-Based Methods." pith.science (2026). https://pith.science/paper/FURGR5AG

@misc{pith2026250723010,
  author       = {Pith},
  title        = {Pith review of: Investigating the Invertibility of Multimodal Latent Spaces: Limitations of Optimization-Based Methods},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/FURGR5AG}},
  note         = {Machine review of arXiv:2507.23010}
}
read the original abstract

This paper investigates the inverse capabilities and broader utility of multimodal latent spaces within task-specific AI (Artificial Intelligence) models. While these models excel at their designed forward tasks (e.g., text-to-image generation, audio-to-text transcription), their potential for inverse mappings remains largely unexplored. We propose an optimization-based framework to infer input characteristics from desired outputs, applying it bidirectionally across Text-Image (BLIP, Flux.1-dev) and Text-Audio (Whisper-Large-V3, Chatterbox-TTS) modalities. Our central hypothesis posits that while optimization can guide models towards inverse tasks, their multimodal latent spaces will not consistently support semantically meaningful and perceptually coherent inverse mappings. Experimental results consistently validate this hypothesis. We demonstrate that while optimization can force models to produce outputs that align textually with targets (e.g., a text-to-image model generating an image that an image captioning model describes correctly, or an ASR model transcribing optimized audio accurately), the perceptual quality of these inversions is chaotic and incoherent. Furthermore, when attempting to infer the original semantic input from generative models, the reconstructed latent space embeddings frequently lack semantic interpretability, aligning with nonsensical vocabulary tokens. These findings highlight a critical limitation. multimodal latent spaces, primarily optimized for specific forward tasks, do not inherently possess the structure required for robust and interpretable inverse mappings. Our work underscores the need for further research into developing truly semantically rich and invertible multimodal latent spaces.

Figures

Figures reproduced from arXiv: 2507.23010 by the authors.

Figure 1
Figure 1. Optimization results using Adam with Gaussian noise initialization [PITH_FULL_IMAGE:figures/full_fig_p007_1.png] view at source ↗
Figure 2
Figure 2. Optimization results using Adam with base image initialization for [PITH_FULL_IMAGE:figures/full_fig_p008_2.png] view at source ↗
Figure 3
Figure 3. Optimization results using AdamW with Gaussian noise initialization [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (26 more)
Figure 4
Figure 4. Figure 4: Optimization results using AdamW with base image initialization for [PITH_FULL_IMAGE:figures/full_fig_p009_4.png]
Figure 5
Figure 5. Figure 5: Single-step Inference Optimization using AdamW with Gaussian noise [PITH_FULL_IMAGE:figures/full_fig_p010_5.png]
Figure 6
Figure 6. Figure 6: 50 Denoising Step Inference by Optimization results [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: t-SNE R 2 visualization of pooled embedding R 768 across training steps This figure presents a t-SNE projection of the pooled R 768 embeddings on R 2 , which captures their state at different stages of training. The dynamic shifts highlight the model’s learning traject…
Figure 8
Figure 8. Figure 8: step 0 [PITH_FULL_IMAGE:figures/full_fig_p015_8.png]
Figure 9
Figure 9. Figure 9: step 750 15 [PITH_FULL_IMAGE:figures/full_fig_p015_9.png]
Figure 10
Figure 10. Figure 10: step 1500 [PITH_FULL_IMAGE:figures/full_fig_p016_10.png]
Figure 11
Figure 11. Figure 11: step 2250 16 [PITH_FULL_IMAGE:figures/full_fig_p016_11.png]
Figure 12
Figure 12. Figure 12: step 3000 17 [PITH_FULL_IMAGE:figures/full_fig_p017_12.png]
Figure 13
Figure 13. Figure 13: step 0 18 [PITH_FULL_IMAGE:figures/full_fig_p018_13.png]
Figure 14
Figure 14. Figure 14: step 750 [PITH_FULL_IMAGE:figures/full_fig_p019_14.png]
Figure 15
Figure 15. Figure 15: step 1500 [PITH_FULL_IMAGE:figures/full_fig_p019_15.png]
Figure 16
Figure 16. Figure 16: step 2250 19 [PITH_FULL_IMAGE:figures/full_fig_p019_16.png]
Figure 17
Figure 17. Figure 17: step 3000 20 [PITH_FULL_IMAGE:figures/full_fig_p020_17.png]
Figure 18
Figure 18. Figure 18: step 0 21 [PITH_FULL_IMAGE:figures/full_fig_p021_18.png]
Figure 19
Figure 19. Figure 19: step 250 [PITH_FULL_IMAGE:figures/full_fig_p022_19.png]
Figure 20
Figure 20. Figure 20: step 500 [PITH_FULL_IMAGE:figures/full_fig_p022_20.png]
Figure 21
Figure 21. Figure 21: step 750 22 [PITH_FULL_IMAGE:figures/full_fig_p022_21.png]
Figure 22
Figure 22. Figure 22: step 1000 [PITH_FULL_IMAGE:figures/full_fig_p023_22.png]
Figure 23
Figure 23. Figure 23: target 23 [PITH_FULL_IMAGE:figures/full_fig_p023_23.png]
Figure 24
Figure 24. Figure 24: step 0 [PITH_FULL_IMAGE:figures/full_fig_p024_24.png]
Figure 25
Figure 25. Figure 25: step 250 24 [PITH_FULL_IMAGE:figures/full_fig_p024_25.png]
Figure 26
Figure 26. Figure 26: step 500 [PITH_FULL_IMAGE:figures/full_fig_p025_26.png]
Figure 27
Figure 27. Figure 27: step 750 [PITH_FULL_IMAGE:figures/full_fig_p025_27.png]
Figure 28
Figure 28. Figure 28: step 1000 25 [PITH_FULL_IMAGE:figures/full_fig_p025_28.png]
Figure 29
Figure 29. Figure 29: target 26 [PITH_FULL_IMAGE:figures/full_fig_p026_29.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

34 extracted references · 18 canonical work pages

  1. [2]

    Towards Evaluating the Robustness of Neural Networks

    Nicholas Carlini and David Wagner. Towards Evaluating the Robustness of Neural Networks . 2017. arXiv: 1608.04644 [cs.CR]. url: https:// arxiv.org/abs/1608.04644

  2. [7]

    Goodfellow, Jonathon Shlens, and Christian Szegedy

    Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. Explaining and Harnessing Adversarial Examples. 2015. arXiv: 1412.6572 [stat.ML]. url: https://arxiv.org/abs/1412.6572

  3. [29]

    Intriguing properties of neural networks

    Christian Szegedy et al. Intriguing properties of neural networks . 2014. arXiv: 1312.6199 [cs.CV]. url: https://arxiv.org/abs/1312.6199

  4. [1]

    GitHub - black-forest-labs/flux: Official inference repo for FLUX.1 models

    black-forest-labs. GitHub - black-forest-labs/flux: Official inference repo for FLUX.1 models . GitHub, 2024. url: https://github.com/black- forest-labs/flux

  5. [3]

    M´ ethode g´ en´ erale pour la r´ esolution des systemes d’´ equations simultan´ ees

    Augustin Cauchy et al. “M´ ethode g´ en´ erale pour la r´ esolution des systemes d’´ equations simultan´ ees”. In:Comp. Rend. Sci. Paris 25.1847 (1847), pp. 536–538. 32

  6. [4]

    Imagenet: A large-scale hierarchical image database

    Jia Deng et al. “Imagenet: A large-scale hierarchical image database”. In: 2009 IEEE conference on computer vision and pattern recognition . Ieee. 2009, pp. 248–255

  7. [5]

    BERT: Pre-training of Deep Bidirectional Transform- ers for Language Understanding

    Jacob Devlin et al. BERT: Pre-training of Deep Bidirectional Transform- ers for Language Understanding . 2019. arXiv: 1810.04805 [cs.CL]. url: https://arxiv.org/abs/1810.04805

  8. [6]

    Adaptive subgradient meth- ods for online learning and stochastic optimization

    John Duchi, Elad Hazan, and Yoram Singer. “Adaptive subgradient meth- ods for online learning and stochastic optimization.” In: Journal of ma- chine learning research 12.7 (2011)

Show all 34 references
  1. [8]

    Signal estimation from modified short-time Fourier transform

    Daniel Griffin and Jae Lim. “Signal estimation from modified short-time Fourier transform”. In:IEEE Transactions on acoustics, speech, and signal processing 32.2 (1984), pp. 236–243

  2. [9]

    CLIPScore: A Reference-free Evaluation Metric for Im- age Captioning

    Jack Hessel et al. CLIPScore: A Reference-free Evaluation Metric for Im- age Captioning. 2022. arXiv: 2104.08718 [cs.CV]. url: https://arxiv. org/abs/2104.08718

  3. [10]

    Neural networks for machine learning lecture 6a overview of mini-batch gradient descent

    Geoffrey Hinton, Nitish Srivastava, and Kevin Swersky. “Neural networks for machine learning lecture 6a overview of mini-batch gradient descent”. In: Cited on 14.8 (2012), p. 2

  4. [11]

    Inversion of neural networks by gradient descent

    Joerg Kindermann and Alexander Linden. “Inversion of neural networks by gradient descent”. In: Parallel computing 14.3 (1990), pp. 277–286

  5. [12]

    Kingma and Jimmy Ba

    Diederik P. Kingma and Jimmy Ba. Adam: A Method for Stochastic Op- timization. 2017. arXiv: 1412.6980 [cs.LG]. url: https://arxiv.org/ abs/1412.6980

  6. [13]

    ImageNet Clas- sification with Deep Convolutional Neural Networks

    Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. “ImageNet Clas- sification with Deep Convolutional Neural Networks”. In: Advances in Neural Information Processing Systems . Ed. by F. Pereira et al. Vol. 25. Curran Associates, Inc., 2012. url: https://proceedings.neurip...

  7. [14]

    BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

    Junnan Li et al. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. 2022. arXiv: 2201. 12086 [cs.CV]. url: https://arxiv.org/abs/2201.12086

  8. [15]

    Landscape Learning for Neural Network Inversion

    Ruoshi Liu et al. Landscape Learning for Neural Network Inversion. 2022. arXiv: 2206.09027 [cs.CV]. url: https://arxiv.org/abs/2206.09027

  9. [16]

    Decoupled Weight Decay Regularization

    Ilya Loshchilov and Frank Hutter. Decoupled Weight Decay Regularization

  10. [17]

    Towards Deep Learning Models Resistant to Ad- versarial Attacks

    Aleksander Madry et al. Towards Deep Learning Models Resistant to Ad- versarial Attacks . 2019. arXiv: 1706.06083 [stat.ML]. url: https:// arxiv.org/abs/1706.06083

  11. [18]

    Efficient Estimation of Word Representations in Vector Space

    Tomas Mikolov et al. Efficient Estimation of Word Representations in Vector Space. 2013. arXiv: 1301.3781 [cs.CL]. url: https://arxiv. org/abs/1301.3781

  12. [19]

    OpenAI. Whisper. GitHub, 2022. url: https://github.com/openai/ whisper

  13. [20]

    Glove: Global Vectors for Word Representation

    Jeffrey Pennington, Richard Socher, and Christopher Manning. “Glove: Global Vectors for Word Representation”. In: vol. 14. Jan. 2014, pp. 1532–

  14. [21]

    Some methods of speeding up the convergence of iter- ation methods

    Boris T Polyak. “Some methods of speeding up the convergence of iter- ation methods”. In: Ussr computational mathematics and mathematical physics 4.5 (1964), pp. 1–17

  15. [22]

    Improving language understanding by generative pre- training

    Alec Radford et al. “Improving language understanding by generative pre- training”. In: (2018)

  16. [23]

    Language models are unsupervised multitask learn- ers

    Alec Radford et al. “Language models are unsupervised multitask learn- ers”. In: OpenAI blog 1.8 (2019), p. 9

  17. [24]

    Robust Speech Recognition via Large-Scale Weak Su- pervision

    Alec Radford et al. Robust Speech Recognition via Large-Scale Weak Su- pervision. 2022. arXiv: 2212.04356 [eess.AS]. url: https://arxiv. org/abs/2212.04356

  18. [25]

    GitHub - resemble-ai/chatterbox: SoTA open-source TTS

    resemble-ai. GitHub - resemble-ai/chatterbox: SoTA open-source TTS. GitHub,

  19. [26]

    Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs

    A.W. Rix et al. “Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs”. In: 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221). Vol. 2. 2001, 749–...

  20. [27]

    A stochastic approximation method

    Herbert Robbins and Sutton Monro. “A stochastic approximation method”. In: The annals of mathematical statistics (1951), pp. 400–407

  21. [28]

    Learning representations by back-propagating errors

    David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. “Learning representations by back-propagating errors”. In: nature 323.6088 (1986), pp. 533–536

  22. [30]

    BERTScore: Evaluating Text Generation with BERT

    Tianyi Zhang et al. BERTScore: Evaluating Text Generation with BERT

  23. [1543]

    doi: 10.3115/v1/D14-1162

  24. [2019]

    url: https://arxiv.org/abs/1711

    arXiv: 1711.05101 [cs.LG]. url: https://arxiv.org/abs/1711. 05101. 33

  25. [2020]

    url: https://arxiv.org/abs/1904

    arXiv: 1904.09675 [cs.CL]. url: https://arxiv.org/abs/1904. 09675. 34

  26. [2025]

    url: https://github.com/resemble-ai/chatterbox

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.