Pith. sign in

REVIEW 2 major objections 4 minor 300 references

SimulS2ST-Omni: Data-Efficient Streaming Speech-to-Speech Translation via Explicit Trajectory Supervision

T0 review · 2 major / 4 minor · reviewed 2026-08-01 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Streaming speech-to-speech translation is trainable from ~2,000 hours of paired audio when a joint text-code trajectory schedule and a two-stream Thinker–Talker design replace separate speech-side controllers.

desk verdict Solid empirical recipe for data-efficient streaming S2ST; the main qualification is a missing quantification of alignment-error residue in the trajectories, not a demonstrated flaw. read the letter →

arxiv 2607.19810 v1 pith:4EMQOHVS submitted 2026-07-22 cs.SD

Rongshen He , Xinyu Liang , Dekun Chen , Jiaqi Li , Mingjie Chen , Zhizheng Wu This is my paper
classification cs.SD
keywords streamingspeech-to-speechtranslationtrajectorysupervisionjointtext-codecommitmentThinker–Talkerfactorizationsemanticcodesdataefficiencysimultaneousinterpretationlatency–qualitytrade-off
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that the main obstacle to streaming speech-to-speech translation (S2ST) is not reasoning capacity but supervision structure. It proposes a training recipe in which a speech language model is taught to translate continuously using only about 2,000 hours of paired cross-lingual audio, layered on much more abundant ASR, speech-to-text, machine-translation, and TTS data. The central device is joint text-code trajectory supervision: target words and their acoustic semantic codes are tied to monotonized source boundaries and emitted together in chunks, so the model learns a read/wait/write policy without a separate speech-side controller. A two-stream architecture — a Thinker that plans target text and a lightweight Talker that predicts acoustic codes from the Thinker's hidden states — is shown to beat a matched unified decoder across latency tiers. If correct, the recipe lowers the data barrier for streaming S2ST from tens of thousands of hours to a few thousand, and matches or approaches a closed-source commercial system on RealSI while setting a strong frontier on ACL60/60-dev.

What carries the argument

The central object is the streaming trajectory τ = {(Y^text_c, Y^code_c, g_c)}: a chunk-wise schedule that says which source prefix must be read before the model may write both the target text chunk and its acoustic semantic codes. Boundaries come from forced alignment of source and target speech plus cross-lingual word alignment (SimAlign), monotonized to handle local reordering, then grouped into one-second read steps; latency tiers are induced by a sampled multiplier m ∈ {1,…,12} so one checkpoint covers all latencies. The second load-bearing mechanism is the Thinker–Talker factorization, p(Y^text_c | C_c) · p(Y^code_c | C_c, Y^text_c, H_θ), which routes code prediction through a lightwei

What would settle it

Re-run the identical recipe on naturally recorded simultaneous interpretation with ground-truth commit times. If streaming ASR-BLEU at the lowest latency tiers collapses — or if replacing the clean-reference alignment with an ASR-transcript alignment shifts a target word's unlock time from 0.08 s to ~0.96 s on disfluent speech, exactly the failure documented in Appendix J.2 — then the trajectory's low-latency benefit is not stable under alignment error. A complementary check: full-budget training across multiple seeds, since the reported seed stability covers only the cheaper 10%-without-aux a

Watch

Extended reading notes

Core claim

The paper's claim, stated the way a sympathetic reader would state it: a speech language model can do sentence-level and long-form streaming S2ST with competitive quality–latency trade-offs from only about 2,000 hours of filtered paired S2ST data, provided three things are in place: auxiliary multitask pretraining anchors the model; the paired data are converted into a joint text-code commitment path in which each target word and its code span inherits a monotonized, source-aligned boundary and is emitted in one chunk; and text planning is architecturally separated from dense acoustic-code prediction. Offline S2ST becomes the special case of a single chunk; streaming is the general case. The

Load-bearing premise

The load-bearing premise is that the paired S2ST training signal — target speech synthesized by a TTS model, word boundaries from forced alignment, cross-lingual links from an alignment model, candidates kept by an ASR filter — is trustworthy enough that the commit times it encodes match real interpreting conditions; the paper's own Limitations section and Appendix J.2 (a forced-alignment error that unlocks a target word at 0.08 s before real content arrives) show where this

Editorial extensions

If this is right

  • The paired-S2ST data requirement for streaming S2ST drops from tens of thousands of hours to about 2,000 — and the ablation shows keeping the auxiliary mixture matters more than the exact paired budget, with 10% of the paired data still competitive.
  • A single checkpoint can serve every latency tier, because training samples a latency multiplier over m∈{1,…,12}; deployment can trade latency against quality without retraining.
  • The unified-decoder baseline stays below the two-stream model at every tier even with identical trajectory supervision, which the paper reads as structural evidence that text planning and dense code prediction should be decoupled under data constraints.
  • Long-form, unbounded streaming does not collapse: on RealSI long-form S2ST the system stays competitive with LiveInterpret 2.0 from m4–m6, and on ACL60/60-dev it beats recent academic S2TT systems at comparable latency.
  • Offline S2ST is recovered as the C=1 special case, so the same recipe yields an offline model that matches UniSS(Q) on CVSS-T Text-BLEU/ASR-BLEU.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because the trajectory is only as reliable as its alignments, the recipe's practical ceiling on real disfluent speech likely depends on the same failure mode the paper documents in its own Appendix J.2 — a forced-alignment error unlocking a target word at 0.08 s before real content arrives. A natural next step, which the paper leaves implicit, is to mine naturally recorded simultaneous interpretat
  • The joint text-code commitment idea is not tied to S2ST: any streaming generation task that must emit dense perceptual codes along a text-like plan — e.g., live dubbing with lip-sync constraints or streaming speech-to-music captioning — could reuse the same chunk-factorized objective.
  • The paper keeps the speech encoder and acoustic backend frozen; it states the chunk-wise flow-matching decoder is not fully streaming-native. If a streaming-native backend were adopted, the remaining boundary artifacts and the gap to the RTF<1 regime at low latency might close — a testable engineering extension.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 4 minor

Summary. The paper proposes a training recipe for streaming speech-to-speech translation (S2ST) that uses only ~2k hours of paired cross-lingual S2ST data, layered atop large auxiliary multitask supervision. The main contributions are (1) a joint text-code trajectory supervision that schedules target text and acoustic semantic codes as a unified commitment path, and (2) a two-stream Thinker–Talker architecture that factorizes linguistic planning from dense acoustic code prediction. The system is evaluated on CVSS-T for offline S2ST, RealSI for sentence-level and long-form streaming S2ST/S2TT, and ACL60/60-dev for long-form S2TT, with ablations on data filtering, budget reduction, and latency-multiplier sampling. The authors report competitive quality–latency trade-offs, including matching a closed-source system (LiveInterpret 2.0) on ASR-BLEU in several operating regimes. The paper is an empirical training-recipe evaluation with multiple benchmarks, an ASR-backend sensitivity check, a seed-reproducibility proxy, and a small human/LLM-judge study.

Significance. If the results hold, this is a practically significant demonstration that careful trajectory construction, auxiliary multitask training, and a two-stream architecture can largely compensate for a very small paired-S2ST budget. The paper's strengths are its controlled matched-backbone comparison, the breadth of streaming evaluation (sentence-level and long-form, S2TT and S2ST, multiple latency metrics), the ASR-backend sensitivity analysis, the seed-variance proxy, and the unusually explicit disclosure of failure modes. The central risk is the unquantified reliability of the automatically constructed trajectories, since the paper's core contribution is explicitly a trajectory-based supervision method. The attached stress-test concern about forced-alignment/SimAlign errors is real and is not adequately resolved by the current filtering description.

major comments (2)
  1. [§3.2, §A.4, App. J.2] The core contribution is trajectory supervision, whose validity depends on force-aligned source/target word boundaries and SimAlign links. The paper's own Appendix J.2 shows a concrete failure: an FA error under transcript–audio mismatch unlocks a target word at 0.08 s, before real content arrives. The filtering described in §A.4 retains roughly 79–80% of candidates under ASR error-rate thresholds, but these thresholds check content, not commit-time correctness; no estimate is given of the residual fraction of trajectories with premature ready_times. If such trajectories are systematic, the learned streaming policy could appear artificially aggressive at low latency, which would directly affect the quality–latency comparison with LiveInterpret 2.0 in Table 3 and Figures 3–4. Please quantify the residual rate (e.g., by re-aligning a sample of retained trajectories with an ASR transcript a
  2. [§4.4, Table 3, Fig. 3, App. F] The headline "matching LiveInterpret 2.0" relies on a mixed measurement protocol: ASR-BLEU is computed locally from API-obtained audio under a unified pipeline, but the latency coordinate of the LiveInterpret operating point is the value reported in its paper (footnote 1), not measured under the same SimulEval/LAAL conditions used for the authors' own points. LAAL is sensitive to segmentation and simulator settings; the paper's Appendix F shows that when computation-aware latency is measured directly via the API, LiveInterpret shifts rightward by several seconds, changing the comparison. To support the abstract's claim, the main-text comparison should use latency values measured under a single protocol (or should present the Appendix F computation-aware comparison as the primary evidence).
minor comments (4)
  1. [§4.1, App. G.1] The main results in Table 3 and Figures 3–5 are from single training runs. The 3-seed reproducibility check is only for the cheaper 10% w/o aux proxy, which is reassuring but not a substitute for variance estimates at the main operating points. Please state this limitation explicitly in the main text and consider reporting at least one additional seed for the headline comparison.
  2. [Table 5 vs. Table 12] Table 5 reports Talker 10% w/o aux En→Zh m1 = 9.47, while Table 12 gives 9.04±0.54 for the same condition. These are close but not identical; clarify whether the numbers are from different runs or whether Table 5 uses a different decoding configuration, so readers can reconcile them.
  3. [Fig. 1] The trajectory-construction figure is dense. Consider explicitly labeling the time axis and the meaning of the color-coded brackets in the caption, since the monotonicization step is essential to the method.
  4. [App. H.1] The human listening study has N=15 per direction. The statistical tests and ICC are helpful, but this scale should be acknowledged as a limitation in the main text when human evidence is cited, not only in the appendix.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity; empirical recipe evaluated on held-out benchmarks; minor self-reliance on own components is not load-bearing.

full rationale

The paper's central claim is an empirical training recipe, not a derivation. The trajectory objective in Eq. (2) is constructed from forced alignments and SimAlign in Section 3.2, and the trained model is evaluated on held-out real recordings (RealSI, ACL60/60-dev, CVSS-T). No test-set target is used to fit any parameter, and no reported number is identical by construction to a fitted input: latency tiers are induced by the multiplier m, but ASR-BLEU, BLEU, A.PCP, and SIM-O are measured from generated outputs, and comparisons to LiveInterpret 2.0 and UniSS are external. The self-citations (DualCodec, FlexiVoice, Emilia) appear as fixed tokenizer, acoustic-backend, and data inputs rather than as evidence for the target S2ST claim, so they are ordinary self-reliance rather than circular justification. Appendix J.2 documents a real data-quality failure (a forced-alignment error unlocking a word at 0.08 s) and J.3 a premature-emission case; these are correctness and latency risks, not circular steps, and the paper's own mitigation via ASR re-transcription and filtering (Section A.4) is acknowledged rather than hidden. Overall, no load-bearing reduction to the paper's own inputs was found.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The central claim rests on the quality of constructed trajectories (alignments, NIR filtering, ASR thresholds) and on the synthetic target speech being representative. These are training-pipeline choices rather than fitted physical constants, but the RANDOM vs NIR ablation shows that at least one of them (NIR filtering) materially changes the low-latency result. No new physical or architectural entities are postulated beyond the training constructs described in the method.

free parameters (5)
  • source chunk interval = 1 second
    Defines trajectory granularity in §3.2; all streaming tiers and the chunk-factorized objective depend on this discretization.
  • NIR difficulty and length quotas = difficulty {high:0.1, mid_high:0.3, mid_low:0.4, low:0.2}; length {short:0.1, medium:0.5, long:0.4}
    Used in A.3 to select training trajectories; the RANDOM vs NIR ablation in Table 4 shows a large m1 effect, so this choice is load-bearing for low-latency quality.
  • ASR pair filtering thresholds = 5% Chinese / 7% English
    A.4; sets which synthesized pairs enter training, retaining roughly 79–80% of candidates.
  • latency multiplier sampling parameters = a=0.18, b=0.017, Mmax=12; Gaussian mean=3.5, variance=4.0
    B.1; controls the distribution of read/write steps during streaming finetuning and defines the latency tiers used in evaluation.
  • stage data mixture ratio = ASR:S2TT:MT:TTS:S2ST = 0.2:1:0.5:1:1.5
    Stage 2 recipe; the data-efficiency claim depends on the presence of the auxiliary mixture, as shown by the 10% w/o aux ablation in Table 5.
assumptions (4)
  • domain assumption Forced alignment and SimAlign give reliable word-level cross-lingual boundaries for committing target words.
    Section 3.2 Step 1; incorrect FA can unlock target words too early, as the paper's own J.2 bad-case shows.
  • domain assumption Target speech synthesized with OmniVoice under voice cloning is adequate supervision for learning semantic-code prediction on real target speech.
    A.2 and Limitations; the paired S2ST data is entirely synthesized rather than collected from natural simultaneous interpretation.
  • domain assumption Chunk-factorized teacher-forced log-likelihood (Eq. 2) is a valid surrogate for the streaming read/write policy.
    The model is trained on teacher trajectories and never trains on its own emitted audio; inference assumes that this transfers to committed, irrevocable streaming decisions.
  • domain assumption ASR-BLEU via Whisper-large-v3/Paraformer measures translation fidelity of synthesized speech.
    Appendix D.3; the paper's own G.2 probe with Qwen3-ASR-1.7B changes one of four settings, so the metric is not fully backend-invariant.

how reviews work

0 comments
Cite this review

Pith. "Pith review of SimulS2ST-Omni: Data-Efficient Streaming Speech-to-Speech Translation via Explicit Trajectory Supervision." pith.science (2026). https://pith.science/paper/4EMQOHVS

@misc{pith2026260719810,
  author       = {Pith},
  title        = {Pith review of: SimulS2ST-Omni: Data-Efficient Streaming Speech-to-Speech Translation via Explicit Trajectory Supervision},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/4EMQOHVS}},
  note         = {Machine review of arXiv:2607.19810}
}
abstract

Long-form streaming speech-to-speech translation (S2ST) requires incremental, unbounded translation under strict latency constraints. Existing methods typically suffer from sentence-bounded supervision or demand massive paired-S2ST supervision. We introduce a training recipe enabling a speech language model for sentence-level and long-form streaming S2ST using only $\sim$2k hours of paired cross-lingual S2ST data, layered atop auxiliary supervision. Anchored by auxiliary multitask training, our approach remains robust even when the paired-S2ST budget itself is reduced by 90\%. Our core contribution, joint text-code trajectory supervision, schedules target text and acoustic semantic codes as a unified commitment path, eliminating the need for separate, unstable speech-side emission controllers. Furthermore, our two-stream Thinker--Talker factorization significantly outperforms unified-decoder baselines by decoupling linguistic reasoning from dense acoustic prediction to mitigate modality interference. Finally, our system achieves highly competitive quality-latency trade-offs on RealSI and ACL60/60-dev, matching state-of-the-art, closed-source S2ST systems such as LiveInterpret~2.0 on ASR-BLEU.

Figures

Figures reproduced from arXiv: 2607.19810 by the authors.

Figure 1
Figure 1. Streaming trajectory construction. Step 1: Word-level and cross-lingual alignments establish the earliest valid source prefix for each target word. Step 2: Target text and segmented target speech codes inherit monotonized boundaries and are grouped into discrete read/wait/write steps for joint emission. 3 Method 3.1 Problem Setup and Formulation A paired-audio S2ST dataset consists of N train￾ing samples, denoted as… view at source ↗
Figure 2
Figure 2. Matched backbone comparison. Thinker–Talker (left) and Dec-only (right) share an identical speech encoder, base LLM backbone (with independent LoRA adapters), semantic-code tokenizer Q, and frozen flow￾matching/vocoder backend. inherit the same monotonized source boundary t˜i . To form fixed-size streaming steps, we group adja￾cent target words and their codes whose boundaries fall within the same pre-defined source… view at source ↗
Figure 3
Figure 3. RealSI sentence-level content trade-off. Dashed curves denote S2TT text BLEU, solid curves denote S2ST ASR-BLEU, and horizontal lines mark offline reference lines [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figures from the paper (16 more)
Figure 4
Figure 4. Figure 4: RealSI sentence-level acoustic quality trade￾off: A.PCP and SIM-O against LAAL for En→Zh and Zh→En. trade-off. The two-stream Talker vastly outper￾forms both Seamless streaming and the matched Dec-only baseline across all latency tiers in both directions. Crucially, th…
Figure 5
Figure 5. Figure 5: ACL60/60-dev long-form streaming S2TT En→Zh trade-off: BLEU against StreamLAAL for En→Zh and Zh→En. a tight, approaching margin on Zh→En. This con￾firms that the joint text-code commitment path ef￾fectively manages long-form target speech genera￾tion [PITH_FULL_IMAGE:…
Figure 6
Figure 6. Figure 6: Pooled NIR and Spearman distributions for [PITH_FULL_IMAGE:figures/full_fig_p014_6.png]
Figure 7
Figure 7. Figure 7: RealSI long-form streaming S2TT trade-off for both directions. [PITH_FULL_IMAGE:figures/full_fig_p021_7.png]
Figure 8
Figure 8. Figure 8: RealSI Sentence-level simultaneous S2ST under LAAL_CA. ASR-BLEU is plotted against computation [PITH_FULL_IMAGE:figures/full_fig_p021_8.png]
Figure 9
Figure 9. Figure 9: RealSI sentence-level simultaneous S2ST: active compute RTF vs. LAAL_CA. RTF counts only non-idle [PITH_FULL_IMAGE:figures/full_fig_p022_9.png]
Figure 10
Figure 10. Figure 10: RealSI long-form simultaneous S2TT under StreamLAAL_CA. [PITH_FULL_IMAGE:figures/full_fig_p022_10.png]
Figure 11
Figure 11. Figure 11: ACL60/60-dev Long-form simultaneous S2TT under StreamLAAL_CA. G.2 ASR Backend Sensitivity ASR-BLEU transcribes synthesized target speech with an ASR system and scores the transcript against the reference translation, so the metric can inherit systematic biases of the …
Figure 12
Figure 12. Figure 12: Anonymized rating interface used in the human listening study. Systems are randomly assigned to slots [PITH_FULL_IMAGE:figures/full_fig_p024_12.png]
Figure 13
Figure 13. Figure 13: RealSI S2ST case study: En→Zh, m=1. Source um this ti this time uh uh uh this time he gives simeon the back of his hand um and not incidentally spreads his arms arms in a kind of ins in innocent spontaneous spontaneous um reminder reminder of the crucifixion in the fu…
Figure 14
Figure 14. Figure 14: RealSI S2ST case study: En→Zh, m=2. Source 0 5 10 15 20 Time (s) Target For example, this company has this kind of, uh, you know, uh, you've sold this product, but but, but it's like, even if your company isn'tbankrupt on its own, well, it's not going to affect WAIT i…
Figure 15
Figure 15. Figure 15: RealSI S2ST case study: Zh→En, m=1 [PITH_FULL_IMAGE:figures/full_fig_p026_15.png]
Figure 16
Figure 16. Figure 16: RealSI S2ST case study: Zh→En, m=2. Re-timed (concatenated) Original (continuous) [PITH_FULL_IMAGE:figures/full_fig_p027_16.png]
Figure 17
Figure 17. Figure 17: Boundary concatenation artifact (mel spectrogram). [PITH_FULL_IMAGE:figures/full_fig_p027_17.png]
Figure 18
Figure 18. Figure 18: FA under transcript–audio mismatch (source clip; the false start [PITH_FULL_IMAGE:figures/full_fig_p029_18.png]
Figure 19
Figure 19. Figure 19: Premature emission / wrong write (Zh→En), source-consumed axis. Top: source. Middle (m=2): the agent commits “It’s called a podium.” at 6.0 s—before the disambiguating source (“sage”) arrives—then stalls in a WAIT. Bottom (m=4): the wider read window lets it hear the …

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

300 extracted references · 17 canonical work pages

  1. [1]

    Neural Information Processing Systems , year=

    Neural Ordinary Differential Equations , author=. Neural Information Processing Systems , year=

  2. [2]

    International Conference on Learning Representations , year=

    Flow Matching for Generative Modeling , author=. International Conference on Learning Representations , year=

  3. [3]

    2023 , eprint=

    Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervision , author=. 2023 , eprint=

    2023

  4. [4]

    ArXiv , year=

    Language Models are Few-Shot Learners , author=. ArXiv , year=

  5. [5]

    Alex Nichol and Prafulla Dhariwal and Aditya Ramesh and Pranav Shyam and Pamela Mishkin and Bob McGrew and Ilya Sutskever and Mark Chen , booktitle=

  6. [6]

    ArXiv , year=

    Zero-Shot Text-to-Image Generation , author=. ArXiv , year=

  7. [7]

    ACM Computing Surveys , year=

    Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing , author=. ACM Computing Surveys , year=

  8. [8]

    ArXiv , year=

    Scaling Laws for Generative Mixed-Modal Language Models , author=. ArXiv , year=

Show all 300 references
  1. [9]

    ArXiv , year=

    Training Compute-Optimal Large Language Models , author=. ArXiv , year=

  2. [10]

    International Conference on Machine Learning , year=

    Conditional variational autoencoder with adversarial learning for end-to-end text-to-speech , author=. International Conference on Machine Learning , year=

  3. [11]

    Kim, Jaehyeon and Kim, Sungwon and Kong, Jungil and Yoon, Sungroh , journal=

  4. [12]

    Rongjie Huang and Max W. Y. Lam and J. Wang and Dan Su and Dong Yu and Yi Ren and Zhou Zhao , booktitle=

  5. [13]

    Soong and Tao Qin and Sheng Zhao and Tie-Yan Liu , journal=

    Xu Tan and Jiawei Chen and Haohe Liu and Jian Cong and Chen Zhang and Yanqing Liu and Xi Wang and Yichong Leng and Yuanhao Yi and Lei He and Frank K. Soong and Tao Qin and Sheng Zhao and Tie-Yan Liu , journal=. 2022 , volume=

    2022

  6. [14]

    CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR Voice Cloning Toolkit (version 0.92) , author=

  7. [15]

    International Conference on Language Resources and Evaluation , year=

    Common Voice: A Massively-Multilingual Speech Corpus , author=. International Conference on Language Resources and Evaluation , year=

  8. [16]

    International Conference on Acoustics, Speech and Signal Processing , year=

    Librispeech: An ASR corpus based on public domain audio books , author=. International Conference on Acoustics, Speech and Signal Processing , year=

  9. [17]

    International Conference on Learning Representations , year=

    Hierarchical Generative Modeling for Controllable Speech Synthesis , author=. International Conference on Learning Representations , year=

  10. [18]

    Conference on Empirical Methods in Natural Language Processing , year=

    fairseq S ^2 : A Scalable and Integrable Speech Synthesis Toolkit , author=. Conference on Empirical Methods in Natural Language Processing , year=

  11. [19]

    International Conference on Machine Learning , year=

    Edresson Casanova and Julian Weber and Christopher Dane Shulby and Arnaldo C. International Conference on Machine Learning , year=

  12. [20]

    International Conference on Learning Representations , year=

    FastSpeech 2: Fast and High-Quality End-to-End Text to Speech , author=. International Conference on Learning Representations , year=

  13. [21]

    Vadim Popov and Ivan Vovk and Vladimir Gogoryan and Tasnima Sadekova and Mikhail Kudinov , booktitle=

  14. [22]

    Advances in Neural Information Processing Systems , year=

    Denoising diffusion probabilistic models , author=. Advances in Neural Information Processing Systems , year=

  15. [23]

    International Conference on Acoustics, Speech and Signal Processing , year=

    Jacob Kahn and Morgane Rivi. International Conference on Acoustics, Speech and Signal Processing , year=

  16. [24]

    ArXiv , year=

    MLS: A Large-Scale Multilingual Dataset for Speech Research , author=. ArXiv , year=

  17. [25]

    Kameoka and Takuhiro Kaneko and Kou Tanaka and Nobukatsu Hojo , journal=

    H. Kameoka and Takuhiro Kaneko and Kou Tanaka and Nobukatsu Hojo , journal=

  18. [26]

    ArXiv , year=

    The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods , author=. ArXiv , year=

    2018

  19. [27]

    Sequence-to-sequence modelling of

    Robinson, Carl and Obin, Nicolas and Roebel, Axel , booktitle=. Sequence-to-sequence modelling of

  20. [28]

    Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , year=

    Textless speech emotion conversion using decomposed and discrete representations , author=. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , year=

    2022

  21. [29]

    IEEE/ACM Transactions on Audio, Speech, and Language Processing , volume=

    A regression approach to speech enhancement based on deep neural networks , author=. IEEE/ACM Transactions on Audio, Speech, and Language Processing , volume=. 2014 , publisher=

    2014

  22. [30]

    ArXiv , year=

    Real Time Speech Enhancement in the Waveform Domain , author=. ArXiv , year=

  23. [31]

    ArXiv , year=

    Universal Speech Enhancement with Score-based Diffusion , author=. ArXiv , year=

  24. [32]

    Advances in neural information processing systems , year=

    Transfer learning from speaker verification to multispeaker text-to-speech synthesis , author=. Advances in neural information processing systems , year=

  25. [33]

    International Conference on Machine Learning , year=

    Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis , author=. International Conference on Machine Learning , year=

  26. [34]

    ArXiv , year=

    Expressive Speech Synthesis via Modeling Expressions with Variational Autoencoder , author=. ArXiv , year=

  27. [35]

    Weiss and Mike Schuster and Navdeep Jaitly and Zongheng Yang and Z

    Jonathan Shen and Ruoming Pang and Ron J. Weiss and Mike Schuster and Navdeep Jaitly and Zongheng Yang and Z. Chen and Yu Zhang and Yuxuan Wang and R. J. Skerry-Ryan and Rif A. Saurous and Yannis Agiomyrgiannakis and Yonghui Wu , journal=. Natural

  28. [36]

    Transactions of the Association for Computational Linguistics , year=

    On Generative Spoken Language Modeling from Raw Audio , author=. Transactions of the Association for Computational Linguistics , year=

  29. [37]

    He Bai and Renjie Zheng and Junkun Chen and Xintong Li and Mingbo Ma and Liang Huang , booktitle=

  30. [38]

    Interspeech , year=

    Zal. Interspeech , year=

  31. [39]

    ArXiv , year=

    Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers , author=. ArXiv , year=

  32. [40]

    ArXiv , year=

    High Fidelity Neural Audio Compression , author=. ArXiv , year=

  33. [41]

    IEEE/ACM Transactions on Audio, Speech, and Language Processing , year=

    SoundStream: An End-to-End Neural Audio Codec , author=. IEEE/ACM Transactions on Audio, Speech, and Language Processing , year=

  34. [42]

    IEEE/ACM Transactions on Audio, Speech, and Language Processing , year=

    HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units , author=. IEEE/ACM Transactions on Audio, Speech, and Language Processing , year=

  35. [43]

    ArXiv , year=

    Robust Speech Recognition via Large-Scale Weak Supervision , author=. ArXiv , year=

  36. [44]

    Annual Meeting of the Association for Computational Linguistics , year=

    Text-Free Prosody-Aware Generative Spoken Language Modeling , author=. Annual Meeting of the Association for Computational Linguistics , year=

  37. [45]

    Transactions of the Association for Computational Linguistics , year=

    Generative Spoken Dialogue Language Modeling , author=. Transactions of the Association for Computational Linguistics , year=

  38. [46]

    Interspeech , year=

    Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi , author=. Interspeech , year=

  39. [47]

    ArXiv , year=

    Attention is All you Need , author=. ArXiv , year=

  40. [48]

    ArXiv , year=

    Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation , author=. ArXiv , year=

  41. [49]

    CoRR , year=

    Adam: A Method for Stochastic Optimization , author=. CoRR , year=

  42. [50]

    Chen, Ricky T. Q. , title=. 2018 , url=

    2018

  43. [51]

    Journal of Computational and Applied Mathematics , year=

    A family of embedded Runge-Kutta formulae , author=. Journal of Computational and Applied Mathematics , year=

  44. [52]

    International Conference on Acoustics, Speech and Signal Processing , year=

    Fastpitch: Parallel text-to-speech with pitch prediction , author=. International Conference on Acoustics, Speech and Signal Processing , year=

  45. [53]

    ACM SIGGRAPH 2022 Conference Proceedings , year=

    Palette: Image-to-image diffusion models , author=. ACM SIGGRAPH 2022 Conference Proceedings , year=

    2022

  46. [54]

    International Conference on Acoustics, Speech and Signal Processing , year=

    Ribeiro, Fl. International Conference on Acoustics, Speech and Signal Processing , year=

  47. [55]

    Proceedings of IEEE pacific rim conference on communications computers and signal processing , volume=

    Mel-cepstral distance measure for objective speech quality assessment , author=. Proceedings of IEEE pacific rim conference on communications computers and signal processing , volume=. 1993 , organization=

    1993

  48. [56]

    international conference on machine learning , pages=

    Towards end-to-end prosody transfer for expressive speech synthesis with tacotron , author=. international conference on machine learning , pages=. 2018 , organization=

    2018

  49. [57]

    ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=

    SDR--half-baked or well done? , author=. ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=. 2019 , organization=

    2019

  50. [58]

    arXiv preprint arXiv:1904.02882 , year=

    Libritts: A corpus derived from librispeech for text-to-speech , author=. arXiv preprint arXiv:1904.02882 , year=

    1904 arXiv

  51. [59]

    Language Resources and Evaluation , volume=

    TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese , author=. Language Resources and Evaluation , volume=. 2022 , publisher=

    2022

  52. [60]

    arXiv preprint arXiv:2005.08100 , year=

    Conformer: Convolution-augmented transformer for speech recognition , author=. arXiv preprint arXiv:2005.08100 , year=

    2005 arXiv

  53. [61]

    Yamamoto, Ryuichi and Song, Eunwoo and Kim, Jae-Min , booktitle=

  54. [62]

    Kevin Kilgour and Mauricio Zuluaga and Dominik Roblek and Matthew Sharifi , booktitle=. Fr

  55. [63]

    Interspeech , year=

    VoxCeleb2: Deep Speaker Recognition , author=. Interspeech , year=

  56. [64]

    Desplanques, Brecht and Thienpondt, Jenthe and Demuynck, Kris , booktitle=

  57. [65]

    arXiv preprint arXiv:2207.12598 , year=

    Classifier-free diffusion guidance , author=. arXiv preprint arXiv:2207.12598 , year=

    arXiv

  58. [66]

    Diffusion models beat

    Dhariwal, Prafulla and Nichol, Alexander , journal=. Diffusion models beat

  59. [67]

    arXiv preprint arXiv:1809.11096 , year=

    Large scale GAN training for high fidelity natural image synthesis , author=. arXiv preprint arXiv:1809.11096 , year=

    arXiv

  60. [68]

    Advances in neural information processing systems , volume=

    Glow: Generative flow with invertible 1x1 convolutions , author=. Advances in neural information processing systems , volume=

  61. [69]

    Advances in neural information processing systems , year=

    wav2vec 2.0: A framework for self-supervised learning of speech representations , author=. Advances in neural information processing systems , year=

  62. [70]

    Workshop on automatic speech recognition and understanding , year=

    The Kaldi speech recognition toolkit , author=. Workshop on automatic speech recognition and understanding , year=

  63. [71]

    Heusel, Martin and Ramsauer, Hubert and Unterthiner, Thomas and Nessler, Bernhard and Hochreiter, Sepp , journal=

  64. [72]

    Paszke, Adam and Gross, Sam and Massa, Francisco and Lerer, Adam and Bradbury, James and Chanan, Gregory and Killeen, Trevor and Lin, Zeming and Gimelshein, Natalia and Antiga, Luca and others , journal=

  65. [73]

    Park and William Chan and Yu Zhang and Chung-Cheng Chiu and Barret Zoph and Ekin Dogus Cubuk and Quoc V

    Daniel S. Park and William Chan and Yu Zhang and Chung-Cheng Chiu and Barret Zoph and Ekin Dogus Cubuk and Quoc V. Le , booktitle=

  66. [74]

    Acoustics, Speech, and Signal Processing, IEEE International Conference on , volume=

    SWITCHBOARD: Telephone speech corpus for research and development , author=. Acoustics, Speech, and Signal Processing, IEEE International Conference on , volume=. 1992 , organization=

    1992

  67. [75]

    arXiv preprint arXiv:2212.11377 , year=

    ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement , author=. arXiv preprint arXiv:2212.11377 , year=

    arXiv

  68. [76]

    Proceedings of the IEEE/CVF International conference on computer vision , pages=

    Artificial fingerprinting for generative models: Rooting deepfake attribution in training data , author=. Proceedings of the IEEE/CVF International conference on computer vision , pages=

  69. [77]

    Interspeech , year=

    Speech Resynthesis from Discrete Disentangled Self-Supervised Representations , author=. Interspeech , year=

  70. [78]

    IEEE Journal of Selected Topics in Signal Processing , volume=

    Wavlm: Large-scale self-supervised pre-training for full stack speech processing , author=. IEEE Journal of Selected Topics in Signal Processing , volume=. 2022 , publisher=

    2022

  71. [79]

    Interspeech 2022, 23rd Annual Conference of the International Speech Communication Association, Incheon, Korea, 18-22 September 2022 , pages =

    Arun Babu and Changhan Wang and Andros Tjandra and Kushal Lakhotia and Qiantong Xu and Naman Goyal and Kritika Singh and Patrick von Platen and Yatharth Saraf and Juan Pino and Alexei Baevski and Alexis Conneau and Michael Auli , editor =. Interspeech 2022, 23rd Annual Confere...

    2022

  72. [80]

    arXiv preprint arXiv:2304.09116 , year=

    Naturalspeech 2: Latent diffusion models are natural and zero-shot speech and singing synthesizers , author=. arXiv preprint arXiv:2304.09116 , year=

    arXiv

  73. [81]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , year=

    High-resolution image synthesis with latent diffusion models , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , year=

  74. [82]

    Advances in neural information processing systems , volume=

    Generative modeling by estimating gradients of the data distribution , author=. Advances in neural information processing systems , volume=

  75. [83]

    2023 , eprint =

    Loïc Barrault and Yu-An Chung and Mariano Coria Meglioli and David Dale and Ning Dong and Mark Duppenthaler and others , title =. 2023 , eprint =

    2023

  76. [84]

    2017 , pages =

    Ondrej Bojar and Rajen Chatterjee and Christian Federmann and Yvette Graham and Barry Haddow and Shujian Huang and Matthias Huck and others , title =. 2017 , pages =

    2017

  77. [85]

    Cooper and Michael K

    Houwei Cao and David G. Cooper and Michael K. Keutmann and Ruben C. Gur and Ani Nenkova and Ragini Verma , title =. IEEE Trans. Affect. Comput. , volume =

  78. [86]

    Francisco Casacuberta and Hermann Ney and Franz Josef Och and Enrique Vidal and others , title =. Comput. Speech Lang. , volume =

  79. [87]

    Sanyuan Chen and Chengyi Wang and Zhengyang Chen and Yu Wu and Shujie Liu and Zhuo Chen and Jinyu Li and others , title =. IEEE J. Sel. Top. Signal Process. , volume =

  80. [88]

    Qianqian Dong and Zhiying Huang and Qi Tian and Chen Xu and Tom Ko and Yunlong Zhao and others , title =

  81. [89]

    2024 , eprint =

    Zhihao Du and Yuxuan Wang and Qian Chen and Xian Shi and Xiang Lv and Tianyu Zhao and Zhifu Gao and Yexin Yang and others , title =. 2024 , eprint =

    2024

  82. [90]

    2022 , pages =

    Zhifu Gao and Shiliang Zhang and Ian McLoughlin and Zhijie Yan , title =. 2022 , pages =

    2022

  83. [91]

    2024 , eprint =

    Hongyu Gong and Bandhav Veluri , title =. 2024 , eprint =

    2024

  84. [92]

    Goucher and Adam Perelman and Aditya Ramesh and Aidan Clark and AJ Ostrow and Akila Welihinda and others , title =

    Aaron Hurst and Adam Lerer and Adam P. Goucher and Adam Perelman and Aditya Ramesh and Aidan Clark and AJ Ostrow and Akila Welihinda and others , title =. 2024 , eprint =

    2024

  85. [93]

    2023 , pages =

    Hirofumi Inaguma and Sravya Popuri and Ilia Kulikov and Peng-Jen Chen and Changhan Wang and Yu-An Chung and Yun Tang and Ann Lee and Shinji Watanabe and Juan Pino , title =. 2023 , pages =

    2023

  86. [94]

    2022 , pages =

    Ye Jia and Michelle Tadmor Ramanovich and Tal Remez and Roi Pomerantz , title =. 2022 , pages =

    2022

  87. [95]

    2022 , pages =

    Ye Jia and Michelle Tadmor Ramanovich and Quan Wang and Heiga Zen , title =. 2022 , pages =

    2022

  88. [96]

    Weiss and Fadi Biadsy and Wolfgang Macherey and Melvin Johnson and Zhifeng Chen and Yonghui Wu , title =

    Ye Jia and Ron J. Weiss and Fadi Biadsy and Wolfgang Macherey and Melvin Johnson and Zhifeng Chen and Yonghui Wu , title =. 2019 , pages =

    2019

  89. [97]

    2023 , pages =

    Yeskendir Koishekenov and Alexandre Berard and Vassilina Nikoulina , title =. 2023 , pages =

    2023

  90. [98]

    2023 , pages =

    Woosuk Kwon and Zhuohan Li and Siyuan Zhuang and Ying Sheng and Lianmin Zheng and Cody Hao Yu and Joseph Gonzalez and Hao Zhang and Ion Stoica , title =. 2023 , pages =

    2023

  91. [99]

    2025 , eprint =

    Tom Labiausse and Laurent Mazaré and Edouard Grave and Patrick Pérez and Alexandre Défossez and Neil Zeghidour , title =. 2025 , eprint =

    2025

  92. [100]

    Chenyang Le and Yao Qian and Dongmei Wang and Long Zhou and Shujie Liu and Xiaofei Wang and Midia Yousefi and Yanmin Qian and Jinyu Li and Sheng Zhao and Michael Zeng , title =

  93. [101]

    2022 , pages =

    Ann Lee and Peng-Jen Chen and Changhan Wang and Jiatao Gu and Sravya Popuri and Xutai Ma and Adam Polyak and Yossi Adi and Qing He and Yun Tang and Juan Pino and Wei-Ning Hsu , title =. 2022 , pages =

    2022

  94. [102]

    2019 , note =

    Ilya Loshchilov and Frank Hutter , title =. 2019 , note =

    2019

  95. [103]

    IEEE Trans

    Satoshi Nakamura and Konstantin Markov and Hiromi Nakaiwa and Gen-ichiro Kikui and Hisashi Kawai and Takatoshi Jitsuhiro and Jinsong Zhang and others , title =. IEEE Trans. Speech Audio Process. , volume =

  96. [104]

    2002 , pages =

    Kishore Papineni and Salim Roukos and Todd Ward and Wei-Jing Zhu , title =. 2002 , pages =

    2002

  97. [105]

    2024 , eprint =

    Yifan Peng and Ilia Kulikov and Yilin Yang and Sravya Popuri and Hui Lu and Changhan Wang and Hongyu Gong , title =. 2024 , eprint =

    2024

  98. [106]

    2024 , eprint =

    An Yang and Baosong Yang and Beichen Zhang and Binyuan Hui and Bo Zheng and Bowen Yu and Chengyuan Li and Dayiheng Liu and Fei Huang and Haoran Wei and others , title =. 2024 , eprint =

    2024

  99. [107]

    2023 , pages =

    Alec Radford and Jong Wook Kim and Tao Xu and Greg Brockman and Christine McLeavey and Ilya Sutskever , title =. 2023 , pages =

    2023

  100. [108]

    Rubenstein and Chulayuth Asawaroengchai and Duc Dung Nguyen and Ankur Bapna and Zalán Borsos and Félix de Chaumont Quitry and Peter Chen and others , title =

    Paul K. Rubenstein and Chulayuth Asawaroengchai and Duc Dung Nguyen and Ankur Bapna and Zalán Borsos and Félix de Chaumont Quitry and Peter Chen and others , title =. 2023 , eprint =

    2023

  101. [109]

    2022 , pages =

    Takaaki Saeki and Detai Xin and Wataru Nakata and Tomoki Koriyama and Shinnosuke Takamichi and Hiroshi Saruwatari , title =. 2022 , pages =

    2022

  102. [110]

    2019 , eprint =

    Mohammad Shoeybi and Mostofa Patwary and Raul Puri and Patrick LeGresley and Jared Casper and Bryan Catanzaro , title =. 2019 , eprint =

    2019

  103. [111]

    2023 , pages =

    Kun Song and Yi Ren and Yi Lei and Chunfeng Wang and Kun Wei and Lei Xie and Xiang Yin and Zejun Ma , title =. 2023 , pages =

    2023

  104. [112]

    2024 , howpublished =

    Silero Team , title =. 2024 , howpublished =

    2024

  105. [113]

    2021 , pages =

    Chengyi Wang and Yu Wu and Yao Qian and Ken'ichi Kumatani and Shujie Liu and Furu Wei and Michael Zeng and Xuedong Huang , title =. 2021 , pages =

    2021

  106. [114]

    2025 , eprint =

    Xinsheng Wang and Mingqi Jiang and Ziyang Ma and Ziyu Zhang and Songxiang Liu and Linqin Li and Zheng Liang and others , title =. 2025 , eprint =

    2025

  107. [115]

    Yongqi Wang and Jionghao Bai and Rongjie Huang and Ruiqi Li and Zhiqing Hong and Zhou Zhao , title =. Proc. Assoc. Comput. Linguistics (Volume 4: Student Research Workshop) (ACL) , year =

  108. [116]

    Chi and Quoc V

    Jason Wei and Xuezhi Wang and Dale Schuurmans and Maarten Bosma and Brian Ichter and Fei Xia and Ed H. Chi and Quoc V. Le and Denny Zhou , title =

  109. [117]

    Thomas Wolf and Lysandre Debut and Victor Sanh and Julien Chaumond and Clement Delangue and Anthony Moi and Pierric Cistac and others , title =. Proc. Empirical Methods Nat. Lang. Process. (Demos) , year =

  110. [118]

    2023 , pages =

    Yihan Wu and Junliang Guo and Xu Tan and Chen Zhang and Bohan Li and Ruihua Song and Lei He and Sheng Zhao and Arul Menezes and Jiang Bian , title =. 2023 , pages =

    2023

  111. [119]

    2025 , eprint =

    Jin Xu and Zhifang Guo and Jinzheng He and Hangrui Hu and Ting He and Shuai Bai and Keqin Chen and Jialin Wang and Yang Fan and Kai Dang and Bin Zhang and Xiong Wang and Yunfei Chu and Junyang Lin , title =. 2025 , eprint =

    2025

  112. [120]

    2024 , eprint =

    Aohan Zeng and Zhengxiao Du and Mingdao Liu and Kedong Wang and Shengmin Jiang and Lei Zhao and Yuxiao Dong and Jie Tang , title =. 2024 , eprint =

    2024

  113. [121]

    2021 , pages =

    Chen Zhang and Xu Tan and Yi Ren and Tao Qin and Kejun Zhang and Tie-Yan Liu , title =. 2021 , pages =

    2021

  114. [122]

    2021 , pages =

    Kun Zhou and Berrak Sisman and Rui Liu and Haizhou Li , title =. 2021 , pages =

    2021

  115. [123]

    2025 , eprint=

    Phi-Omni-ST: A multimodal language model for direct speech-to-speech translation , author=. 2025 , eprint=

    2025

  116. [124]

    2025 , eprint=

    Seed LiveInterpret 2.0: End-to-end Simultaneous Speech-to-speech Translation with Your Voice , author=. 2025 , eprint=

    2025

  117. [125]

    2023 , eprint =

    Tianrui Wang and Long Zhou and Ziqiang Zhang and Yu Wu and Shujie Liu and Yashesh Gaur and Zhuo Chen and Jinyu Li and Furu Wei , title =. 2023 , eprint =

    2023

  118. [126]

    Peloquin and Hongyu Gong and Peng-Jen Chen and Ann Lee , title =

    Min-Jae Hwang and Ilia Kulikov and Benjamin N. Peloquin and Hongyu Gong and Peng-Jen Chen and Ann Lee , title =. 2024 , pages =

    2024

  119. [127]

    2022 , eprint=

    Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance , author=. 2022 , eprint=

    2022

  120. [128]

    2022 , pages =

    Alexis Conneau and Min Ma and Simran Khanuja and Yu Zhang and Vera Axelrod and Siddharth Dalmia and Jason Riesa and Clara Rivera and Ankur Bapna , title =. 2022 , pages =

    2022

  121. [129]

    Journal of Open Research Software , year =

    Schoeffler, Michael and Stöter, Fabian-Robert and Westphal, Sebastian and Bayerlein, Henning and Edler, Bernd and Herre, Jürgen , title =. Journal of Open Research Software , year =

  122. [130]

    arXiv preprint arXiv:2407.10759 , year=

    Qwen2-Audio Technical Report , author=. arXiv preprint arXiv:2407.10759 , year=

    arXiv

  123. [131]

    A Call for Clarity in Reporting BLEU Scores

    Post, Matt. A Call for Clarity in Reporting BLEU Scores. Proceedings of the Third Conference on Machine Translation: Research Papers. 2018. doi:10.18653/v1/W18-6319

    2018 doi

  124. [132]

    Librispeech: An ASR corpus based on public domain audio books , year=

    Panayotov, Vassil and Chen, Guoguo and Povey, Daniel and Khudanpur, Sanjeev , booktitle=. Librispeech: An ASR corpus based on public domain audio books , year=

  125. [133]

    2021 , eprint=

    AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines , author=. 2021 , eprint=

    2021

  126. [134]

    2020 , eprint=

    CoVoST 2 and Massively Multilingual Speech-to-Text Translation , author=. 2020 , eprint=

    2020

  127. [135]

    Tyers and Gregor Weber , title =

    Rosana Ardila and Megan Branson and Kelly Davis and Michael Kohler and Josh Meyer and Michael Henretty and Reuben Morais and Lindsay Saunders and Francis M. Tyers and Gregor Weber , title =. 2020 , pages =

    2020

  128. [136]

    2023 , pages =

    Keon Lee and Kyumin Park and Daeyoung Kim , title =. 2023 , pages =

    2023

  129. [137]

    2021 , pages =

    Guoguo Chen and Shuzhou Chai and Guan-Bo Wang and Jiayu Du and Wei-Qiang Zhang and Chao Weng and Dan Su and Daniel Povey and Jan Trmal and Junbo Zhang and Mingjie Jin and Sanjeev Khudanpur and Shinji Watanabe and Shuaijiang Zhao and Wei Zou and Xiangang Li and Xuchen Yao and Y...

    2021

  130. [138]

    2024 , pages =

    Haorui He and Zengqiang Shang and Chaoren Wang and Xuyuan Li and Yicheng Gu and Hua Hua and Liwei Liu and Chen Yang and Jiaqi Li and Peiyang Shi and Yuancheng Wang and Kai Chen and Pengyuan Zhang and Zhizheng Wu , title =. 2024 , pages =

    2024

  131. [139]

    2021 , pages =

    Evelina Bakhturina and Vitaly Lavrukhin and Boris Ginsburg and Yang Zhang , title =. 2021 , pages =

    2021

  132. [140]

    2023 , pages =

    Yuma Koizumi and Heiga Zen and Shigeki Karita and Yifan Ding and Kohei Yatabe and Nobuyuki Morioka and Michiel Bacchiani and Yu Zhang and Wei Han and Ankur Bapna , title =. 2023 , pages =

    2023

  133. [141]

    2024 , pages =

    Rui Liu and Yifan Hu and Yi Ren and Xiang Yin and Haizhou Li , title =. 2024 , pages =

    2024

  134. [142]

    University of Edinburgh

    CSTR VCTK corpus: English multi-speaker corpus for CSTR voice cloning toolkit , author=. University of Edinburgh. The Centre for Speech Technology Research (CSTR) , volume=

  135. [143]

    Linhan Ma and Dake Guo and Kun Song and Yuepeng Jiang and Shuai Wang and Liumeng Xue and Weiming Xu and Huan Zhao and Binbin Zhang and Lei Xie , title =

  136. [144]

    , title =

    Magic Data Technology Co., Ltd. , title =. 2024 , howpublished =

    2024

  137. [145]

    , title =

    Magic Data Technology Co., Ltd. , title =. 2019 , note =

    2019

  138. [146]

    arXiv preprint arXiv:2406.10052 , year=

    Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection , author=. arXiv preprint arXiv:2406.10052 , year=

    arXiv

  139. [147]

    arXiv preprint arXiv:2005.11185 , year=

    Low-latency sequence-to-sequence speech recognition and translation by partial hypothesis selection , author=. arXiv preprint arXiv:2005.11185 , year=

    2005 arXiv

  140. [148]

    ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=

    Synchronous transformers for end-to-end speech recognition , author=. ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=. 2020 , organization=

    2020

  141. [149]

    arXiv preprint arXiv:2307.14743 , year=

    Turning whisper into real-time transcription system , author=. arXiv preprint arXiv:2307.14743 , year=

    arXiv

  142. [150]

    International conference on machine learning , pages=

    Robust speech recognition via large-scale weak supervision , author=. International conference on machine learning , pages=. 2023 , organization=

    2023

  143. [151]

    arXiv preprint arXiv:1810.08398 , year=

    STACL: Simultaneous translation with implicit anticipation and controllable latency using prefix-to-prefix framework , author=. arXiv preprint arXiv:1810.08398 , year=

    arXiv

  144. [152]

    ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=

    Cif: Continuous integrate-and-fire for end-to-end speech recognition , author=. ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=. 2020 , organization=

    2020

  145. [153]

    arXiv preprint arXiv:2305.10788 , year=

    Whisper-kdq: A lightweight whisper via guided knowledge distillation and quantization for efficient asr , author=. arXiv preprint arXiv:2305.10788 , year=

    arXiv

  146. [154]

    arXiv preprint arXiv:2311.00430 , year=

    Distil-whisper: Robust knowledge distillation via large-scale pseudo labelling , author=. arXiv preprint arXiv:2311.00430 , year=

    arXiv

  147. [155]

    arXiv preprint arXiv:2409.15869 , year=

    Whisper in Medusa's Ear: Multi-head Efficient Decoding for Transformer-based ASR , author=. arXiv preprint arXiv:2409.15869 , year=

    arXiv

  148. [156]

    International conference on machine learning , pages=

    Online and linear-time attention by enforcing monotonic alignments , author=. International conference on machine learning , pages=. 2017 , organization=

    2017

  149. [157]

    arXiv preprint arXiv:1906.05218 , year=

    Monotonic infinite lookback attention for simultaneous machine translation , author=. arXiv preprint arXiv:1906.05218 , year=

    1906 arXiv

  150. [158]

    arXiv preprint arXiv:1712.05382 , year=

    Monotonic chunkwise attention , author=. arXiv preprint arXiv:1712.05382 , year=

    arXiv

  151. [159]

    arXiv preprint arXiv:1909.12406 , year=

    Monotonic multihead attention , author=. arXiv preprint arXiv:1909.12406 , year=

    1909 arXiv

  152. [160]

    arXiv preprint arXiv:2406.19954 , year=

    Bestow: Efficient and streamable speech language model with the best of two worlds in gpt and t5 , author=. arXiv preprint arXiv:2406.19954 , year=

    arXiv

  153. [161]

    5 Technical Report , author=

    Qwen2. 5 Technical Report , author=. arXiv preprint arXiv:2412.15115 , year=

    arXiv

  154. [162]

    arXiv preprint arXiv:1906.00048 , year=

    Thinking slow about latency evaluation for simultaneous machine translation , author=. arXiv preprint arXiv:1906.00048 , year=

    1906 arXiv

  155. [163]

    arXiv preprint arXiv:2410.03752 , year=

    Efficient Streaming LLM for Speech Recognition , author=. arXiv preprint arXiv:2410.03752 , year=

    arXiv

  156. [164]

    arXiv preprint arXiv:2406.16107 , year=

    Decoder-only architecture for streaming end-to-end speech recognition , author=. arXiv preprint arXiv:2406.16107 , year=

    arXiv

  157. [165]

    arXiv preprint arXiv:2106.09685 , year=

    Lora: Low-rank adaptation of large language models , author=. arXiv preprint arXiv:2106.09685 , year=

    arXiv

  158. [166]

    arXiv preprint arXiv:2012.03411 , year=

    Mls: A large-scale multilingual dataset for speech research , author=. arXiv preprint arXiv:2012.03411 , year=

    2012 arXiv

  159. [167]

    arXiv preprint arXiv:2406.05763 , year=

    WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmark , author=. arXiv preprint arXiv:2406.05763 , year=

    arXiv

  160. [168]

    2015 IEEE international conference on acoustics, speech and signal processing (ICASSP) , pages=

    Librispeech: an asr corpus based on public domain audio books , author=. 2015 IEEE international conference on acoustics, speech and signal processing (ICASSP) , pages=. 2015 , organization=

    2015

  161. [169]

    arXiv preprint arXiv:2101.00390 , year=

    VoxPopuli: A large-scale multilingual speech corpus for representation learning, semi-supervised learning and interpretation , author=. arXiv preprint arXiv:2101.00390 , year=

    arXiv

  162. [170]

    He, Haorui and Shang, Zengqiang and Wang, Chaoren and Li, Xuyuan and Gu, Yicheng and Hua, Hua and Liu, Liwei and Yang, Chen and Li, Jiaqi and Shi, Peiyang and Wang, Yuancheng and Chen, Kai and Zhang, Pengyuan and Wu, Zhizheng , title=. Proc. of SLT , year=

  163. [171]

    IEEE transactions on pattern analysis and machine intelligence , volume=

    A normalized Levenshtein distance metric , author=. IEEE transactions on pattern analysis and machine intelligence , volume=. 2007 , publisher=

    2007

  164. [172]

    WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkit , author=. Proc. Interspeech , year=

  165. [173]

    arXiv preprint arXiv:2408.09491 , year=

    A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition , author=. arXiv preprint arXiv:2408.09491 , year=

    arXiv

  166. [174]

    International Conference on Machine Learning , pages=

    Fast inference from transformers via speculative decoding , author=. International Conference on Machine Learning , pages=. 2023 , organization=

    2023

  167. [175]

    Advances in Neural Information Processing Systems , volume=

    Speculative decoding with big little decoder , author=. Advances in Neural Information Processing Systems , volume=

  168. [176]

    Multilingual Distilwhisper: Efficient Distillation of Multi-Task Speech Models Via Language-Specific Experts , year=

    Ferraz, Thomas Palmeira and Zanon Boito, Marcely and Brun, Caroline and Nikoulina, Vassilina , booktitle=. Multilingual Distilwhisper: Efficient Distillation of Multi-Task Speech Models Via Language-Specific Experts , year=

  169. [177]

    Chen, Zhehuai and Zhang, Yu and Rosenberg, Andrew and Ramabhadran, Bhuvana and Moreno, Pedro and Bapna, Ankur and Zen, Heiga , year =

  170. [178]

    Zhang, Yu and Han, Wei and Qin, James and Wang, Yongqiang and Bapna, Ankur and Chen, Zhehuai and Chen, Nanxin and Li, Bo and Axelrod, Vera and Wang, Gary and Meng, Zhong and Hu, Ke and Rosenberg, Andrew and Prabhavalkar, Rohit and Park, Daniel S. and Haghani, Parisa and Riesa,...

    2023

  171. [179]

    Advances in

    Le, Chenyang and Qian, Yao and Zhou, Long and Liu, Shujie and Qian, Yanmin and Zeng, Michael and Huang, Xuedong , year =. Advances in

  172. [180]

    Liu, Danni and Niehues, Jan , editor =. Recent. Proceedings of the 21st. 2024 , pages =. doi:10.18653/v1/2024.iwslt-1.29 , urldate =

    2024 doi

  173. [181]

    2023 , primaryclass =

    Communication, Seamless and Barrault, Lo. 2023 , primaryclass =. doi:10.48550/arXiv.2308.11596 , urldate =

    2023 doi arXiv

  174. [182]

    2024 IEEE Spoken Language Technology Workshop (SLT) , pages=

    DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition , author=. 2024 IEEE Spoken Language Technology Workshop (SLT) , pages=. 2024 , organization=

    2024

  175. [183]

    Advances in Neural Information Processing Systems , volume=

    Flashattention: Fast and memory-efficient exact attention with io-awareness , author=. Advances in Neural Information Processing Systems , volume=

  176. [184]

    arXiv preprint arXiv:1711.05101 , year=

    Decoupled weight decay regularization , author=. arXiv preprint arXiv:1711.05101 , year=

    arXiv

  177. [185]

    arXiv preprint arXiv:1912.06670 , year=

    Common voice: A massively-multilingual speech corpus , author=. arXiv preprint arXiv:1912.06670 , year=

    1912 arXiv

  178. [186]

    ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=

    Wenetspeech: A 10000+ hours multi-domain mandarin corpus for speech recognition , author=. ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=. 2022 , organization=

    2022

  179. [187]

    Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2) , year=

    Kespeech: An open source speech dataset of mandarin and its eight subdialects , author=. Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2) , year=

  180. [188]

    Liu, Yuchen and Xiong, Hao and He, Zhongjun and Zhang, Jiajun and Wu, Hua and Wang, Haifeng and Zong, Chengqing , year =. End-to-

  181. [189]

    , author=

    CoVoST 2 and Massively Multilingual Speech Translation. , author=. Interspeech , pages=

  182. [190]

    Proceedings of the 57th

    Ma, Mingbo and Huang, Liang and Xiong, Hao and Zheng, Renjie and Liu, Kaibo and Zheng, Baigong and Zhang, Chuanqiang and He, Zhongjun and Liu, Hairong and Li, Xing and Wu, Hua and Wang, Haifeng , editor =. Proceedings of the 57th. 2019 , pages =. doi:10.18653/v1/P19-1289 , urldate =

    2019 doi

  183. [191]

    2022 IEEE Spoken Language Technology Workshop (SLT) , pages=

    Fleurs: Few-shot learning evaluation of universal representations of speech , author=. 2022 IEEE Spoken Language Technology Workshop (SLT) , pages=. 2023 , organization=

    2022

  184. [192]

    Seamless:

    Communication, Seamless and Barrault, Lo. Seamless:. 2023 , number =. doi:10.48550/arXiv.2312.05187 , urldate =

    2023 doi arXiv

  185. [193]

    Zhang, Shaolei and Feng, Yang , year =. End-to-

  186. [194]

    Proceedings of the 1st

    Ma, Xutai and Pino, Juan and Koehn, Philipp , editor =. Proceedings of the 1st. 2020 , pages =

    2020

  187. [195]

    Learning

    Guo, Shoutao and Zhang, Shaolei and Feng, Yang , editor =. Learning. Proceedings of the 61st. 2023 , pages =. doi:10.18653/v1/2023.acl-long.130 , urldate =

    2023 doi

  188. [196]

    Language

    Yin, Aoxiong and Zhong, Tianyun and Li, Haoyuan and Tang, Siliang and Zhao, Zhou , year =. Language. doi:10.48550/arXiv.2312.14488 , urldate =

    doi arXiv

  189. [197]

    Divergence-

    Chen, Xinjie and Fan, Kai and Luo, Wei and Zhang, Linlin and Zhao, Libo and Liu, Xinggao and Huang, Zhongqiang , year =. Divergence-. Proceedings of the AAAI Conference on Artificial Intelligence , volume =. doi:10.1609/aaai.v38i16.29733 , urldate =

    doi

  190. [198]

    doi:10.48550/arXiv.2406.03049 , urldate =

    Zhang, Shaolei and Fang, Qingkai and Guo, Shoutao and Ma, Zhengrui and Zhang, Min and Feng, Yang , year =. doi:10.48550/arXiv.2406.03049 , urldate =

    doi arXiv

  191. [199]

    doi:10.48550/arXiv.2410.04075 , urldate =

    Zhao, Libo and Li, Jing and Zeng, Ziqian , year =. doi:10.48550/arXiv.2410.04075 , urldate =

    doi arXiv

  192. [200]

    Guo, Shoutao and Zhang, Shaolei and Ma, Zhengrui and Feng, Yang , year =. Large. doi:10.48550/arXiv.2501.00868 , urldate =

    doi arXiv

  193. [201]

    Textless

    Zhao, Jinzheng and Moritz, Niko and Lakomkin, Egor and Xie, Ruiming and Xiu, Zhiping and Zmolikova, Katerina and Ahmed, Zeeshan and Gaur, Yashesh and Le, Duc and Fuegen, Christian , year =. Textless. doi:10.1109/ICASSP49660.2025.10889740 , urldate =

    2025

  194. [202]

    doi:10.48550/arXiv.2412.10117 , urldate =

    Du, Zhihao and Wang, Yuxuan and Chen, Qian and Shi, Xian and Lv, Xiang and Zhao, Tianyu and Gao, Zhifu and Yang, Yexin and Gao, Changfeng and Wang, Hui and Yu, Fan and Liu, Huadai and Sheng, Zhengyan and Gu, Yue and Deng, Chong and Wang, Wen and Zhang, Shiliang and Yan, Zhijie...

    doi arXiv

  195. [203]

    2024 , eprint=

    Seed-TTS: A Family of High-Quality Versatile Speech Generation Models , author=. 2024 , eprint=

    2024

  196. [204]

    2023 IEEE automatic speech recognition and understanding workshop (ASRU) , pages=

    Librispeech-pc: Benchmark for evaluation of punctuation and capitalization capabilities of end-to-end asr models , author=. 2023 IEEE automatic speech recognition and understanding workshop (ASRU) , pages=. 2023 , organization=

    2023

  197. [205]

    Xue, Jian and Wang, Peidong and Li, Jinyu and Post, Matt and Gaur, Yashesh , year =. Large-. doi:10.48550/arXiv.2204.05352 , urldate =

    doi arXiv

  198. [206]

    , year =

    Deng, Keqi and Woodland, Philip C. , year =. Label-. doi:10.48550/arXiv.2406.04541 , urldate =

    doi arXiv

  199. [207]

    Learning

    Dong, Qianqian and Zhu, Yaoming and Wang, Mingxuan and Li, Lei , year =. Learning. doi:10.48550/arXiv.2109.07368 , urldate =

    doi arXiv

  200. [208]

    doi:10.48550/arXiv.2106.04833 , urldate =

    Zeng, Xingshan and Li, Liangyou and Liu, Qun , year =. doi:10.48550/arXiv.2106.04833 , urldate =

    doi arXiv

  201. [209]

    Information-

    Zhang, Shaolei and Feng, Yang , editor =. Information-. Proceedings of the 2022. 2022 , pages =. doi:10.18653/v1/2022.emnlp-main.65 , urldate =

    2022 doi

  202. [210]

    Attention as a

    Papi, Sara and Negri, Matteo and Turchi, Marco , editor =. Attention as a. Proceedings of the 61st. 2023 , pages =. doi:10.18653/v1/2023.acl-long.745 , urldate =

    2023 doi

  203. [211]

    doi:10.21437/Interspeech.2023-170 , urldate =

    Papi, Sara and Turchi, Marco and Negri, Matteo , year =. doi:10.21437/Interspeech.2023-170 , urldate =

    2023 doi

  204. [212]

    Connectionist

    Graves, Alex and Fernandez, Santiago and Gomez, Faustino and Schmidhuber, Jurgen , year =. Connectionist

  205. [213]

    Efficient

    Ma, Xutai and Sun, Anna and Ouyang, Siqi and Inaguma, Hirofumi and Tomasello, Paden , year =. Efficient

  206. [214]

    Zhang, Shaolei and Feng, Yang , year =. Hidden. The

  207. [215]

    Ma, Zhengrui and Fang, Qingkai and Zhang, Shaolei and Guo, Shoutao and Feng, Yang and Zhang, Min , year =. A. Proceedings of the 62nd. doi:10.18653/v1/2024.acl-long.85 , urldate =

    2024 doi

  208. [216]

    doi:10.48550/arXiv.2406.07330 , urldate =

    Fang, Qingkai and Ma, Zhengrui and Zhou, Yan and Zhang, Min and Feng, Yang , year =. doi:10.48550/arXiv.2406.07330 , urldate =

    doi arXiv

  209. [217]

    doi:10.48550/arXiv.2502.11094 , urldate =

    Sheng, Zhengyan and Du, Zhihao and Zhang, Shiliang and Yan, Zhijie and Yang, Yexin and Ling, Zhenhua , year =. doi:10.48550/arXiv.2502.11094 , urldate =

    doi

  210. [218]

    Dang, Trung and Aponte, David and Tran, Dung and Chen, Tianyi and Koishida, Kazuhito , year =. Zero-. doi:10.48550/arXiv.2410.00767 , urldate =

    doi arXiv

  211. [219]

    2024-06-10 , journal =

    Dang, Trung and Aponte, David and Tran, Dung and Koishida, Kazuhito , eprinttype =. 2024-06-10 , journal =. doi:10.48550/arXiv.2406.02897 , url =

    2024 doi arXiv

  212. [220]

    Dekel, Avihu and Shechtman, Slava and Fernandez, Raul and Haws, David and Kons, Zvi and Hoory, Ron , year =. Speak. doi:10.48550/arXiv.2309.11210 , urldate =

    doi arXiv

  213. [221]

    Proceedings of the EMNLP , year =

    Simuleval: An evaluation toolkit for simultaneous translation , author =. Proceedings of the EMNLP , year =

  214. [222]

    1996 , editor=

    The ``awful idea of accountability'': Inscribing people into the measurement of objects , author=. 1996 , editor=

    1996

  215. [223]

    Athene-70B: Redefining the Boundaries of Post-Training for Open Models , url =

    Frick, Evan and Jin, Peter and Li, Tianle and Ganesan, Karthik and Zhang, Jian and Jiao, Jiantao and Zhu, Banghua , month =. Athene-70B: Redefining the Boundaries of Post-Training for Open Models , url =

  216. [224]

    2024 , volume=

    Zhilin Wang and Alexander Bukharin and Olivier Delalleau and Daniel Egert and Gerald Shen and Jiaqi Zeng and Oleksii Kuchaiev and Yi Dong , journal=. 2024 , volume=

    2024

  217. [225]

    Bo Adler and Niket Agarwal and Ashwath Aithal and Dong H. Anh and Pallab Bhattacharya and Annika Brundyn and Jared Casper and Bryan Catanzaro and Sharon Clay and Jonathan Cohen and Sirshak Das and Ayush Dattagupta and Olivier Delalleau and Leon Derczynski and Yi Dong and Danie...

    2024

  218. [226]

    Gonzalez and Ion Stoica , journal=

    Evan Frick and Tianle Li and Connor Chen and Wei-Lin Chiang and Anastasios Nikolas Angelopoulos and Jiantao Jiao and Banghua Zhu and Joseph E. Gonzalez and Ion Stoica , journal=. How to Evaluate Reward Models for. 2024 , volume=

    2024

  219. [227]

    2024 , volume=

    Enyu Zhou and Guodong Zheng and Bing Wang and Zhiheng Xi and Shihan Dou and Rong Bao and Wei Shen and Limao Xiong and Jessica Fan and Yurong Mou and Rui Zheng and Tao Gui and Qi Zhang and Xuanjing Huang , journal=. 2024 , volume=

    2024

  220. [228]

    Smith and Hanna Hajishirzi , journal=

    Nathan Lambert and Valentina Pyatkin and Jacob Daniel Morrison and Lester James Validad Miranda and Bill Yuchen Lin and Khyathi Raghavi Chandu and Nouha Dziri and Sachin Kumar and Tom Zick and Yejin Choi and Noah A. Smith and Hanna Hajishirzi , journal=. 2024 , volume=

    2024

  221. [229]

    Chowdhery, Aakanksha and Narang, Sharan and Devlin, Jacob and Bosma, Maarten and Mishra, Gaurav and Roberts, Adam and Barham, Paul and Chung, Hyung Won and Sutton, Charles and Gehrmann, Sebastian and others , journal=

  222. [230]

    CoRR , volume=

    Evaluating and Aligning CodeLLMs on Human Preference , author=. CoRR , volume=

  223. [231]

    Zhihong Shao and Peiyi Wang and Qihao Zhu and Runxin Xu and Junxiao Song and Mingchuan Zhang and Y. K. Li and Y. Wu and Daya Guo , title =. CoRR , volume =

  224. [232]

    Secrets of

    Wang, Binghai and Zheng, Rui and Chen, Lu and Liu, Yan and Dou, Shihan and Huang, Caishuang and Shen, Wei and Jin, Senjie and Zhou, Enyu and Shi, Chenyu and others , journal=. Secrets of

  225. [233]

    CoRR , volume=

    Multi-Programming Language Sandbox for LLMs , author=. CoRR , volume=

  226. [234]

    CoRR , volume=

    Language Models Can Self-Lengthen to Generate Long Texts , author=. CoRR , volume=. 2024 , archivePrefix=. 2410.23933 , primaryClass=

    2024 arXiv

  227. [235]

    CoRR , volume=

    Aligning Large Language Models via Self-Steering Optimization , author=. CoRR , volume=

  228. [236]

    Anil, Rohan and Dai, Andrew M and Firat, Orhan and Johnson, Melvin and Lepikhin, Dmitry and Passos, Alexandre and Shakeri, Siamak and Taropa, Emanuel and Bailey, Paige and Chen, Zhifeng and others , journal=

  229. [237]

    CoRR , volume =

    Zheng Yuan and Hongyi Yuan and Chengpeng Li and Guanting Dong and Chuanqi Tan and Chang Zhou , title =. CoRR , volume =

  230. [238]

    Manning and Stefano Ermon and Chelsea Finn , title =

    Rafael Rafailov and Archit Sharma and Eric Mitchell and Christopher D. Manning and Stefano Ermon and Chelsea Finn , title =. NeurIPS , year =

  231. [239]

    CoRR , volume =

    Keming Lu and Bowen Yu and Fei Huang and Yang Fan and Runji Lin and Chang Zhou , title =. CoRR , volume =

  232. [240]

    Constitutional

    Yuntao Bai and Saurav Kadavath and Sandipan Kundu and Amanda Askell and Jackson Kernion and Andy Jones and Anna Chen and Anna Goldie and Azalia Mirhoseini and Cameron McKinnon and Carol Chen and Catherine Olsson and Christopher Olah and Danny Hernandez and Dawn Drain and Deep ...

  233. [241]

    CoRR , volume =

    Boxi Cao and Keming Lu and Xinyu Lu and Jiawei Chen and Mengjie Ren and Hao Xiang and Peilin Liu and Yaojie Lu and Ben He and Xianpei Han and Le Sun and Hongyu Lin and Bowen Yu , title =. CoRR , volume =

  234. [242]

    CoRR , volume =

    Keming Lu and Bowen Yu and Chang Zhou and Jingren Zhou , title =. CoRR , volume =

  235. [243]

    CoRR , volume=

    Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models , author=. CoRR , volume=

  236. [244]

    Aribandi, Vamsi and Tay, Yi and Schuster, Tal and Rao, Jinfeng and Zheng, Huaixiu Steven and Mehta, Sanket Vaibhav and Zhuang, Honglei and Tran, Vinh Q and Bahri, Dara and Ni, Jianmo and others , journal=

  237. [245]

    Zhang, Yidan and Deng, Boyi and Wan, Yu and Yang, Baosong and Wei, Haoran and Huang, Fei and Yu, Bowen and Lin, Junyang and Zhou, Jingren , journal=

  238. [246]

    CoRR , volume =

    Guanting Dong and Hongyi Yuan and Keming Lu and Chengpeng Li and Mingfeng Xue and Dayiheng Liu and Wei Wang and Zheng Yuan and Chang Zhou and Jingren Zhou , title =. CoRR , volume =

  239. [247]

    Zhang and Yongbin Li , title =

    Yingxiu Zhao and Bowen Yu and Binyuan Hui and Haiyang Yu and Minghao Li and Fei Huang and Nevin L. Zhang and Yongbin Li , title =

  240. [248]

    Lu, Keming and Yuan, Hongyi and Yuan, Zheng and Lin, Runji and Lin, Junyang and Tan, Chuanqi and Zhou, Chang and Zhou, Jingren , booktitle=. \#

  241. [249]

    Wei, Xiangpeng and Wei, Haoran and Lin, Huan and Li, Tianhao and Zhang, Pei and Ren, Xingzhang and Li, Mei and Wan, Yu and Cao, Zhiwei and Xie, Binbin and others , journal=

  242. [250]

    Penedo, Guilherme and Malartic, Quentin and Hesslow, Daniel and Cojocaru, Ruxandra and Cappelli, Alessandro and Alobeidli, Hamza and Pannier, Baptiste and Almazrouei, Ebtesam and Launay, Julien , journal=. The

  243. [251]

    An important next step on our

    Google , url =. An important next step on our

  244. [252]

    CoRR , volume=

    Unsupervised cross-lingual representation learning at scale , author=. CoRR , volume=

  245. [253]

    Xing , title =

    Somanshu Singla and Zhen Wang and Tianyang Liu and Abdullah Ashfaq and Zhiting Hu and Eric P. Xing , title =

  246. [254]

    Evaluation Benchmark for Tool Usage through

  247. [255]

    Rozi. Code. CoRR , volume=

  248. [256]

    Evaluation Benchmark for Code Intepreter , author =

  249. [257]

    Introducing

    Anthropic , institution =. Introducing

  250. [258]

    Jianlin Su and Murtadha H. M. Ahmed and Yu Lu and Shengfeng Pan and Wen Bo and Yunfeng Liu , title =. Neurocomputing , volume =

  251. [259]

    Byte Pair Encoding is Suboptimal for Language Model Pretraining

    Bostrom, Kaj and Durrett, Greg. Byte Pair Encoding is Suboptimal for Language Model Pretraining. Findings of the Association for Computational Linguistics: EMNLP 2020. 2020. doi:10.18653/v1/2020.findings-emnlp.414

    2020 doi

  252. [260]

    Hinton , title =

    Lei Jimmy Ba and Jamie Ryan Kiros and Geoffrey E. Hinton , title =. CoRR , volume =. 2016 , url =. 1607.06450 , timestamp =

    2016 arXiv

  253. [261]

    Pan , title =

    Zixuan Jiang and Jiaqi Gu and Hanqing Zhu and David Z. Pan , title =. CoRR , volume =

  254. [262]

    CoRR , volume =

    Noam Shazeer , title =. CoRR , volume =. 2020 , url =. 2002.05202 , timestamp =

    2020 arXiv

  255. [263]

    CoRR , volume =

    Dan Hendrycks and Kevin Gimpel , title =. CoRR , volume =. 2016 , url =. 1606.08415 , timestamp =

    2016 arXiv

  256. [264]

    Dauphin and Angela Fan and Michael Auli and David Grangier , title =

    Yann N. Dauphin and Angela Fan and Michael Auli and David Grangier , title =

  257. [265]

    Shazeer, Noam , journal=

  258. [266]

    CoRR , volume=

    Searching for activation functions , author=. CoRR , volume=

  259. [267]

    2022 , url =

    Shantanu Jain , institution =. 2022 , url =

    2022

  260. [268]

    Fu and Stefano Ermon and Atri Rudra and Christopher R

    Tri Dao and Daniel Y. Fu and Stefano Ermon and Atri Rudra and Christopher R. NeurIPS , year =

  261. [269]

    Gomez and Lukasz Kaiser and Illia Polosukhin , title =

    Ashish Vaswani and Noam Shazeer and Niki Parmar and Jakob Uszkoreit and Llion Jones and Aidan N. Gomez and Lukasz Kaiser and Illia Polosukhin , title =

  262. [270]

    Liu, Yinhan and Ott, Myle and Goyal, Naman and Du, Jingfei and Joshi, Mandar and Chen, Danqi and Levy, Omer and Lewis, Mike and Zettlemoyer, Luke and Stoyanov, Veselin , journal=

  263. [271]

    Zhao and Kelvin Guu and Adams Wei Yu and Brian Lester and Nan Du and Andrew M

    Jason Wei and Maarten Bosma and Vincent Y. Zhao and Kelvin Guu and Adams Wei Yu and Brian Lester and Nan Du and Andrew M. Dai and Quoc V. Le , title =. The Tenth International Conference on Learning Representations,. 2022 , url =

    2022

  264. [272]

    CoRR , volume=

    Scaling instruction-finetuned language models , author=. CoRR , volume=

  265. [273]

    Longpre, Shayne and Hou, Le and Vu, Tu and Webson, Albert and Chung, Hyung Won and Tay, Yi and Zhou, Denny and Le, Quoc V and Zoph, Barret and Wei, Jason and others , journal=. The

  266. [274]

    Code with CodeQwen1.5 , url =

  267. [275]

    Constitutional

    Bai, Yuntao and Kadavath, Saurav and Kundu, Sandipan and Askell, Amanda and Kernion, Jackson and Jones, Andy and Chen, Anna and Goldie, Anna and Mirhoseini, Azalia and McKinnon, Cameron and others , journal=. Constitutional

  268. [276]

    Christiano and Jan Leike and Tom B

    Paul F. Christiano and Jan Leike and Tom B. Brown and Miljan Martic and Shane Legg and Dario Amodei , editor =. Deep Reinforcement Learning from Human Preferences , booktitle =. 2017 , url =

    2017

  269. [277]

    CoRR , volume=

    Red teaming language models to reduce harms: Methods, scaling behaviors, and lessons learned , author=. CoRR , volume=

  270. [278]

    Transformers Agents , author =

  271. [279]

    The Stack: 3

    Denis Kocetkov and Raymond Li and Loubna Ben Allal and Jia Li and Chenghao Mou and Carlos Mu. The Stack: 3. CoRR , volume =. 2022 , url =. doi:10.48550/arXiv.2211.15533 , eprinttype =. 2211.15533 , timestamp =

    2022 doi arXiv

  272. [280]

    CoRR , volume =

    Raymond Li and Loubna Ben Allal and Yangtian Zi and Niklas Muennighoff and Denis Kocetkov and Chenghao Mou and Marc Marone and Christopher Akiki and Jia Li and Jenny Chim and Qian Liu and Evgenii Zheltonozhskii and Terry Yue Zhuo and Thomas Wang and Olivier Dehaene and Mishig ...

    2023 doi arXiv

  273. [281]

    Reed and Konrad Zolna and Emilio Parisotto and Sergio G

    Scott E. Reed and Konrad Zolna and Emilio Parisotto and Sergio G. A Generalist Agent , journal =. 2022 , url =

    2022

  274. [282]

    CoRR , volume=

    Gemma 2: Improving open language models at a practical size , author=. CoRR , volume=

  275. [283]

    CoRR , volume=

    Are We Done with MMLU? , author=. CoRR , volume=

  276. [284]

    Long Ouyang and Jeffrey Wu and Xu Jiang and Diogo Almeida and Carroll L. Wainwright and Pamela Mishkin and Chong Zhang and Sandhini Agarwal and Katarina Slama and Alex Ray and John Schulman and Jacob Hilton and Fraser Kelton and Luke Miller and Maddie Simens and Amanda Askell ...

  277. [285]

    Learning to Reason with

  278. [286]

    FAccT , pages =

    Robert Wolfe and Isaac Slaughter and Bin Han and Bingbing Wen and Yiwei Yang and Lucas Rosenblatt and Bernease Herman and Eva Maxfield Brown and Zening Qu and Nic Weber and Bill Howe , title =. FAccT , pages =

  279. [287]

    Sayash Kapoor and Rishi Bommasani and Kevin Klyman and Shayne Longpre and Ashwin Ramaswami and Peter Cihon and Aspen K. Hopkins and Kevin Bankston and Stella Biderman and Miranda Bogen and Rumman Chowdhury and Alex Engler and Peter Henderson and Yacine Jernite and Seth Lazar a...

  280. [288]

    Hui, Binyuan and Yang, Jian and Cui, Zeyu and Yang, Jiaxi and Liu, Dayiheng and Zhang, Lei and Liu, Tianyu and Zhang, Jiajun and Yu, Bowen and Lu, Keming and others , journal=

  281. [289]

    Yang, An and Zhang, Beichen and Hui, Binyuan and Gao, Bofei and Yu, Bowen and Li, Chengpeng and Liu, Dayiheng and Tu, Jianhong and Zhou, Jingren and Lin, Junyang and others , journal=

  282. [290]

    CoRR , volume=

    Scaling laws for neural language models , author=. CoRR , volume=

  283. [291]

    CoRR , volume=

    Training compute-optimal large language models , author=. CoRR , volume=

  284. [292]

    CoRR , volume=

    Scaling Data-Constrained Language Models , author=. CoRR , volume=

  285. [293]

    Dan Hendrycks and Collin Burns and Steven Basart and Andy Zou and Mantas Mazeika and Dawn Song and Jacob Steinhardt , title =

  286. [294]

    Challenging

    Mirac Suzgun and Nathan Scales and Nathanael Sch. Challenging

  287. [295]

    Nye and Maarten Bosma and Henryk Michalewski and David Dohan and Ellen Jiang and Carrie J

    Jacob Austin and Augustus Odena and Maxwell I. Nye and Maarten Bosma and Henryk Michalewski and David Dohan and Ellen Jiang and Carrie J. Cai and Michael Terry and Quoc V. Le and Charles Sutton , title =. CoRR , volume =

  288. [296]

    CoRR , volume =

    Haonan Li and Yixuan Zhang and Fajri Koto and Yifei Yang and Hai Zhao and Yeyun Gong and Nan Duan and Timothy Baldwin , title =. CoRR , volume =

  289. [297]

    NeurIPS , year =

    Yuzhen Huang and Yuzhuo Bai and Zhihao Zhu and Junlei Zhang and Jinghan Zhang and Tangjun Su and Junteng Liu and Chuancheng Lv and Yikai Zhang and Jiayi Lei and Yao Fu and Maosong Sun and Junxian He , title =. NeurIPS , year =

  290. [298]

    CoRR , volume =

    Karl Cobbe and Vineet Kosaraju and Mohammad Bavarian and Mark Chen and Heewoo Jun and Lukasz Kaiser and Matthias Plappert and Jerry Tworek and Jacob Hilton and Reiichiro Nakano and Christopher Hesse and John Schulman , title =. CoRR , volume =

  291. [299]

    Gao, Leo and Biderman, Stella and Black, Sid and Golding, Laurence and Hoppe, Travis and Foster, Charles and Phang, Jason and He, Horace and Thite, Anish and Nabeshima, Noa and others , journal=. The

  292. [300]

    The Journal of Machine Learning Research , volume=

    Exploring the limits of transfer learning with a unified text-to-text transformer , author=. The Journal of Machine Learning Research , volume=. 2020 , publisher=

    2020

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.