Pith. sign in

REVIEW 3 major objections 4 minor 1 cited by

DLM-One: Diffusion Language Models for One-Step Sequence Generation

T0 review · 3 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read DLM-One distills a 2000-step diffusion language model into a one-pass student that matches BLEU, ROUGE-L, and BERTScore on three text tasks while running up to roughly 500 times faster.

desk verdict A real first: one-step distillation of continuous diffusion language models, with plausible results and an honest diversity caveat, but the 500x speedup claim rests on comparing only against the teacher's slowest sampler. read the letter →

arxiv 2506.00290 v1 pith:35LVDVKP submitted 2025-05-30 cs.CL cs.LGstat.ML

classification cs.CLcs.LGstat.ML
keywords diffusionlanguagemodelsone-stepgenerationscoredistillationsequence-to-sequenceadversarialregularizationembeddingspaceinferenceaccelerationtext
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that continuous diffusion language models do not need iterative denoising: a same-size student can generate a full token sequence in a single forward pass by matching the teacher's scores in the token embedding space. Distilling DiffuSeq, the authors report BLEU, ROUGE-L, and BERTScore within roughly 1-5 percent of the 2000-step teacher while cutting the number of function evaluations from 2000 to 1, an approximately 500x wall-clock speedup. Because naive data-free distillation degenerates into repetitive or [PAD]-filled text, the method adds an adversarial loss on noised embeddings and a two-stage training schedule. The price is measurable diversity loss: self-BLEU rises and Div-4 falls, most sharply on question generation.

What carries the argument

The load-bearing object is embedding-space score distillation, specifically the Score Identity Distillation (SiD) objective, a Fisher-divergence / model-based explicit score matching loss between the student's induced score and the teacher's score. The student generator is a same-size transformer that outputs a whole embedding sequence from random noise; the teacher is the frozen DiffuSeq model; a shared score estimator doubles as adversarial discriminator on noised embeddings. Two-stage training reinitializes the score estimator from the teacher at stage two to correct lag. The paper also relies on Tweedie's formula to convert score matching into clean-embedding prediction and on a frozen embedding matrix during distillation.

What would settle it

Distill a continuous DLM whose embedding space is known to suffer from token collapse or poor separation (or freeze a poorly regularized embedding matrix), and check whether adversarial regularization is insufficient to prevent self-BLEU from approaching 1 and Div-4 from collapsing; if one-step BLEU also drops toward random rounding, the score-matching target is not informative enough for a single pass.

Watch

Extended reading notes

Core claim

The central claim is that the teacher's score function, evaluated on forward-diffused noisy embeddings, is a usable training target for a one-step student. The student generator $G_\theta$ maps noise and an optional condition to a clean embedding; the score estimator $\psi$ is trained to track the student's true score via denoising score matching, and $G_\theta$ is updated so that, under Tweedie's formula, its predicted clean embedding matches the teacher's predicted clean embedding (the SiD objective). On the QQP, Quasar-T, and Wiki-Auto benchmarks the student matches or nearly matches the teacher on BLEU, ROUGE-L, and BERTScore with one function evaluation, while diversity metrics (self-BLEU, Div-4) degrade; a second training stage improves fidelity at further diversity cost, and extra inference steps recoup some quality without retraining.

Load-bearing premise

The teacher's embedding space is a well-behaved Euclidean latent space in which the score function points toward clean, well-separated token embeddings, so that a single forward pass lands close enough to round to valid tokens.

Editorial extensions

If this is right

  • With DLM-One, an entire sequence of length $L$ is produced in one function evaluation, so the speedup over an autoregressive model is roughly $L\times$ and the speedup over the DiffuSeq teacher is up to about $500\times$ in wall-clock time.
  • The distilled model inherits the teacher's quality in terms of BLEU, ROUGE-L, and BERTScore (within roughly 1--5\%), so one-step diffusion becomes a practical regime for sequence-to-sequence tasks when reference fidelity matters.
  • Two-stage training and adversarial regularization are what keep the student from collapsing to repetition or padding; removing either is expected to cause degeneration.
  • Because 2--4 inference steps improve the same checkpoint, the student offers an inference-time quality--speed knob even though it was trained for one step.
  • Additional training stages beyond the second plateau, so the distillation signal itself saturates rather than continuing to improve the student.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same recipe should transfer to other continuous DLMs whose embedding spaces were learned end-to-end; if the embedding space is degenerate or poorly separated, the adversarial term would likely have to bear more of the load, which is testable on Diffusion-LM and Plaid checkpoints.
  • The reported diversity drop suggests that future distillation objectives for language should include a diversity-promoting term (for example, encouraging distinct n-grams or penalizing self-BLEU) rather than optimizing reference fidelity alone.
  • One-step generation changes the deployment arithmetic: for a fixed latency budget, a DLM-One model could be much larger than an autoregressive model delivering the same tokens, which may shift the Pareto frontier toward bigger non-autoregressive models.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. DLM-One distills a pretrained continuous diffusion language model (DiffuSeq) into a one-step student generator by matching student and teacher score estimates in the forward-diffused embedding space, using an SiD-style score distillation loss augmented with adversarial regularization and a two-stage training procedure. Experiments on question generation (Quasar-T), text simplification (Wiki-Auto), and paraphrase (QQP) report BLEU, ROUGE-L, and BERTScore close to those of the 2000-step teacher while reducing inference time to about 0.03 s per sample, giving the claimed ~500x speedup. The paper also includes MBR decoding results, a stage-wise analysis, and explicit discussion of diversity loss and hyperparameter sensitivity.

Significance. Within its stated scope—one teacher architecture, fixed sequence lengths, and three benchmark tasks—the method is sensible and the evaluation is largely non-circular: teacher scores come from released DiffuSeq checkpoints, test sets are external, and hyperparameters are validation-tuned. The two-stage reinitialization of the score estimator, the condition-concatenation correction described in Appendix B.1.2, and the MBR-10 evaluation in Appendix C.2 are thoughtful additions that strengthen confidence in the mechanism. If the quality–speed trade-off were robust, the paper would be a useful first demonstration of one-step distillation for continuous diffusion language models. However, the missing fast-sampler baselines and the substantial diversity collapse prevent the central Pareto-frontier claim from being established at this point.

major comments (3)
  1. [§4.3, Table 2] The headline ~500x speedup is measured only against the 2000-step default DDPM sampler of DiffuSeq. DDIM and DPM-Solver are cited in §2.2 as acceleration options but are never run. Since the paper claims to 'redefine the Pareto frontier' between quality and speed, it must compare against strong few-step samplers (e.g., DPM-Solver at 10–50 steps) and report BLEU and wall-clock time for those configurations; otherwise the speedup number is relative to the slowest configuration of the teacher, not to the fastest available one.
  2. [Abstract, Table 1] The statement 'no notable performance degradation' is contradicted by the paper's own diversity and quality numbers. On QG, Div-4 falls from 0.8103 (teacher) to 0.3798 (student), SelfBLEU rises from 0.2789 to 0.6166, and ROUGE-L falls by roughly 6%; similar but smaller diversity drops appear on PP and TS in Tables 1 and 6. The paper should either report these trade-offs in the abstract and frame the contribution as a speed–quality–diversity trade-off, or provide evidence that diversity is not part of generation quality for the tasks considered.
  3. [§4.2, Table 2] The empirical claims rest on single runs: there are no error bars, no multiple seeds, and no wall-clock timing of an autoregressive baseline, even though the introduction claims an Lx speedup over AR LMs. Please report means and variances over at least three seeds for the main metrics and inference time, and either measure an AR baseline or remove that claim. This is necessary to determine whether the observed quality differences of a few percent and the 500x factor are stable.
minor comments (4)
  1. [§3.2] There is a typo in the text: 'e_theta,t as the noised version of of e_theta' should read 'the noised version of e_theta.'
  2. [Figure 3] The caption says 'offering over 100x faster generation,' which is inconsistent with the abstract's 'up to ~500x speedup'; please reconcile these numbers.
  3. [Table 3] The table mentions percentages in green and red, but the colors are not visible in the printed manuscript and no significance tests are reported; the relative changes should be presented with a simple significance statement or standard errors.
  4. [§2.2] DPM-Solver is described as a training-free acceleration technique, but ODE solvers still require a solver schedule and are not literally training-free in the same sense as quantization; the wording could be clarified.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the central one-step distillation claim is validated against external DiffuSeq checkpoints and test sets, and the SiD self-citation supplies the algorithm rather than the evidence.

full rationale

DLM-One's derivation chain is not circular. The method's stated objective (Eqs. 1–4) is an explicit score-matching and score-identity loss: Eq. 1 defines the model-based explicit score matching loss, Eq. 2 is the Tweedie reparameterization, and Eqs. 3–4 are the cited SiD update rules. The paper does not derive 'one-step quality' from these equations alone; it evaluates the trained student against the fixed DiffuSeq teacher on external test splits of Quasar-T, Wiki-Auto, and QQP (Section 4). The speedup claim is an empirically measured wall-clock ratio (Table 2: 0.03 s versus 14.94 s for 2000 steps), not a quantity defined to equal the step-count ratio by construction. Hyperparameters such as mu, loss coefficients, and learning rates are fixed per dataset (Table 5), and Stage 1 checkpoints are selected on validation BLEU before Stage 2 and test reporting, so the headline numbers are not fitted to the test set. The SiD citation (Zhou et al., 2024c) shares an author with the present paper, but the paper uses it as an explicitly stated optimization procedure, and the central empirical claim is tested against an external teacher and external benchmarks, so this self-citation is not load-bearing circular evidence. The paper's own limitations—diversity degradation, hyperparameter sensitivity, and the absence of fast-sampler baselines such as DDIM or DPM-Solver—are correctness and strength caveats, not circular steps. No self-definitional, fitted-input-as-prediction, uniqueness-imported, ansatz-smuggled, or renaming pattern appears in the derivation chain.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The central claim rests on the teacher's score function being a reliable target in a frozen embedding space, plus a handful of manually tuned hyperparameters. No new entities are introduced.

free parameters (5)
  • mu (score distillation coefficient) = 1.2 (QQP/QT Stage 1), 0.5 (QQP Stage 2), 1.0 (Wiki Stage 1)
    Manually set per dataset and stage; controls the balance between the SiD MSE term and the cross-term in Eq. 4.
  • adversarial loss weights (a_sg_dsm, b_sg_adv, a_g_sd, b_g_adv) = 0.5/0.5/0.5/0.5 (most), 0.5/0.5/0.9/0.1 (QQP Stage 2)
    Chosen by hand per stage/dataset to stabilize training.
  • learning rates lr_psi, lr_theta = 1e-5 or 3e-5
    Fixed values, not justified by analysis.
  • initial time t_init = 1490
    Starting timestep for distillation, chosen in [0,1976].
  • training steps = 50000
    Fixed budget.
assumptions (5)
  • standard math Tweedie's formula holds for the continuous embedding diffusion process, so score matching losses in Eqs. 1-2 are equivalent.
    Used implicitly in Section 3.1 to connect the explicit score matching loss to a denoising objective.
  • domain assumption The pretrained teacher DLM (DiffuSeq) has a well-trained score function that approximates the data score in the embedding space.
    The entire distillation relies on the teacher's scores being accurate at the noise levels sampled.
  • domain assumption The embedding space of the teacher is sufficiently Euclidean and well-conditioned for score distillation to transfer from vision.
    No analysis of the embedding geometry is provided; the authors instead address observed degeneration with adversarial training.
  • domain assumption One network can serve as both score estimator and GAN discriminator without conflicts that bias the score prediction.
    Section 3.2 states this design but does not study its effect on score accuracy.
  • ad hoc to paper The condition concatenation adjustment (replacing generated condition embeddings with true ones) matches teacher pretraining and stabilizes training.
    Described in Appendix B.1.2 as an adjustment found in early experiments; not derived.

how reviews work

0 comments
Cite this review

Pith. "Pith review of DLM-One: Diffusion Language Models for One-Step Sequence Generation." pith.science (2026). https://pith.science/paper/35LVDVKP

@misc{pith2026250600290,
  author       = {Pith},
  title        = {Pith review of: DLM-One: Diffusion Language Models for One-Step Sequence Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/35LVDVKP}},
  note         = {Machine review of arXiv:2506.00290}
}
read the original abstract

This paper introduces DLM-One, a score-distillation-based framework for one-step sequence generation with continuous diffusion language models (DLMs). DLM-One eliminates the need for iterative refinement by aligning the scores of a student model's outputs in the continuous token embedding space with the score function of a pretrained teacher DLM. We investigate whether DLM-One can achieve substantial gains in sampling efficiency for language modeling. Through comprehensive experiments on DiffuSeq -- a representative continuous DLM -- we show that DLM-One achieves up to ~500x speedup in inference time while maintaining competitive performance on benchmark text generation tasks used to evaluate the teacher models. We further analyze the method's empirical behavior across multiple datasets, providing initial insights into its generality and practical applicability. Our findings position one-step diffusion as a promising direction for efficient, high-quality language generation and broader adoption of continuous diffusion models operating in embedding space for natural language processing.

Figures

Figures reproduced from arXiv: 2506.00290 by the authors.

Figure 1
Figure 1. Overview of the adversarial score distillation process. Left: During score estimator ψ updates, both real and generated data-condition pairs are used. The generator θ produces e clean fake from cfake, while real pairs are sampled from the dataset. The shared score estimator ψ is trained for both score prediction and GAN discrimination. Right: During generator θ updates, the pretrained teacher model ϕ provides target… view at source ↗
Figure 2
Figure 2. Evaluation metrics using MBR decoding across 1 to 10 candidate(s) on the Wiki dataset. [PITH_FULL_IMAGE:figures/full_fig_p009_2.png] view at source ↗
Figure 3
Figure 3. BLEU score vs. sampling steps on different datasets. The teacher model (DiffuSeq) requires hundreds to thousands of denoising steps to reach optimal performance, while our DLM-One achieves competitive BLEU in a single step—offering over 100× faster generation without significant quality degradation [PITH_FULL_IMAGE:figures/full_fig_p011_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Evolution of evaluation metrics during Stage 3 training on the QQP dataset [PITH_FULL_IMAGE:figures/full_fig_p012_4.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Streaming-dLLM: Accelerating Diffusion LLMs via Suffix Pruning and Dynamic Decoding

    cs.LG 2026-01 conditional novelty 5.0 of 10

    A training-free inference framework prunes suffix masks, adapts confidence thresholds, and early-exits at EOS to speed up diffusion LLM decoding by up to 68×.

Reference graph

Works this paper leans on

40 extracted references · 9 canonical work pages · cited by 1 Pith paper

  1. [1]

    L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al

    Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al. GPT-4 technical report.arXiv preprint arXiv:2303.08774,

  2. [4]

    Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J

    URLhttps://openreview.net/forum?id=GPKTIktA0k. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. Language models are few-shot learners.Advances in neural information processing systems, 33:1877–1901,

  3. [5]

    Table 5: Distillation-related hyperparameters used in Stage 1 and Stage 2 across different datasets. Dataset Stageµ[t min, tmax]t init asg dsm,b sg adv ag sd,b g adv lrψ lrθ QQP Stage 1 1.2[0,1976]1490 0.5, 0.5 0.5, 0.5 3e-5 1e-5 Stage 2 0.5[0,1976]1490 0.5, 0.5 0.9, 0.1 1e-5 1e-5 Q-T Stage 1 1.2[0,1976]1490 0.5, 0.5 0.5, 0.5 1e-5 1e-5 Stage 2 1.2[0,1976]...

  4. [8]

    Empowering diffusion models on the embedding space for text generation

    Gao, Z., Guo, J., Tan, X., Zhu, Y., Zhang, F., Bian, J., and Xu, L. Empowering diffusion models on the embedding space for text generation. InProceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pp. 4664–4683,

  5. [9]

    Geng, Z., Pokle, A., Luo, W., Lin, J., and Kolter, J. Z. Consistency models made easy.arXiv preprint arXiv:2406.14548,

  6. [10]

    Diffuseq: Sequence to sequence text generation with diffusion models.arXiv preprint arXiv:2210.08933,

    Gong, S., Li, M., Feng, J., Wu, Z., and Kong, L. Diffuseq: Sequence to sequence text generation with diffusion models.arXiv preprint arXiv:2210.08933,

  7. [12]

    The Llama 3 herd of models.arXiv preprint arXiv:2407.21783,

    Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. The Llama 3 herd of models.arXiv preprint arXiv:2407.21783,

  8. [13]

    Plug-and-play controllable generation for discrete masked models

    Guo, W., Zhu, Y., Tao, M., and Chen, Y. Plug-and-play controllable generation for discrete masked models. arXiv preprint arXiv:2410.02143,

Show all 40 references
  1. [14]

    and Salimans, T

    Ho, J. and Salimans, T. Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598,

  2. [16]

    Challenges and applications of large language models.arXiv preprint arXiv:2307.10169,

    Kaddour, J., Harris, J., Mozes, M., Bradley, H., Raileanu, R., and McHardy, R. Challenges and applications of large language models.arXiv preprint arXiv:2307.10169,

  3. [17]

    S., McCann, B., Varshney, L

    Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., and Socher, R. Ctrl: A conditional transformer language model for controllable generation.arXiv preprint arXiv:1909.05858,

  4. [19]

    S., and Hashimoto, T

    Li, X., Thickstun, J., Gulrajani, I., Liang, P. S., and Hashimoto, T. B. Diffusion-LM improves controllable text generation.Advances in Neural Information Processing Systems, 35:4328–4343, 2022a. Li, X., Liu, Y., Lian, L., Yang, H., Dong, Z., Kang, D., Zhang, S., and Keutzer, ...

  5. [20]

    Liu, A., Broadrick, O., Niepert, M., and Broeck, G. V. d. Discrete copula diffusion.arXiv preprint arXiv:2410.01949,

  6. [21]

    and Dhariwal, P

    Nichol, A. and Dhariwal, P. Improved denoising diffusion probabilistic models.arXiv preprint arXiv:2102.09672,

  7. [22]

    Scaling up masked diffusion models on text

    Nie, S., Zhu, F., Du, C., Pang, T., Liu, Q., Zeng, G., Lin, M., and Li, C. Scaling up masked diffusion models on text. InThe Thirteenth International Conference on Learning Representations, 2025a. URL https://openreview.net/forum?id=WNvvwK0tut. Nie, S., Zhu, F., You, Z., Zhang...

  8. [24]

    J., and Neubig, G

    Reid, M., Hellendoorn, V. J., and Neubig, G. Diffuser: Discrete diffusion via edit-based reconstruction.arXiv preprint arXiv:2210.16886,

  9. [25]

    URLhttps://openreview.net/forum?id=St1giarCHLP. Song, Y. and Dhariwal, P. Improved techniques for training consistency models.arXiv preprint arXiv:2310.14189,

  10. [26]

    P., Kumar, A., Ermon, S., and Poole, B

    Song, Y., Sohl-Dickstein, J., Kingma, D. P., Kumar, A., Ermon, S., and Poole, B. Score-based generative modeling through stochastic differential equations.arXiv preprint arXiv:2011.13456,

  11. [27]

    Self-conditioned embedding diffusion for text generation.arXiv preprint arXiv:2211.04236,

    Strudel, R., Tallec, C., Altché, F., Du, Y., Ganin, Y., Mensch, A., Grathwohl, W., Savinov, N., Dieleman, S., Sifre, L., and Leblond, R. Self-conditioned embedding diffusion for text generation.arXiv preprint arXiv:2211.04236,

  12. [28]

    M., Hauth, A., Millican, K., et al

    Team, G., Anil, R., Borgeaud, S., Alayrac, J.-B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A. M., Hauth, A., Millican, K., et al. Gemini: a family of highly capable multimodal models.arXiv preprint arXiv:2312.11805,

  13. [29]

    Llama 2: Open foundation and fine-tuned chat models.arXiv preprint arXiv:2307.09288,

    Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. Llama 2: Open foundation and fine-tuned chat models.arXiv preprint arXiv:2307.09288,

  14. [30]

    Diffusion-GAN: Training GANs with diffusion.arXiv preprint arXiv:2206.02262,

    Wang, Z., Zheng, H., He, P., Chen, W., and Zhou, M. Diffusion-GAN: Training GANs with diffusion.arXiv preprint arXiv:2206.02262,

  15. [31]

    Dinoiser: Diffused conditional sequence learning by manipulating noises.arXiv preprint arXiv:2302.10025,

    17 Ye, J., Zheng, Z., Bao, Y., Qian, L., and Wang, M. Dinoiser: Diffused conditional sequence learning by manipulating noises.arXiv preprint arXiv:2302.10025,

  16. [32]

    T., and Park, T

    Yin, T., Gharbi, M., Zhang, R., Shechtman, E., Durand, F., Freeman, W. T., and Park, T. One-step diffusion with distribution matching distillation.arXiv preprint arXiv:2311.18828,

  17. [33]

    Yuan, H., Yuan, Z., Tan, C., Huang, F., and Huang, S

    URLhttps://openreview.net/forum?id=tQukGCDaNT. Yuan, H., Yuan, Z., Tan, C., Huang, F., and Huang, S. Seqdiffuseq: Text diffusion with encoder-decoder transformers.arXiv preprint arXiv:2212.10325,

  18. [34]

    Masked diffusion models are secretly time-agnostic masked models and exploit inaccurate categorical sampling.arXiv preprint arXiv:2409.02908, 2024a

    Zheng, K., Chen, Y., Mao, H., Liu, M.-Y., Zhu, J., and Zhang, Q. Masked diffusion models are secretly time-agnostic masked models and exploit inaccurate categorical sampling.arXiv preprint arXiv:2409.02908, 2024a. Zheng, L., Yuan, J., Yu, L., and Kong, L. A reparameterized dis...

  19. [36]

    (2022), we evaluate our student models using the MBR decoding strategy with a total of 10 generated candidates (denoted as MBR-10)

    C.2 DLM-One with MBR Decoding To directly compare with the results reported in Gong et al. (2022), we evaluate our student models using the MBR decoding strategy with a total of 10 generated candidates (denoted as MBR-10). As shown in Table 6, our distilled models demonstrate ...

  20. [38]

    she was the leader of the party from 1995 to

  21. [40]

    vetlanda kom- mun

    thiel - sur - acolin is a commune in the allier department in auvergne - rhone - alpes in central france. thiel - sur - acolin is a commune. thiel - sur - acolin is a commune. thiel - sur - acolin is a commune. vetlanda municipal- ity ( " vetlanda kom- mun " ) is a munic- ipal...

  22. [1993]

    she was the leader between 1993 and

  23. [1995]

    she was also the leader of the party between 1993 and

  24. [2002]

    doi: 10.3115/1073083.1073135

    Association for Computational Linguistics. doi: 10.3115/1073083.1073135. URLhttps://doi.org/10.3115/1073083.1073135. Poole, B., Jain, A., Barron, J. T., and Mildenhall, B. DreamFusion: Text-to-3D using 2D diffusion. InThe Eleventh International Conference on Learning Representations,

  25. [2005]

    Neural crf model for sentence alignment in text simplification.arXiv preprint arXiv:2005.02324,

    Jiang, C., Maddela, M., Lan, W., Zhong, Y., and Xu, W. Neural crf model for sentence alignment in text simplification.arXiv preprint arXiv:2005.02324,

  26. [2017]

    H., Doucet, A., Strudel, R., Dyer, C., Durkan, C., et al

    Dieleman, S., Sartran, L., Roshannai, A., Savinov, N., Ganin, Y., Richemond, P. H., Doucet, A., Strudel, R., Dyer, C., Durkan, C., et al. Continuous diffusion for categorical data.arXiv preprint arXiv:2211.15089,

  27. [2019]

    A comprehensive survey of accelerated generation techniques in large language models.arXiv preprint arXiv:2405.13019,

    Khoshnoodi, M., Jain, V., Gao, M., Srikanth, M., and Chadha, A. A comprehensive survey of accelerated generation techniques in large language models.arXiv preprint arXiv:2405.13019,

  28. [2020]

    W., Sutton, C., Gehrmann, S., et al

    Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. Palm: Scaling language modeling with pathways.arXiv preprint arXiv:2204.02311,

  29. [2021]

    13 Dhingra, B., Mazaitis, K., and Cohen, W. W. Quasar: Datasets for question answering by search and reading. arXiv preprint arXiv:1707.03904,

  30. [2022]

    Scaling diffusion language models via adaptation from autoregressive models.arXiv preprint arXiv:2410.17891,

    Gong, S., Agarwal, S., Zhang, Y., Ye, J., Zheng, L., Li, M., An, C., Zhao, P., Bi, W., Han, J., et al. Scaling diffusion language models via adaptation from autoregressive models.arXiv preprint arXiv:2410.17891,

  31. [2023]

    Austin, J., Johnson, D., Ho, J., Tarlow, D., and Berg, R. v. d. Structured denoising diffusion models in discrete state-spaces.arXiv preprint arXiv:2107.03006,

  32. [2024]

    Qwen technical report.ArXiv, abs/2309.16609,

    Bai, J., Bai, S., Chu, Y., Cui, Z., Dang, K., Deng, X., Fan, Y., Ge, W., Han, Y., Huang, F., Hui, B., Ji, L., Li, M., Lin, J., Lin, R., Liu, D., Liu, G., Lu, C., Lu, K., Ma, J., Men, R., Ren, X., Ren, X., Tan, C., Tan, S., Tu, J., Wang, P., Wang, S., Wang, W., Wu, S., Xu, B., ...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.