REVIEW 5 cited by
Mask-Predict: Parallel Decoding of Conditional Masked Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Most machine translation systems generate text autoregressively from left to right. We, instead, use a masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a partially masked target translation. This approach allows for efficient iterative decoding, where we first predict all of the target words non-autoregressively, and then repeatedly mask out and regenerate the subset of words that the model is least confident about. By applying this strategy for a constant number of iterations, our model improves state-of-the-art performance levels for non-autoregressive and parallel decoding translation models by over 4 BLEU on average. It is also able to reach within about 1 BLEU point of a typical left-to-right transformer model, while decoding significantly faster.
Forward citations
Cited by 5 Pith papers
-
FAIR-Calib: Frontier-Aware Instability-Reweighted Calibration for Post-Training Quantization of Diffusion Large Language Models
FAIR-Calib is a frontier-aware instability-reweighted calibration framework for PTQ of dLLMs that minimizes reweighted hidden-state MSE to reduce frontier decision flips.
-
Is Your Diffusion Sampler Actually Correct? A Sampler-Centric Evaluation of Discrete Diffusion Language Models
Under an exact oracle denoiser derived from a ground-truth Markov chain, SEDD, MDLM, LLaDA, and ReMDM samplers show large transition-level error at few diffusion steps; GenPPL/MAUVE can improve or stay flat while tran...
-
Set Block Decoding is a Language Model Inference Accelerator
Fine-tuning an autoregressive LLM with an extra masked-token loss lets it decode several non-consecutive future tokens per forward pass, giving 3-5x fewer passes at similar accuracy.
-
DiffER: Categorical Diffusion for Chemical Retrosynthesis
DiffER, an ensemble of categorical diffusion models with random-padding length prediction, achieves state-of-the-art top-1 accuracy among template-free retrosynthesis models on USPTO-50K.
-
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching
R-VC performs zero-shot voice conversion in two sampling steps while transferring the target speaker's rhythm, matching or exceeding prior systems in naturalness and intelligibility.
Discussion (0). Continue with ORCID to comment.