Pith. sign in

REVIEW 3 cited by

Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2204.01171 v3 pith:IDTKCDDH submitted 2022-04-03 cs.CL cs.AIcs.LG

Kushal Arora , Layla El Asri , Hareesh Bahuleyan , Jackie Chi Kit Cheung This is my paper · ORCID
classification cs.CLcs.AIcs.LG
keywords biasexposuregenerationaccumulationhypothesisimitationlanguagelearning
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Current language generation models suffer from issues such as repetition, incoherence, and hallucinations. An often-repeated hypothesis is that this brittleness of generation models is caused by the training and the generation procedure mismatch, also referred to as exposure bias. In this paper, we verify this hypothesis by analyzing exposure bias from an imitation learning perspective. We show that exposure bias leads to an accumulation of errors, analyze why perplexity fails to capture this accumulation, and empirically show that this accumulation results in poor generation quality. Source code to reproduce these experiments is available at https://github.com/kushalarora/quantifying_exposure_bias

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Cross-Tokenizer On-Policy Distillation via Byte-Prefix Marginalization

    cs.LG 2026-07 conditional novelty 7.0 of 10

    Byte-Prefix Marginalization maps a teacher's next-token distribution onto the student's vocabulary through shared byte prefixes plus an explicit residual, giving a mass-preserving target for on-policy distillation acr...

  2. Neural operator discovery from heterogeneous trajectories

    cs.LG 2026-07 conditional novelty 6.0 of 10

    Trajectory grouping plus a low-dimensional latent bottleneck lets a neural operator discover each system's hidden governing factors and extrapolate to unseen systems.

  3. Adaptive Accompaniment with ReaLchords

    cs.SD 2025-06 conditional novelty 6.0 of 10

    An online melody-to-chord accompaniment model, fine-tuned with reinforcement learning and distillation from a future-seeing teacher, recovers from cold starts and mid-song perturbations better than MLE baselines.

Pith tools