GLEU Without Tuning

Courtney Napoles , Keisuke Sakaguchi , Matt Post , Joel Tetreault

Authors on Pith no claims yet

classification 💻 cs.CL

keywords metricgleureferencetuningversionaddressannotatedarise

read the original abstract

The GLEU metric was proposed for evaluating grammatical error corrections using n-gram overlap with a set of reference sentences, as opposed to precision/recall of specific annotated errors (Napoles et al., 2015). This paper describes improvements made to the GLEU metric that address problems that arise when using an increasing number of reference sets. Unlike the originally presented metric, the modified metric does not require tuning. We recommend that this version be used instead of the original version.

This paper has not been read by Pith yet.

discussion (0)

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Multi-Dimensional Evaluation of LLMs for Grammatical Error Correction
cs.CL 2026-05 unverdicted novelty 6.0

Fine-tuned GPT-4o reaches state-of-the-art on grammatical error correction while reference-based metrics underestimate performance by missing 73.76 percent of valid or superior outputs.
Edit-level Majority Voting Mitigates Over-Correction in LLM-based Grammatical Error Correction
cs.CL 2026-05 unverdicted novelty 5.0

Edit-level majority voting on multiple LLM-generated candidates reduces over-correction in grammatical error correction and outperforms greedy and MBR decoding on nine multilingual benchmarks while remaining stable to...