Shuffling input order degrades LLM accuracy on four of five benchmarks, but single-run measurements without error bars leave the effect size uncertain.
2 Bachelor’s degree or higher: 15.4%
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
The Order Effect: Investigating Prompt Sensitivity to Input Order in LLMs
Shuffling input order degrades LLM accuracy on four of five benchmarks, but single-run measurements without error bars leave the effect size uncertain.