REVIEW 23 cited by
The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A phenomenon where models favor extended internal reasoning chains over environmental interaction. Through experiments on software engineering tasks using SWE Bench Verified, we observe three recurring patterns: Analysis Paralysis, Rogue Actions, and Premature Disengagement. We propose a framework to study these behaviors, which correlates with human expert assessments, and analyze 4018 trajectories. We observe that higher overthinking scores correlate with decreased performance, with reasoning models exhibiting stronger tendencies toward overthinking compared to non-reasoning models. Our analysis reveals that simple efforts to mitigate overthinking in agentic environments, such as selecting the solution with the lower overthinking score, can improve model performance by almost 30% while reducing computational costs by 43%. These results suggest that mitigating overthinking has strong practical implications. We suggest that by leveraging native function-calling capabilities and selective reinforcement learning overthinking tendencies could be mitigated. We also open-source our evaluation framework and dataset to facilitate research in this direction at https://github.com/AlexCuadron/Overthinking.
Forward citations
Cited by 23 Pith papers
-
Agentic-R1: Distilled Dual-Strategy Reasoning
A distillation framework that composes solutions from a tool-augmented agent and a text-reasoning teacher trains a 7B model to dynamically choose between code execution and verbal reasoning, improving math benchmark accuracy.
-
Diagnosing Search Behavior and Failure Modes in Long-Horizon Search Agents
For six deep search agents on BrowseComp-Plus, answer accuracy tracks cumulative retrieval recall, not search effort, and failures split into missing-evidence and evidence-misuse gaps.
-
Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents
Cost-aware stopping over ranked tool prefixes, trained on stop-versus-continue payoff gaps, beats score and sufficiency thresholds under heterogeneous tool costs.
-
EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization
EvoThink reduces LRM overthinking by pruning redundant atomic reasoning steps (SPT) and training on diversity-selected wrong-to-right mutation data (AMPO), cutting tokens and improving math/code accuracy.
-
Implicit Fine-tuning via Context Engineering: A Curriculum Learning Framework for Multimodal Entity Alignment
Context engineering for multimodal entity alignment is mathematically equivalent to sequential contrastive fine-tuning, enabling a curriculum prompt framework that matches large-model accuracy at far lower cost.
-
From Trajectories to Prefixes: Reusing Teacher Trajectories via Replayed Prefixes and Online Continuation
Replaying teacher trajectory prefixes and explicitly optimizing the historical prefix tokens improves small-model agent success rates over distillation and response-only GRPO baselines in TextCraft, BabyAI, and ALFWorld.
-
FitText: Evolving Agent Tool Ecologies via Memetic Retrieval
FitText embeds memetic evolutionary retrieval inside the agent's reasoning loop to iteratively refine pseudo-tool descriptions, raising retrieval rank from 8.81 to 2.78 on ToolRet and pass rate to 0.73 on StableToolBench.
-
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers
Proactive Interactive Reasoning (PIR) teaches LLMs to insert clarification questions into their chain-of-thought, improving simulated task success while cutting reasoning tokens roughly in half.
-
Understanding the Effects of Distractors on Reasoning Vision-Language Models
Adding visual distractors to images lowers reasoning-VLM accuracy while leaving reasoning length essentially flat, with the accuracy loss traced to the share of reasoning-trace attributes devoted to distractors.
-
TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Framework
TeaRAG shows that hybrid chunk+triplet retrieval with Personalized PageRank and an iterative process-aware DPO reward keeps QA accuracy while cutting reasoning tokens by roughly 60%.
-
ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Compute
ParaThinker trains LLMs for native parallel reasoning and reports 7 to 12 percent higher accuracy on math benchmarks over sequential thinking with modest latency overhead.
-
SmartThinker: Learning to Compress and Preserve Reasoning by Step-Level Length Control
SmartThinker shortens AI reasoning chains by estimating the importance of each step and penalizing the unimportant ones, preserving accuracy while using far fewer tokens.
-
ReCUT: Balancing Reasoning Length and Accuracy in LLMs via Stepwise Trails and Preference Optimization
ReCUT combines stepwise long-short sampling, dual DPO training, and DARE-Ties parameter interpolation to compress LLM reasoning chains by 30-50% without sacrificing accuracy on math benchmarks.
-
Sample Complexity and Representation Ability of Test-time Scaling Paradigms
Best-of-n sampling provably needs about 1/Δ samples versus 1/Δ² for self-consistency, and a constructed Transformer can route among experts using verifier feedback to reach near-optimal final responses.
-
Enhancing Decision-Making of Large Language Models via Actor-Critic
LAC improves LLM decision-making by computing action scores from token logits and combining them with the model's prior policy through a gradient-free KL-constrained update.
-
EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning
Reasoning in non-English languages reduces thinking tokens by 20-40% while largely preserving math accuracy, with savings persisting after translation to English.
-
Enterprise Large Language Model Evaluation Benchmark
A 14-task enterprise LLM benchmark built mostly from GPT-4o-generated labels and scored by GPT-4o-as-judge shows open-source models closing the reasoning gap, but the dataset is not public and the evaluation is partly...
-
A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
A structured literature survey concluding that reasoning capabilities do not automatically make LLMs more trustworthy and can introduce new vulnerabilities in safety, robustness, and privacy.
-
Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency
Suppressing "Wait"-like reflection tokens at decode time reduces reasoning token counts by 27-51% across five R1-style model families, with mixed accuracy effects.
-
When Researchers Say Mental Model/Theory of Mind of AI, What Are They Really Talking About?
Researchers' claims of AI theory of mind are really about behavioral prediction, so AI evaluation should shift from isolated cognitive tests to human-AI interaction.
-
Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey
A comprehensive review that categorizes methods for shortening and adaptively triggering chain-of-thought reasoning in large language models.
-
Pok\'eAI: A Goal-Generating, Battle-Optimizing Multi-agent System for Pokemon Red
A text-based LLM battle agent reaches an 80.8% win rate on Pokémon Red wild battles, close to a single human run of 86%, with different models showing distinct playstyles.
- Optimizing Length Compression in Large Reasoning Models
Discussion (0). Sign in to comment.