Pith. sign in

REVIEW 13 cited by

Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2506.03106 v7 pith:BZ4MMIKS submitted 2025-06-03 cs.CL cs.AI

classification cs.CLcs.AI
keywords critique-grpolanguagemodelsnumericalfeedbacknaturalreasoningachieving
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Recent advances in reinforcement learning (RL) using numerical rewards have significantly enhanced the complex reasoning capabilities of large language models (LLMs). However, we identify three fundamental limitations of purely numerical feedback: performance plateaus, ineffective spontaneous self-reflection, and persistent failures. We show that plateaued RL models can successfully refine failed solutions when given natural language critiques. Motivated by this, we propose Critique-GRPO, an online RL framework that integrates both natural language and numerical feedback for policy optimization. This approach enables LLMs to learn simultaneously from initial responses and critique-guided refinements, effectively internalizing the exploration benefits of both stages. Extensive experiments show that Critique-GRPO outperforms all compared supervised and RL-based fine-tuning methods, achieving average Pass@1 improvements of approximately +15.0-21.6% on various Qwen models and +7.3% on Llama-3.2-3B-Instruct across eight challenging reasoning tasks. Notably, Critique-GRPO facilitates effective self-improvement through self-critiquing, achieving substantial gains over GRPO, e.g., a +16.7% Pass@1 improvement on AIME 2024. The code and models are released at: https://github.com/zhangxy-2019/critique-GRPO

Discussion (0). Sign in to comment.

Forward citations

Cited by 13 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks

    cs.LG 2026-07 conditional novelty 6.0 of 10

    Training a language model by distilling a coach's written experiential knowledge beats training on a scalar rubric score for open-ended tasks, with better out-of-distribution transfer.

  2. Agent Reinforcement Learning via Pivotal-Aware Self-Feedback Retry

    cs.AI 2026-07 conditional novelty 6.0 of 10

    Local retry from the earliest erroneous turn, with pivotal credit isolation and reflection rewards, improves Pass@k and reduces interaction cost over MetaRL and GiGPO on agent and search tasks.

  3. REVES: REvision and VErification--Augmented Training for Test-Time Scaling

    cs.LG 2026-06 unverdicted novelty 6.0 of 10

    REVES augments LLM post-training by decoupling revision and verification signals from successful multi-step trajectories, reporting +6.5 point gains on LiveCodeBench over RL baselines.

  4. Credit Assignment with Resets in Language Model Reasoning

    cs.AI 2026-05 unverdicted novelty 6.0 of 10

    The paper introduces Random-Reset Policy Optimization (RRPO) and Self-Reset Policy Optimization (SRPO) that use resets to enable more precise credit assignment in RL for language model reasoning, with SRPO outperformi...

  5. PAIR: Prefix-Aware Internal Reward Model for Multi-Turn Agent Optimization

    cs.AI 2026-05 unverdicted novelty 6.0 of 10

    PAIR combines a hidden-state probe with an attention correction to deliver robust step-level rewards for GRPO-based optimization of multi-turn LLM agents, achieving high AUROC on contaminated trajectories at low cost.

  6. CPMobius: Iterative Coach-Player Reasoning for Data-Free Reinforcement Learning

    cs.CL 2026-02 conditional novelty 6.0 of 10

    CPMobius uses iterative coach-player reinforcement learning to improve mathematical reasoning in LLMs without external training data, yielding +4.9 average accuracy gains on Qwen2.5-Math-7B-Instruct.

  7. AdvJudge-Zero: Binary Decision Flips in LLM-as-a-Judge via Adversarial Control Tokens

    cs.LG 2025-12 conditional novelty 6.0 of 10

    Short low-perplexity tokens sampled from a judge's own next-token distribution flip binary "No" judgments to "Yes" at high rates on most tested LLM judges.

  8. Trust Region On-Policy Distillation

    cs.LG 2026-05 unverdicted novelty 5.0 of 10

    TrOPD stabilizes on-policy distillation for LLMs with trust-region learning, outlier estimation, and off-policy guidance, outperforming prior OPD methods on reasoning and code benchmarks.

  9. RL with Learnable Textual Feedback: A Bilevel Approach

    cs.LG 2026-05 unverdicted novelty 5.0 of 10

    Bi-NAC frames RL with textual feedback as a Stackelberg bilevel program and reports that 2B and 6B models trained this way outperform larger GRPO baselines on MATH-500 and GPQA.

  10. XRPO: Pushing the limits of GRPO with Targeted Exploration and Exploitation

    cs.LG 2025-10 conditional novelty 5.0 of 10

    XRPO extends GRPO with adaptive rollout allocation, in-context example seeding for unsolved prompts, and novelty-weighted advantages, reporting roughly 1-4% higher accuracy and faster convergence.

  11. CLPO: Curriculum Learning meets Policy Optimization for LLM Reasoning

    cs.AI 2025-09 conditional novelty 5.0 of 10

    CLPO: an online curriculum that rewrites each problem according to the model's own current accuracy and scales the KL penalty by difficulty, reporting strong but internally inconsistent gains over GRPO and DAPO.

  12. TaoSR-AGRL: Adaptive Guided Reinforcement Learning Framework for E-commerce Search Relevance

    cs.IR 2025-10 conditional novelty 4.0 of 10

    TaoSR-AGRL improves e-commerce search relevance by combining dense rule-aware reward shaping with adaptive ground-truth-guided replay in GRPO, reporting gains on Taobao's private offline and online evaluations.

  13. MoL-RL: Distilling Multi-Step Environmental Feedback into LLMs for Feedback-Independent Reasoning

    cs.CL 2025-07 conditional novelty 4.0 of 10

    MoL-RL combines MoL continual training on multi-step environmental feedback with GRPO post-training to improve LLM math and code reasoning without runtime feedback loops.

Pith tools