REVIEW 8 cited by
AgentRefine: Enhancing Agent Generalization through Refinement Tuning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large Language Model (LLM) based agents have proved their ability to perform complex tasks like humans. However, there is still a large gap between open-sourced LLMs and commercial models like the GPT series. In this paper, we focus on improving the agent generalization capabilities of LLMs via instruction tuning. We first observe that the existing agent training corpus exhibits satisfactory results on held-in evaluation sets but fails to generalize to held-out sets. These agent-tuning works face severe formatting errors and are frequently stuck in the same mistake for a long while. We analyze that the poor generalization ability comes from overfitting to several manual agent environments and a lack of adaptation to new situations. They struggle with the wrong action steps and can not learn from the experience but just memorize existing observation-action relations. Inspired by the insight, we propose a novel AgentRefine framework for agent-tuning. The core idea is to enable the model to learn to correct its mistakes via observation in the trajectory. Specifically, we propose an agent synthesis framework to encompass a diverse array of environments and tasks and prompt a strong LLM to refine its error action according to the environment feedback. AgentRefine significantly outperforms state-of-the-art agent-tuning work in terms of generalization ability on diverse agent tasks. It also has better robustness facing perturbation and can generate diversified thought in inference. Our findings establish the correlation between agent generalization and self-refinement and provide a new paradigm for future research.
Forward citations
Cited by 8 Pith papers
-
Agentic-DPO: From Imitation to Agentic Policy Optimization on Expert Trajectories
Offline DPO on expert states with one-step student negatives and schema-preserving augmentation improves LLM agents beyond SFT and can match online GRPO without environment interaction.
-
RLVMR: Reinforcement Learning with Verifiable Meta-Reasoning Rewards for Robust Long-Horizon Agents
RLVMR adds rule-based rewards for planning, exploration, reflection, and monitoring tags to outcome-based reinforcement learning, and reports state-of-the-art success rates and fewer redundant actions on ALFWorld and ...
-
PGPO: Enhancing Agent Reasoning via Pseudocode-style Planning Guided Preference Optimization
Pseudocode-structured plans paired with preference optimization improve LLM agent success rates and generalization across interactive benchmarks.
-
Agent-Environment Alignment via Automated Interface Generation
ALIGN automatically generates and verifies an interface wrapper that enriches environment observations, improving LLM agent success rates by up to 45.67 percentage points on ALFWorld without modifying the agent or env...
-
Beyond Action Imitation: Learning a Decision-Aware User Simulator for Online Advertising
DASH folds cross-domain user histories, distills teacher thinking traces, and RL-tunes a small LLM with action plus rubric rewards to jointly predict ad actions and decision traces on Tencent data.
-
Source Component Shift Adaptation via Offline Decomposition and Online Mixing Approach
The claimed result is that source-component-shift adaptation splits cleanly into offline component learning via EM and online mixing-weight updates, cutting cumulative test loss by up to 67.4%.
-
Leveraging OS-Level Primitives for Robotic Action Management
Applying OS-style exception handling, context caching, and replay to robotic action slices raises success rates 7x to 24x and cuts execution steps up to 74% for repetitive manipulation tasks, without retraining the VLA model.
-
Large Language Models for Planning: A Comprehensive and Systematic Survey
A structured survey of LLM planning methods, benchmarks, and interpretability work, organized around a three-way taxonomy.
Discussion (0). Sign in to comment.