REVIEW 6 cited by
LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time. Existing benchmarks treat agents as static systems and fail to evaluate lifelong learning capabilities. We present LifelongAgentBench, the first unified benchmark designed to systematically assess the lifelong learning ability of LLM agents. It provides skill-grounded, interdependent tasks across three interactive environments, Database, Operating System, and Knowledge Graph, with automatic label verification, reproducibility, and modular extensibility. Extensive experiments reveal that conventional experience replay has limited effectiveness for LLM agents due to irrelevant information and context length constraints. We further introduce a group self-consistency mechanism that significantly improves lifelong learning performance. We hope LifelongAgentBench will advance the development of adaptive, memory-capable LLM agents.
Forward citations
Cited by 6 Pith papers
-
EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments
Across ~38,000 hours on 134 ultra-long real-world tasks, aggregate agent performance follows a log-sigmoid of interaction time, and measured learning speed doubles about every three months.
-
FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows
A longitudinal benchmark of 120 real-case financial tasks shows four agent scaffolds beat their state-reset controls by 9.33 to 19.37 score points when allowed to retain experience.
-
Progressive Multimodal Alignment for Continual Instruction Tuning
Progressive Multimodal Alignment expands projector experts only when multimodal distribution shifts are detected, reducing projector-level forgetting and boosting MCIT baselines with sub-linear growth.
-
SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution
A single RL policy alternating task solving and skill-document curation, with decoupled cross-task credit, improves Pass@1 and cross-task test-time scaling on ALFWorld, WebShop, and ScienceWorld.
-
Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfitting
SkillBoost reduces skill overfitting in self-evolving LLM agents by combining failure-localized editing, multi-candidate generation, and an anti-regression acceptance gate.
-
Continual Learning for Generative AI: From LLMs to MLLMs and Beyond
A survey that categorizes continual learning methods for generative models into architecture-based, regularization-based, and replay-based paradigms across four model families.
Discussion (0). Sign in to comment.