REVIEW 6 cited by
TapeAgents: a Holistic Framework for Agent Development and Optimization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present TapeAgents, an agent framework built around a granular, structured log tape of the agent session that also plays the role of the session's resumable state. In TapeAgents we leverage tapes to facilitate all stages of the LLM Agent development lifecycle. The agent reasons by processing the tape and the LLM output to produce new thought and action steps and append them to the tape. The environment then reacts to the agent's actions by likewise appending observation steps to the tape. By virtue of this tape-centred design, TapeAgents can provide AI practitioners with holistic end-to-end support. At the development stage, tapes facilitate session persistence, agent auditing, and step-by-step debugging. Post-deployment, one can reuse tapes for evaluation, fine-tuning, and prompt-tuning; crucially, one can adapt tapes from other agents or use revised historical tapes. In this report, we explain the TapeAgents design in detail. We demonstrate possible applications of TapeAgents with several concrete examples of building monolithic agents and multi-agent teams, of optimizing agent prompts and finetuning the agent's LLM. We present tooling prototypes and report a case study where we use TapeAgents to finetune a Llama-3.1-8B form-filling assistant to perform as well as GPT-4o while being orders of magnitude cheaper. Lastly, our comparative analysis shows that TapeAgents's advantages over prior frameworks stem from our novel design of the LLM agent as a resumable, modular state machine with a structured configuration, that generates granular, structured logs and that can transform these logs into training text -- a unique combination of features absent in previous work.
Forward citations
Cited by 6 Pith papers
-
TaskCraft: Automated Generation of Agentic Tasks
TaskCraft automatically generates verifiable, multi-tool agentic tasks with execution trajectories via atomic task construction and depth/width extension, and fine-tuning on the resulting 36,000-task dataset improves ...
-
OAgents: An Empirical Study of Building Effective Agents
OAgents reports a framework and ablation study claiming open-source state-of-the-art on GAIA, but the empirical evidence is weakened by benchmark fitting and missing statistics.
-
Scaling Test-time Compute for LLM Agents
On the GAIA benchmark, Best-of-N sampling with list-wise answer selection gives the largest agent gains, and selective (score-triggered) reflection beats reflection at every step.
-
Coding Agents with Multimodal Browsing are Generalist Problem Solvers
OpenHands-Versa, a single agent with a small set of general tools, achieves state-of-the-art or competitive results on SWE-Bench Multimodal, GAIA, and The Agent Company.
-
OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation
A hierarchical multi-agent framework with a domain-agnostic planner trained by SFT and DPO achieves 69.70% on GAIA and lifts a Qwen2.5-32B planner by 16.37 points.
-
A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications
A survey of 80+ Deep Research systems that proposes a four-layer taxonomy (foundation models, tool use, planning, synthesis) and compares commercial and open-source implementations.
Discussion (0). Continue with ORCID to comment.