REVIEW 5 cited by
Efficient Agents: Building Effective Agents While Reducing Cost
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
The remarkable capabilities of Large Language Model (LLM)-driven agents have enabled sophisticated systems to tackle complex, multi-step tasks, but their escalating costs threaten scalability and accessibility. This work presents the first systematic study of the efficiency-effectiveness trade-off in modern agent systems, addressing the critical need for cost-effective designs without sacrificing performance. We investigate three key questions: (1) How much complexity do agentic tasks inherently require? (2) When do additional modules yield diminishing returns? (3) How much efficiency can be gained through the design of efficient agent frameworks? Through an empirical analysis on the GAIA benchmark, we evaluate the impact of LLM backbone selection, agent framework designs, and test-time scaling strategies. Using the cost-of-pass metric, we quantify the efficiency-performance trade-off across these dimensions. Our findings inform the development of Efficient Agents , a novel agent framework that has an optimal complexity to task requirements. Efficient Agents retains 96.7% of the performance of OWL, one leading open-source agent framework, while reducing operational costs from $0.398 to $0.228, resulting in a 28.4% improvement in cost-of-pass. Our work provides actionable insights for designing efficient, high-performing agent systems, advancing the accessibility and sustainability of AI-driven solutions.
Forward citations
Cited by 5 Pith papers
-
The Hidden Footprint: Making Storage a First-Class Metric for LLM Agent Evaluation
Storage footprint is a measurable, independent resource axis for LLM agents: equally accurate configurations differ 15.7× in retained bytes and most of the spread is removable duplication.
-
CAM: A Causality-based Analysis Framework for Multi-Agent Code Generation Systems
CAM ranks how much each intermediate output of a multi-agent code-generation system causally matters for final correctness, then uses that ranking to repair failures and prune features.
-
Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Models
A two-framework testbed comparison claims mem0 is Pareto-optimal over Graphiti for distributed LLM agents because its lower cost is paired with accuracy that is not significantly different.
-
A Completely Blind Channel Estimation Technique for OFDM Using Constellation Splitting
A blind OFDM channel estimation scheme uses linear precoding and constellation splitting on alternate subcarriers to eliminate the complex-scalar ambiguity normally resolved with pilots.
-
Toward Efficient Agents: Memory, Tool learning, and Planning
A survey that organizes efficiency techniques for LLM agents into memory, tool learning, and planning, and consolidates benchmarks and metrics for measuring cost-performance trade-offs.
Discussion (0). Continue with ORCID to comment.