Pith. sign in

REVIEW 12 cited by

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.06474 v3 pith:UGQICNME submitted 2024-04-09 cs.AI

Autonomous Evaluation and Refinement of Digital Agents

classification cs.AI
keywords agentsperformanceevaluationimprovecontroldevicedigitalevaluators
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

We show that domain-general automatic evaluators can significantly improve the performance of agents for web navigation and device control. We experiment with multiple evaluation models that trade off between inference cost, modularity of design, and accuracy. We validate the performance of these models in several popular benchmarks for digital agents, finding between 74.4 and 92.9% agreement with oracle evaluation metrics. Finally, we use these evaluators to improve the performance of existing agents via fine-tuning and inference-time guidance. Without any additional supervision, we improve state-of-the-art performance by 29% on the popular benchmark WebArena, and achieve around 75% relative improvement in device control settings.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 12 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. GUIDE: Interpretable GUI Agent Evaluation via Hierarchical Diagnosis

    cs.AI 2026-04 unverdicted novelty 7.0

    GUIDE decomposes GUI agent evaluation into trajectory segmentation, subtask diagnosis, and overall summary to deliver higher accuracy and structured error reports than holistic baselines.

  2. Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification

    cs.AI 2026-01 conditional novelty 7.0

    DeepVerifier enables self-evolving deep research agents via rubric-guided verification at test time, delivering 8-11% accuracy gains on GAIA and XBench-DeepSearch subsets.

  3. WebRetriever: A Large-Scale Comprehensive Benchmark for Efficient Web Agent Evaluation

    cs.CV 2026-07 conditional novelty 6.0

    WebRetriever is a benchmark of 800 websites and 1,550 tasks with an automated evaluator (NavEval) achieving ~91–97% human agreement, showing current web agents succeed on only 11–37% of realistic tasks across three ev...

  4. ChainWorld: Composing Long-Horizon Desktop Workloads from Atomic OSWorld Tasks

    cs.AI 2026-06 unverdicted novelty 6.0

    ChainWorld builds 347 chains from atomic OSWorld tasks and benchmarks four agents under single-turn and multi-turn protocols, reporting a maximum 31% completion rate with distinct failure profiles.

  5. OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation

    cs.CL 2026-06 unverdicted novelty 6.0

    OPD-Evolver uses on-policy self-distillation in fast interaction and slow attribution loops to build agents with holistic memory competence, outperforming prior systems by up to 11.5% and allowing a 9B model to compet...

  6. Benchmark Everything Everywhere All at Once

    cs.AI 2026-06 unverdicted novelty 6.0

    Benchmark Agent is an autonomous agentic system that constructs benchmarks for LLMs and MLLMs via query analysis, subtask design, annotation and quality control, yielding 15 benchmarks with minimal human input.

  7. SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluations

    cs.CL 2026-05 unverdicted novelty 6.0

    SynAE is a multi-metric framework that evaluates how well synthetic benchmarks replicate real data characteristics for multi-turn tool-calling agent testing.

  8. Evaluating Multi-turn Human-AI Interaction

    cs.HC 2026-05 unverdicted novelty 6.0

    Introduces the TCR framework to evaluate educational LLM assistants on transparency, consistency, and refinement in multi-turn interactions, complementing aggregate metrics.

  9. EchoTrail-GUI: Building Actionable Memory for GUI Agents via Critic-Guided Self-Exploration

    cs.AI 2025-12 unverdicted novelty 6.0

    EchoTrail-GUI builds an automated memory of successful GUI task trajectories via self-exploration and injects relevant past examples to raise success rates on Android benchmarks.

  10. Agent Workflow Memory

    cs.CL 2024-09 unverdicted novelty 6.0

    AWM induces reusable workflows from agent experiences and provides them selectively to improve success rates by 24.6% on Mind2Web and 51.1% on WebArena while reducing steps taken.

  11. Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks

    cs.CL 2025-03 unverdicted novelty 5.0

    Plan-and-Act trains a dedicated Planner on synthetic plan-annotated trajectories to generate high-level plans that an Executor follows, reaching 57.58% success on WebArena-Lite and 81.36% on WebVoyager.

  12. A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directions

    cs.AI 2025-01 unverdicted novelty 5.0

    A survey of 87 agents for computer use and 33 datasets that introduces a three-dimensional taxonomy across domain, interaction, and agent perspectives and identifies six research gaps.