Pith. sign in

REVIEW 11 cited by

Beyond Browsing: API-Based Web Agents

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.16464 v3 pith:VWZEQQW7 submitted 2024-10-21 cs.CL cs.MA

Yueqi Song , Frank Xu , Shuyan Zhou , Graham Neubig This is my paper · ORCID
classification cs.CLcs.MA
keywords agentsbrowsingapistasksonlineagentaloneapi-based
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Web browsers are a portal to the internet, where much of human activity is undertaken. Thus, there has been significant research work in AI agents that interact with the internet through web browsing. However, there is also another interface designed specifically for machine interaction with online content: application programming interfaces (APIs). In this paper we ask -- what if we were to take tasks traditionally tackled by Browsing Agents, and give AI agents access to APIs? To do so, we propose two varieties of agents: (1) an API-calling agent that attempts to perform online tasks through APIs only, similar to traditional coding agents, and (2) a Hybrid Agent that can interact with online data through both web browsing and APIs. In experiments on WebArena, a widely-used and realistic benchmark for web navigation tasks, we find that API-Based Agents outperform web Browsing Agents. Hybrid Agents out-perform both others nearly uniformly across tasks, resulting in a more than 24.0% absolute improvement over web browsing alone, achieving a success rate of 38.9%, the SOTA performance among task-agnostic agents. These results strongly suggest that when APIs are available, they present an attractive alternative to relying on web browsing alone.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 11 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memory

    cs.LG 2025-12 conditional novelty 6.0 of 10

    An LLM agent that builds a tool-transition graph with state summaries from past experience improves tool selection and RL exploration by large margins on multi-turn benchmarks.

  2. Doc2Agent: Scalable Generation of Tool-Using Agents from API Documentation

    cs.CL 2025-06 reject novelty 6.0 of 10

    Doc2Agent automatically converts unstructured REST API documentation into validated, Python-based tools for AI agents, reporting a 55% relative WebArena improvement over direct API calling.

  3. Build the web for agents, not agents for the web

    cs.LG 2025-06 conditional novelty 6.0 of 10

    The paper proposes a paradigm shift: design a standardized Agentic Web Interface for AI agents, rather than adapting agents to human-facing websites.

  4. Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction

    cs.LG 2025-06 conditional novelty 6.0 of 10

    Scaling the number of interaction steps, trained via a curriculum over rollout horizon, improves web-agent task success and outperforms scaling per-step reasoning under fixed token budgets.

  5. WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks

    cs.CL 2025-06 conditional novelty 6.0 of 10

    WebChoreArena adds 532 human-curated, memory-intensive tasks to WebArena's reproducible environments, and current LLM agents score 2.6% to 44.9%, much lower than on WebArena.

  6. Self-Challenging Language Model Agents

    cs.AI 2025-06 conditional novelty 6.0 of 10

    A language model agent can generate its own verifiable training tasks and improve its tool-use success rate by about 2x without human-annotated data.

  7. Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks

    cs.CV 2025-05 conditional novelty 6.0 of 10

    Agent-X, a new 828-task benchmark with step-level scoring, finds that the best multimodal agents still fail over half of real-world visual tool-use tasks.

  8. Branch-and-Browse: Efficient and Controllable Web Exploration with Tree-Structured Reasoning and Action Memory

    cs.AI 2025-10 conditional novelty 5.0 of 10

    Branch-and-Browse, a tree-structured web agent with page-level action memory, reports 35.8% success and up to 40.4% less time than the cited Tree Search baseline on WebArena.

  9. Cybernaut: Towards Reliable Web Automation

    cs.SE 2025-08 reject novelty 4.0 of 10

    A demonstration-to-SOP framework plus robust element identification and a trace similarity metric improves enterprise web automation success rates on an internal benchmark, with a fine-tuned consistency classifier rea...

  10. Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Survey

    cs.CL 2025-06 conditional novelty 4.0 of 10

    A survey that classifies AI agent evaluation benchmarks along environment and capability axes, and proposes five traits that distinguish agents from chatbots.

  11. A Red Teaming Roadmap Towards System-Level Safety

    cs.CR 2025-05 conditional novelty 4.0 of 10

    A position paper from Scale AI argues that red teaming research should prioritize product-level safety specifications, realistic attacker models, and system-level monitoring over abstract model-level harm benchmarks.

Pith tools