Pith. sign in

REVIEW 16 cited by

Agent S: An Open Agentic Framework that Uses Computers Like a Human

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.08164 v1 pith:AMAA3NZG submitted 2024-10-10 cs.AI cs.CLcs.CV

classification cs.AIcs.CLcs.CV
keywords agentplanningagenticautomatingbenchmarkcomputersframeworkinteraction
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S aims to address three key challenges in automating computer tasks: acquiring domain-specific knowledge, planning over long task horizons, and handling dynamic, non-uniform interfaces. To this end, Agent S introduces experience-augmented hierarchical planning, which learns from external knowledge search and internal experience retrieval at multiple levels, facilitating efficient task planning and subtask execution. In addition, it employs an Agent-Computer Interface (ACI) to better elicit the reasoning and control capabilities of GUI agents based on Multimodal Large Language Models (MLLMs). Evaluation on the OSWorld benchmark shows that Agent S outperforms the baseline by 9.37% on success rate (an 83.6% relative improvement) and achieves a new state-of-the-art. Comprehensive analysis highlights the effectiveness of individual components and provides insights for future improvements. Furthermore, Agent S demonstrates broad generalizability to different operating systems on a newly-released WindowsAgentArena benchmark. Code available at https://github.com/simular-ai/Agent-S.

Discussion (0). Sign in to comment.

Forward citations

Cited by 16 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

    cs.CV 2026-08 conditional novelty 6.0 of 10

    An external task-state harness with manager-executor-auditor loops lifts Qwen 3.7-Plus from 51.8% to 80.7% on WeaveBench and from 69.7% to 77.2% on Terminal-Bench 2.1 under matched backends.

  2. Rethinking Inference-Time Scaling in Local Computer-Use Agents: Failure Modes and Compute Tradeoffs

    cs.AI 2026-07 conditional novelty 6.0 of 10

    On OSWorld, inference-time scaling for local CUAs mostly yields diminishing returns and shifts failures toward premature false successes rather than raising task success.

  3. CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents

    cs.AI 2026-01 conditional novelty 6.0 of 10

    Computer-use agents can run under Dual-LLM isolation with single-shot branching plans, preserving partial utility while blocking instruction injection, but remain open to branch-steering attacks.

  4. Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memory

    cs.LG 2025-12 conditional novelty 6.0 of 10

    An LLM agent that builds a tool-transition graph with state summaries from past experience improves tool selection and RL exploration by large margins on multi-turn benchmarks.

  5. CODA: Coordinating the Cerebrum and Cerebellum for a Dual-Brain Computer Use Agent with Decoupled Reinforcement Learning

    cs.CV 2025-08 conditional novelty 6.0 of 10

    A decoupled planner-executor GUI agent, trained by per-app reinforcement learning followed by specialist-to-generalist distillation, lifts ScienceBoard success from about 7.6% to 21.0% average and 40% pass@8.

  6. SEAgent: Self-Evolving Computer Use Agent with Autonomous Learning from Experience

    cs.AI 2025-08 conditional novelty 6.0 of 10

    A self-evolving computer-use agent trained with full-trajectory state judging and curriculum task generation goes from 11.3% to 34.5% average success on five OSWorld apps, and a specialist-to-generalist variant beats ...

  7. RLVMR: Reinforcement Learning with Verifiable Meta-Reasoning Rewards for Robust Long-Horizon Agents

    cs.LG 2025-07 conditional novelty 6.0 of 10

    RLVMR adds rule-based rewards for planning, exploration, reflection, and monitoring tags to outcome-based reinforcement learning, and reports state-of-the-art success rates and fewer redundant actions on ALFWorld and ...

  8. BIMgent: Towards Autonomous Building Modeling via Computer-use Agents

    cs.AI 2025-06 conditional novelty 6.0 of 10

    BIMgent, a GUI-controlling LLM agent, completes 32% of BIM building modeling tasks end-to-end, outperforming baseline computer-use agents that complete none.

  9. RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents

    cs.AI 2025-05 conditional novelty 6.0 of 10

    Multimodal computer-use agents show risky intent in about 85% of tasks and complete risky actions in about 60%, measured on RiOSWorld, a new 492-task virtual-machine benchmark.

  10. AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery

    cs.CR 2025-05 conditional novelty 6.0 of 10

    Fake 'Close AD' ads make VLM web agents click them over 60% of the time, and near 100% in some settings.

  11. Agent-Environment Alignment via Automated Interface Generation

    cs.AI 2025-05 conditional novelty 6.0 of 10

    ALIGN automatically generates and verifies an interface wrapper that enriches environment observations, improving LLM agent success rates by up to 45.67 percentage points on ALFWorld without modifying the agent or env...

  12. Branch-and-Browse: Efficient and Controllable Web Exploration with Tree-Structured Reasoning and Action Memory

    cs.AI 2025-10 conditional novelty 5.0 of 10

    Branch-and-Browse, a tree-structured web agent with page-level action memory, reports 35.8% success and up to 40.4% less time than the cited Tree Search baseline on WebArena.

  13. Mirage-1: Augmenting and Updating GUI Agent with Hierarchical Multimodal Skills

    cs.AI 2025-06 conditional novelty 5.0 of 10

    Mirage-1 combines a hierarchical multimodal skill memory with a skill-augmented Monte Carlo tree search to outperform prior GUI agents on Android and web online benchmarks.

  14. Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Scheduling System

    cs.CL 2025-06 conditional novelty 5.0 of 10

    AI phone agents succeed on single-step commands but fail on multi-step compositions; a new benchmark measures this gap and a scheduler that decomposes tasks recovers most of it.

  15. GUI-Reflection: Empowering Multimodal GUI Models with Self-Reflection Behavior

    cs.AI 2025-06 conditional novelty 5.0 of 10

    GUI-Reflection trains an 8B multimodal GUI agent to recognize mistakes, undo incorrect actions, and retry, improving AndroidWorld success rate from 14.58% (filtered BC baseline) to 34.72% with reflection data and onli...

  16. Agentic AI for autonomous anomaly management in complex systems

    cs.AI 2025-07 reject novelty 1.0 of 10

    An expository review claims LLM-based agentic AI can automate anomaly detection, interpretation, and intervention in complex systems, without providing empirical evidence.

Pith tools