Pith. sign in

REVIEW 19 cited by

AIOS: LLM Agent Operating System

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.16971 v5 pith:SGMJSDTB submitted 2024-03-25 cs.OS cs.AIcs.CL

classification cs.OScs.AIcs.CL
keywords aiosagentsagentmanagementllm-basedkernelresourcesystem
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

LLM-based intelligent agents face significant deployment challenges, particularly related to resource management. Allowing unrestricted access to LLM or tool resources can lead to inefficient or even potentially harmful resource allocation and utilization for agents. Furthermore, the absence of proper scheduling and resource management mechanisms in current agent designs hinders concurrent processing and limits overall system efficiency. To address these challenges, this paper proposes the architecture of AIOS (LLM-based AI Agent Operating System) under the context of managing LLM-based agents. It introduces a novel architecture for serving LLM-based agents by isolating resources and LLM-specific services from agent applications into an AIOS kernel. This AIOS kernel provides fundamental services (e.g., scheduling, context management, memory management, storage management, access control) for runtime agents. To enhance usability, AIOS also includes an AIOS SDK, a comprehensive suite of APIs designed for utilizing functionalities provided by the AIOS kernel. Experimental results demonstrate that using AIOS can achieve up to 2.1x faster execution for serving agents built by various agent frameworks. The source code is available at https://github.com/agiresearch/AIOS.

Discussion (0). Sign in to comment.

Forward citations

Cited by 19 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Stop Means Stop: Measuring and Repairing the Enforcement Gap in Agent-Framework Control Primitives

    cs.SE 2026-07 accept novelty 7.0 of 10

    Approval-pause, cancellation, and timeout primitives fail to stop side effects in all six evaluated agent frameworks (sibling leak), and an externally placed, formally verified admission gate closes the gap.

  2. TuxBot: Semantic-Aware Online OS Tuning with Large Language Models

    cs.OS 2026-05 unverdicted novelty 7.0 of 10

    SemaTune uses LLM guidance with semantic context to tune up to 41 Linux OS parameters, delivering 72.5% performance gains over defaults and 153.3% over non-LLM baselines on 13 workloads while avoiding degraded states.

  3. The Agent Operating System (AOS): A Reference Operating Architecture for Distributed Agentic Systems

    cs.AI 2026-08 conditional novelty 6.0 of 10

    A reference architecture that separates governance (intent, policy, authority, confidence) from coordination (lifecycle, routing, scheduling, assurance) for distributed AI agents.

  4. ViSAGE: Constructing Self-Correcting Memories for Long-Form Video Understanding

    cs.AI 2026-07 conditional novelty 6.0 of 10

    ViSAGE builds entity-centered, self-correcting memories for long-form video understanding and reports state-of-the-art accuracy on M3-Bench and Video-MME-long.

  5. From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps

    cs.AI 2026-07 conditional novelty 6.0 of 10

    Coding each mechanism for evidence of lineage and implementation depth, the review closes one candidate gap (GraSP) and isolates five residual control bundles for language agents.

  6. TypeGo: An OS Runtime for Embodied Agents

    cs.SE 2026-07 conditional novelty 6.0 of 10

    An OS-style multi-cadence runtime for LLM-driven robots hides planning latency and schedules concurrent tasks, cutting TTFA by 73% and per-step delay by 50% on a Go2 prototype suite.

  7. Chain-of-Models: Cross-Model Auditing for Bias-Robust LLM Judges

    cs.CL 2026-05 conditional novelty 6.0 of 10

    Per-bias selection of a cross-family LLM auditor lifts biased-judgment accuracy from 0.805/0.824 baselines to 0.884.

  8. AgentCgroup: Understanding and Controlling OS Resources of AI Agents

    cs.OS 2026-02 conditional novelty 6.0 of 10

    AI coding-agent workloads show 15.4× memory peak-to-average, tool-call-driven bursts, and 1.8× run-to-run variance, motivating per-tool-call eBPF/cgroup enforcement.

  9. Node-as-Agent: Graph Agentic Network

    cs.CL 2025-08 conditional novelty 6.0 of 10

    A node-as-agent framework where a frozen LLM plans each node's local and global message passing achieves competitive Cora accuracy without training, but uses per-dataset prompt selection and leaves label-leakage quest...

  10. ConsumerBench: Benchmarking Generative AI Applications on End-User Devices

    cs.DC 2025-06 conditional novelty 6.0 of 10

    ConsumerBench reveals that running multiple generative AI apps concurrently on a consumer GPU causes severe starvation under greedy allocation and wasted capacity under static partitioning, driving the need for SLO-aw...

  11. LLM-First Search: Self-Guided Exploration of the Solution Space

    cs.AI 2025-06 conditional novelty 6.0 of 10

    LLM-First Search, where the model itself decides whether to continue or backtrack during reasoning, outperforms MCTS, BestFS, and ToT-BFS on harder Countdown and Sudoku tasks while using fewer tokens.

  12. Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks

    cs.CV 2025-05 conditional novelty 6.0 of 10

    Agent-X, a new 828-task benchmark with step-level scoring, finds that the best multimodal agents still fail over half of real-world visual tool-use tasks.

  13. Rethinking Scientific Discovery in the Agentic Era

    cs.CL 2026-07 conditional novelty 5.5 of 10

    SCION claims an agentic OS with Research Execution Plans and layered memory that beats autonomous research-agent baselines on reading, ideation, molecule design, and antibody screening.

  14. Towards an Agent Operating System - Lessons from Classical and Cloud OS

    cs.AI 2026-07 conditional novelty 5.0 of 10

    Agentic systems need an Agent-OS of thirteen OS/Cloud-OS-derived primitives with precise platform-enforceable semantics before portable production adoption is possible.

  15. Scalable LLM Agent Tool Access in the Cloud

    cs.DC 2026-07 conditional novelty 5.0 of 10

    A cloud-scale MCP gateway with hybrid dense-sparse retrieval lets LLM agents work with 3,000+ tools at 98% Top-15 recall, cutting tool-selection time 8.9× and token use 23.8×.

  16. Large Language Model Agent for Structural Drawing Generation Using ReAct Prompt Engineering and Retrieval Augmented Generation

    cs.LG 2025-07 conditional novelty 5.0 of 10

    A six-stage LLM agent chain converts natural-language descriptions of three beam types into Python code for AutoCAD drawings, with per-step success rates between 77% and 100% over 100 runs.

  17. The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy

    cs.AI 2026-07 conditional novelty 4.5 of 10

    Medical agents should be scaled mainly by richer clinical environments and self-evolution loops, not parameter growth alone, under a three-level autonomy taxonomy.

  18. LA-RCS: LLM-Agent-Based Robot Control System

    cs.RO 2025-05 reject novelty 4.0 of 10

    LA-RCS reports that a dual-agent LLM system controls a small car robot to complete 18 of 20 self-designed commands with the GPT-4o variant, but the supporting evaluation is inconsistent and not reproducible.

  19. Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI

    cs.SE 2025-05 conditional novelty 3.0 of 10

    A qualitative taxonomy positions vibe coding and agentic coding as complementary paradigms rather than rivals in AI-assisted software development.

Pith tools