Pith. sign in

REVIEW 2 cited by

Agent READMEs: An Empirical Study of Context Files for Agentic Coding

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2511.12884 v2 pith:ZL6PITRU submitted 2025-11-17 cs.SE

classification cs.SE
keywords contextfilesagentcodeagenticagentscodingcontent
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Agentic coding tools receive goals written in natural language, break them down into specific tasks, and write or execute code with minimal human intervention. Central to this process are agent context files (e.g., AGENTS.md and CLAUDE.md) that provide persistent, project-level instructions. In this paper, we conduct the first large-scale empirical study of 2,303 agent context files from 1,925 repositories to characterize their structure, maintenance, and content. We find that these files are not static documentation but complex, difficultto-read artifacts that evolve like configuration code through frequent, small additions. Our content analysis of 16 instruction types shows that developers prioritize functional context, such as test procedures (75.9%), implementation details (70.8%), and architecture (68.1%). We also identify a significant gap: non-functional requirements such as security (14.8%) and performance (14.5%) are rarely specified. These findings indicate that while developers use context files to make agents functional, they provide few guardrails to ensure that agent-written code is secure or performant, highlighting the need for improved tools and practices.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. The Devil Is in the Interface: Evaluating How Tool Architecture Shapes Coding Agent Behavior

    cs.SE 2026-08 conditional novelty 6.0 of 10

    Tool architecture alone, with capabilities held similar, changes coding-agent consistency, exploration, and token efficiency across three models and 11,700 trajectories.

  2. Why Does CLAUDE.md Keep Growing? Catastrophic Remembering in Agentic Coding

    cs.AI 2026-08 conditional novelty 6.0 of 10

    Agentic coding prompts grow because the reasoning behind old instructions decays, and comments that preserve that reasoning halt the growth and recover instruction-following.

Pith tools