Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-08T19:46:29.077278Z
Paper Citation Record · LEDGER
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
As of 17 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 10 inbound Pith citation observations for arXiv:2502.05352.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-11T23:12:09.952843Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Reference resolution
21 of 21 outbound references displayed
- verified exact0
- verified fuzzy11
- unresolved9
- parse uncertain0
- malformed identifier1
- metadata mismatch0
External citation measurements
1
arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Outbound references
Observation b520474b-66a0-4189-814d-065f8998975c · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 1
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.497251Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation c889bd70-fa31-40ab-a2fa-37ce087048ef · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 2
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.482665Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation aaac6ff3-c0d8-4503-b018-7d1e1aba76d3 · outbound
This paper cites playground.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks playground
Reference 3
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.468237Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation e325e85d-2de9-4d5f-9002-5fca9ce9247c · outbound
This paper cites (b) Benchmark Runner deploys the scenario’s environ- ment by executing the deploy_scenario function.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks (b) Benchmark Runner deploys the scenario’s environ- ment by executing the deploy_scenario function
Reference 4
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.453209Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 1a10f1a3-76de-4437-9fe3-385fccd199d0 · outbound
This paper cites node failure.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks node failure
Reference 5
- Resolution
- malformed identifier
- raw_fallback, observed 2026-08-08T19:46:29.438610Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 36705693-e0e4-468a-93bd-80e0e613a7d3 · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 6
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.345593Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 39f41ebf-5218-4df1-a208-237a3b5de4f7 · outbound
This paper cites pass" or.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks pass" or
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.329503Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation ef9f8cff-5133-4745-8dd3-c2eadf8fe02a · outbound
This paper cites Kick agent Y with report.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Kick agent Y with report
Reference 8
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.280862Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 4910c503-b40e-449d-9630-68d83db3678f · outbound
This paper cites We group the agents by Agent Types that reflect the IT operations personas, for example CISO, FInOps, or SRE type.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks We group the agents by Agent Types that reflect the IT operations personas, for example CISO, FInOps, or SRE type
Reference 10
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.423396Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 271a0c99-016f-42b9-9770-2269da4593af · outbound
This paper cites Typi- cal tasks for CISO are to collect evidence and assess compliance controls posture.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Typi- cal tasks for CISO are to collect evidence and assess compliance controls posture
Reference 11
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.407414Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 3f4c685f-4084-4291-8963-ec9fc441979c · outbound
This paper cites For CISO, for instance, each Kubernetes CIS-benchmark requirement instantiated on OPA is a unique scenario.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks For CISO, for instance, each Kubernetes CIS-benchmark requirement instantiated on OPA is a unique scenario
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.391966Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 361d25b6-d50e-4bdb-8a2c-4490dbfc7bfd · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 13
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.376752Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation efb97043-9e9b-4379-96ba-48c424d43d33 · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 14
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.361161Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 3d356a79-91fc-446c-9f27-634725a3142c · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 17
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.312564Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 927cc06d-5a49-4738-9248-13ca839ca6ff · outbound
This paper cites deploy_environment.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks deploy_environment
Reference 18
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.296425Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 882879e2-8f54-4857-b0f4-cee53f461396 · outbound
This paper cites Clear deployed scenario2.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Clear deployed scenario2
Reference 20
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.265588Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation da5608ce-a675-45f1-b012-5b675355edc1 · outbound
This paper cites mini- mize the admission of containers wishing to share the host network namespace.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks mini- mize the admission of containers wishing to share the host network namespace
Reference 21
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.249324Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation b2537391-61d0-4d00-a9fc-cf0f6ec47733 · outbound
This paper cites Exploring LLM-based Agents for Root Cause Analysis.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Exploring LLM-based Agents for Root Cause Analysis
Reference 365
- Resolution
- unresolved
- no resolver link, observed 2026-08-08T19:46:28.986960Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a14c3c13-3df1-4e31-956b-ea1e4feaddc7 · outbound
This paper cites doi: 10.1145/2829988.2787496.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks doi: 10.1145/2829988.2787496
Reference 2015
- Resolution
- unresolved
- no resolver link, observed 2026-08-08T19:46:28.981608Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1f66d25f-b529-403d-b8f0-689eb1e46340 · outbound
This paper cites an unresolved cited work.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work
Reference 2022
- Resolution
- unresolved
- raw_fallback, observed 2026-08-08T19:46:29.513270Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 33c4311d-fded-49d5-a82d-ead5ae4a6d64 · outbound
This paper cites the AI revolution hasn’t happened yet.
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks the AI revolution hasn’t happened yet
Reference 2024
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-08T19:46:29.529339Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Pith citing papers
Observation ddff6922-1cf3-4055-83be-510cd414c2ca · inbound
LLMs Corrupt Your Documents When You Delegate cites this paper.
LLMs Corrupt Your Documents When You Delegate ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 36
- Resolution
- verified exact
- arxiv_id, observed 2026-05-10T09:48:47.626847Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 0247fec9-b64b-4ff5-b8d1-8863f7809c47 · inbound
Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery cites this paper.
Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 136
- Resolution
- verified exact
- arxiv_id, observed 2026-05-08T20:04:06.598794Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation f603da73-d2fd-44f9-b490-51cab57d9fb7 · inbound
Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery cites this paper.
Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 136
- Resolution
- verified exact
- arxiv_id, observed 2026-05-21T00:13:52.344837Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation b341aca9-665d-4d30-a077-6ec02259c301 · inbound
From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines cites this paper.
From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 24
- Resolution
- verified exact
- arxiv_id, observed 2026-05-11T03:55:57.170897Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation df8a5b55-37bf-49a0-8ef3-7ecabce42b99 · inbound
Runtime-Structured Task Decomposition for Agentic Coding Systems cites this paper.
Runtime-Structured Task Decomposition for Agentic Coding Systems ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 22
- Resolution
- verified exact
- arxiv_id, observed 2026-05-19T14:47:36.175763Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation d0025bab-9094-4305-adcc-ad8f611abf7d · inbound
Auditable Graph-Guided Root Cause Analysis for Kubernetes Incidents cites this paper.
Auditable Graph-Guided Root Cause Analysis for Kubernetes Incidents ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 3
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-02T23:27:28.084149Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation ecaeffc4-54e8-476c-8a4e-e48ca3bdc2a5 · inbound
Pooled Leaderboards Hide System-Specific Winners: A Reporting-Protocol Audit of Offline Root-Cause Analysis Benchmarks cites this paper.
Pooled Leaderboards Hide System-Specific Winners: A Reporting-Protocol Audit of Offline Root-Cause Analysis Benchmarks ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 11
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-06-30T07:54:21.844748Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 7e62ae76-ef13-4998-bb89-f97064594ab4 · inbound
Synthetic Scenario Generation for Evaluation of Industry 4.0 Agents cites this paper.
Synthetic Scenario Generation for Evaluation of Industry 4.0 Agents ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 2025
- Resolution
- unresolved
- no resolver link, observed 2026-08-02T12:47:54.895493Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4886e0b6-7834-48f1-94b6-916a93d33fd3 · inbound
Beyond Component Testing: Validating Agentic AI Systems cites this paper.
Beyond Component Testing: Validating Agentic AI Systems ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 18
- Resolution
- unresolved
- no resolver link, observed 2026-08-03T07:41:24.219547Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 07b4d204-c61b-4404-a55a-7273f46e0ce1 · inbound
Motif 3: Technical Report cites this paper.
Motif 3: Technical Report ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Reference 25
- Resolution
- unresolved
- no resolver link, observed 2026-08-11T23:12:09.952843Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.