Pith. sign in

Paper Citation Record · LEDGER

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality

As of 17 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 0 inbound Pith citation observations for arXiv:2608.05263.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.05263 v1

Coverage vector

measured 13 of 13 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T16:55:25.086245Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

13 of 13 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bda7e281-e311-4fc6-ac00-c0d94ddb9991 · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-08T16:55:25.464905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-08T16:55:25.049359Z digest=sha256:f5ce7141d5994ef6f63476c18664c1cefc4ab6e24fd2de485d238b3de19d9728

Observation 4da9c864-5e82-4517-84e9-5e7a6af432f4 · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Why Do Multi-Agent LLM Systems Fail?

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.053010Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.053010Z digest=sha256:b93d04f7c58f31d927a26f8c794a4600c1ac0454df69e32c808beb67f279dffd

Observation 98ce1601-51f6-4558-869a-4bb14d0b31fc · outbound

This paper cites Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.055968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.055968Z digest=sha256:794390266f3d3446bfab27753a025f94bfeb53842fb3d45c0d8e412f352b63a4

Observation 8c0d5811-648d-4f41-9cbb-e0bc95a187ff · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.058736Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.058736Z digest=sha256:fe167c9b4f93eaf30744374436f59ff703449d83aecaf17370b3612271ac2e8f

Observation a0fa45f8-9519-47b3-8a03-363bfd6e0a9e · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.061431Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.061431Z digest=sha256:d09940556ba67d93529466d70b6465f3143452d84f9d2e2fc8f768da2bce1e95

Observation d4d14260-fb19-4726-9c64-857b0e70a7de · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.064300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.064300Z digest=sha256:d20af2841c73a325ebc978f31838af9bd08c51c9adc626e79e441c4bffe64fec

Observation d768e3fc-1ceb-4ecf-a552-de120e499892 · outbound

This paper cites AgentBench: Evaluating LLMs as Agents.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality AgentBench: Evaluating LLMs as Agents

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.067711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.067711Z digest=sha256:7eff6213d16ccd4aee272eb9320a5e97ced3ed8d89335c16f7821e468c68fd0a

Observation afb39c2b-fed8-4bc4-b8e0-aa8a14c79318 · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.070879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.070879Z digest=sha256:793c33eeffbe5536c7fca9c7c18d11247103fdb2f052228de034bf3d60b792bb

Observation ba1c042e-869e-4601-8b0d-3df27d192725 · outbound

This paper cites OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.073757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.073757Z digest=sha256:5b4a41b7cda6567ee768568fe37435d969aaeb16e04b82bb2cf34cf4d5630b0e

Observation f98b9881-50a1-4c5f-8ee8-825bba1b55fa · outbound

This paper cites From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.076877Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.076877Z digest=sha256:0d032ee9d26edfdffba4d869e023e8877a046f84dfa5c7887d7012e92caa3345

Observation 0e07f305-0cfa-4ab7-a867-86b91fa84f4c · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.080128Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.080128Z digest=sha256:ce62262a00a4dbd0947e426ab44f885c91a767ceb2fa4a54aa68df00a9dceb45

Observation 1b1a4bc4-5c4a-4cf5-bfd2-d7320037acf2 · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-08T16:55:25.455420Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-08T16:55:25.082955Z digest=sha256:a2698a987669d12c78e386000f9240e01cb9a0e0d8dedfab6536041b6f095e8d

Observation 3f7cdcfb-68ca-4dbf-9693-bebea510f99b · outbound

This paper cites Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.086245Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.086245Z digest=sha256:e13db56978d4ebe2276115e3efd7023d4efc5c96159107ef656dcef677ad9e6c

Pith citing papers

No inbound Pith citation observations are available.