Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-05T00:36:51.584458Z
Paper Citation Record · LEDGER
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty
As of 8 August 2026, this Paper Citation Record lists 18 of 18 outbound references and 0 inbound Pith citation observations for arXiv:2608.00685.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
18 of 18 outbound references displayed
- verified exact3
- verified fuzzy4
- unresolved7
- parse uncertain0
- malformed identifier1
- metadata mismatch3
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation e97b5b1e-667a-4e86-9d97-1887e8fc79da · outbound
This paper cites Towards reasoning era: a survey of long chain-of-thought for reasoning large language models.Science China Information Sciences, 69(6):161101, May 2026b.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty Towards reasoning era: a survey of long chain-of-thought for reasoning large language models.Science China Information Sciences, 69(6):161101, May 2026b
Reference 2
- Resolution
- verified exact
- doi, observed 2026-08-05T00:36:51.642542Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 6faf6e14-da02-4a82-b125-ae09aafd60be · outbound
This paper cites ISBN 979-8-4007-1926-4.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty ISBN 979-8-4007-1926-4
Reference 5
- Resolution
- metadata mismatch
- raw_fallback, observed 2026-08-05T00:36:52.024269Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 56823672-9e9d-4af1-83a7-9e917b313744 · outbound
This paper cites pgn": SAN in standard algebraic notation **without any annotation symbols** (no ’+’ for check, no ’##’ for checkmate). Use uppercase letters for pieces. Example:.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty pgn": SAN in standard algebraic notation **without any annotation symbols** (no ’+’ for check, no ’##’ for checkmate). Use uppercase letters for pieces. Example:
Reference 6
- Resolution
- malformed identifier
- raw_fallback, observed 2026-08-05T00:36:51.747082Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 15a76664-0ca0-4ddf-81c1-9f23fc8aa58c · outbound
This paper cites OckBench: Measuring the Efficiency of LLM Reasoning.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty OckBench: Measuring the Efficiency of LLM Reasoning
Reference 7
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.549437Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c156dfc5-9448-4670-82f3-4014516eabdc · outbound
This paper cites A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
Reference 8
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.552675Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fd8bd640-66f2-4014-bd91-6516d7c7d17d · outbound
This paper cites arXiv:2511.01633 [cs].
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty arXiv:2511.01633 [cs]
Reference 9
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.555932Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1ebcbd7d-f6bf-4016-b4c9-2421af7bfcdd · outbound
This paper cites doi: 10.1038/s42256-026-01268-y.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty doi: 10.1038/s42256-026-01268-y
Reference 10
- Resolution
- verified exact
- doi, observed 2026-08-05T00:36:51.625114Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 9c8679bc-9784-46cf-b2d9-9f4c4b70af0a · outbound
This paper cites 12 Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E Gonzalez, M Kadous, and Ion Stoica.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty 12 Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E Gonzalez, M Kadous, and Ion Stoica
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T00:36:52.099964Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 040158b0-c344-4ec1-b42d-dfdfc777750b · outbound
This paper cites Andries Smit, Nathan Grinsztajn, Paul Duckworth, Thomas D.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty Andries Smit, Nathan Grinsztajn, Paul Duckworth, Thomas D
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T00:36:52.090242Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 1de149db-2c16-47ab-816e-1ebee00562ba · outbound
This paper cites Jinwei Su, Qizhen Lan, Yinghui Xia, Lifan Sun, Weiyou Tian, Tianyu Shi, and Lewei He.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty Jinwei Su, Qizhen Lan, Yinghui Xia, Lifan Sun, Weiyou Tian, Tianyu Shi, and Lewei He
Reference 14
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T00:36:52.080618Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 58910524-1645-4ff3-b7c4-bc68e7e4b339 · outbound
This paper cites ISBN 979-8-4007-2307-0.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty ISBN 979-8-4007-2307-0
Reference 15
- Resolution
- metadata mismatch
- raw_fallback, observed 2026-08-05T00:36:51.834140Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 5d490b22-8431-4b19-b5ba-61c3aa285a9f · outbound
This paper cites Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets
Reference 16
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.578178Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2718083e-6941-4cc7-907f-0317309aeb28 · outbound
This paper cites net/forum?id=YrycTjllL0.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty net/forum?id=YrycTjllL0
Reference 17
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T00:36:52.071032Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation d9eb118e-d500-4204-b2dc-09666eeb3025 · outbound
This paper cites URL https://proceedings.neurips.cc/paper_files/paper/ 2022/file/8bb0d291acd4acf06ef112099c16f326-Paper-Conference.pdf.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty URL https://proceedings.neurips.cc/paper_files/paper/ 2022/file/8bb0d291acd4acf06ef112099c16f326-Paper-Conference.pdf
Reference 2022
- Resolution
- verified exact
- doi, observed 2026-08-05T00:36:51.615086Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Observation 3157bd3e-ba94-457e-b85a-e179d197338b · outbound
This paper cites ComplexityNet: Increasing LLM Inference Efficiency by Learning Task Complexity.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty ComplexityNet: Increasing LLM Inference Efficiency by Learning Task Complexity
Reference 2023
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.526770Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f3ad080a-6702-4ca5-af59-5fe62095b3dc · outbound
This paper cites Shangheng Du, Jiabao Zhao, Jinxin Shi, Zhentao Xie, Xin Jiang, Yanhong Bai, and Liang He.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty Shangheng Du, Jiabao Zhao, Jinxin Shi, Zhentao Xie, Xin Jiang, Yanhong Bai, and Liang He
Reference 2024
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.545517Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation acbbac15-9a46-4fd5-abdb-8885dcaa562f · outbound
This paper cites The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More
Reference 2025
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T00:36:51.534496Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9faa2bda-5f36-4b73-be0c-208f8d9fdf24 · outbound
This paper cites MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems?.
When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems?
Reference 2026
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-08-05T00:36:52.050154Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.
Pith citing papers
No inbound Pith citation observations are available.