Pith. sign in

Paper Citation Record · LEDGER

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations

As of 18 August 2026, this Paper Citation Record lists 17 of 17 outbound references and 0 inbound Pith citation observations for arXiv:2608.11323.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.11323 v1

Coverage vector

measured 17 of 17 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T14:19:01.373037Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

17 of 17 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved16
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 69fc04de-924a-43d5-952a-d2f92e579858 · outbound

This paper cites $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.300117Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.300117Z digest=sha256:1885de57efeac60af2acc6fa33180ddf5c4a75275f208f35854e4a29182854f4

Observation 332b27dd-87d8-4de5-b8b6-ccdd04592b8c · outbound

This paper cites Quantifying Variance in Evaluation Benchmarks.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Quantifying Variance in Evaluation Benchmarks

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.325377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.325377Z digest=sha256:47b3b0901b07632a7925a3aca3e26e736cffdcbbf9a99f4ca8cf07dadadd32c1

Observation 8aedec13-f0f3-4bf1-9a51-4ad62f1a451c · outbound

This paper cites Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.330125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.330125Z digest=sha256:e8945de27a4b7ec876147902b41e94c48811577310fe7e8afdfc0f7c6c00aabb

Observation b887848f-9d90-42cb-b23d-a1d1c8a8f796 · outbound

This paper cites an unresolved cited work.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Unresolved cited work

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.338993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.338993Z digest=sha256:6564f8c7bfc713a969dca7d46f8bc18efb6a22640d2c2c0dd493e5c8f2bd60cb

Observation 88477b10-f89f-44f7-ac71-b3c8c702842a · outbound

This paper cites Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.342822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.342822Z digest=sha256:4b471908ad26e50e2d5754087d40233b79bf39ff28f88ef74a3e7bd330add547

Observation db44260c-5bec-440f-9530-32e592f4064e · outbound

This paper cites Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theory.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theory

Reference 12

Resolution
verified exact
local_arxiv, observed 2026-08-15T14:19:01.482213Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-15T14:19:01.351948Z digest=sha256:bdd1e008b925d886b8f5f984f8e46c1f5853bda8f166be6ae84b54e06391cce7

Observation 384dd9b7-c37a-4737-8b14-efc908bb4961 · outbound

This paper cites AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.355952Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.355952Z digest=sha256:5cb092dd955714c619ed16bd3d89e1a042f25f80fe63fe469db36a335aaf8c69

Observation c9f04fb3-10a1-4e55-888c-c4ce3341e668 · outbound

This paper cites $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.363935Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.363935Z digest=sha256:e1277a3744c782c84918cde176307e4a150219707e2dc24b76d62cec0de01a27

Observation c22278dd-6d74-44fc-994c-fc5b120df8f0 · outbound

This paper cites Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.368996Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.368996Z digest=sha256:7e0f4c665b86fea94798459b096762f2e61fa5316a7ec74c0fffa3ca7df820d1

Observation f57a5502-39f8-48e0-a75b-a793a9ac26af · outbound

This paper cites Stop Comparing LLM Agents Without Disclosing the Harness.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Stop Comparing LLM Agents Without Disclosing the Harness

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.373037Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.373037Z digest=sha256:eee4daf1f1e26fcf8fb6a776891feef34b2c18486df8054b4ee46e66cc6030b6

Observation 9da7396a-b91e-48bb-8ee5-177e866cf05f · outbound

This paper cites Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation

Reference 1972

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.315611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.315611Z digest=sha256:ffad07839b3ea22725dbf6f5933c462539c5a9454e4bc3f397e4c8e1e96ebef1

Observation 18378a75-b1d5-4ccd-82b4-2da5827b080a · outbound

This paper cites TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks

Reference 2013

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.359932Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.359932Z digest=sha256:93162cc085dfda02038ea313969950a15f1c8f328e2e6e62a2558774d5858833

Observation 31873485-17ff-467c-aa5c-148242dc43bd · outbound

This paper cites tinyBenchmarks: evaluating LLMs with fewer examples.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations tinyBenchmarks: evaluating LLMs with fewer examples

Reference 2019

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.347552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.347552Z digest=sha256:4f1eb580bc46bc1885e3c0a9bf6131335ca1c93f8914190b1a65518273b8a039

Observation b72ee5b7-3ca5-4228-bcf9-dbe4c0528c8b · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Why Do Multi-Agent LLM Systems Fail?

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.306555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.306555Z digest=sha256:094fc976128a3e733d089a3b27750b849cb24e000e2ba90d45a991e62a1e5e31

Observation 8af3943e-88d0-445b-85a2-27bff4a3f0e3 · outbound

This paper cites Holistic Evaluation of Language Models.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Holistic Evaluation of Language Models

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.320667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.320667Z digest=sha256:b34b9efe32ae25aec49481e63f5d1f8d234146016e6a4eddc8a34aba4e19e02a

Observation 1c8b6ed6-75a9-46f3-94ad-8de40ec916a2 · outbound

This paper cites an unresolved cited work.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Unresolved cited work

Reference 2025

Resolution
unresolved
raw_fallback, observed 2026-08-15T14:19:01.680683Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-15T14:19:01.311278Z digest=sha256:9263ca47482f88fd34e6ff3b188803f25f3c289d2d8614269cd9dca001c21171

Observation 647d245e-3e52-47dc-af7b-04d21a150fec · outbound

This paper cites Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations.

Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations

Reference 2026

Resolution
unresolved
no resolver link, observed 2026-08-15T14:19:01.334779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T14:19:01.334779Z digest=sha256:ca61a8a7016d587f2cf5d057ddc1c26c59741229f816b8878784c0e779bde52e

Pith citing papers

No inbound Pith citation observations are available.