Pith. sign in

Paper Citation Record · LEDGER

Quantifying Ranking Uncertainty in LLM Benchmarks

As of 10 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2607.16259.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.16259 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T09:45:26.783659Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved12
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0ce2d397-8c5e-43ab-b500-c7fbe4be67dd · outbound

This paper cites Statistical multi-metric evaluation and visualization of LLM system predictive performance.

Quantifying Ranking Uncertainty in LLM Benchmarks Statistical multi-metric evaluation and visualization of LLM system predictive performance

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.654826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.654826Z digest=sha256:e63a2af5ebc4eb7e7f8a8899d3e4f70cda04215c8a773dd51c37692435680174

Observation 888ac22e-0202-40b4-9ced-e73fb5692a02 · outbound

This paper cites an unresolved cited work.

Quantifying Ranking Uncertainty in LLM Benchmarks Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.783659Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.783659Z digest=sha256:5723d3e6c5afd5f47d02e5d463cdabaf4c78d0c7415bcb005616302d2e256dec

Observation 952a4649-f56a-446f-8cf2-6448267212b1 · outbound

This paper cites Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations.

Quantifying Ranking Uncertainty in LLM Benchmarks Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.764175Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.764175Z digest=sha256:ad37379cb4ca2cd887fab69e2927a7f94fa9565b4d75ed34be00fd9a3c8dd015

Observation d8bd6428-18df-489c-84c4-6df7bb1d22f2 · outbound

This paper cites Uncertainty in Ranking.

Quantifying Ranking Uncertainty in LLM Benchmarks Uncertainty in Ranking

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.770767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.770767Z digest=sha256:df1b78909b5a4968dd12a75398fa35876f6f0e1a0b5534b16307d306c527f08b

Observation 0bf3017c-bbcd-4e3f-82ee-4a1bf21a8f54 · outbound

This paper cites and Soares, C.

Quantifying Ranking Uncertainty in LLM Benchmarks and Soares, C

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.773698Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.773698Z digest=sha256:8703d7d769eef1544a50a688910ba9c3a80d22421e467ed449bab62fdd62f75f

Observation 991caf93-f214-44a3-9db2-ca24810f52b3 · outbound

This paper cites However, the distribution may not be approximately normal, or even symmetric.

Quantifying Ranking Uncertainty in LLM Benchmarks However, the distribution may not be approximately normal, or even symmetric

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.780198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.780198Z digest=sha256:55b66add0c9be4695d90b54dfec78a7b5e6c1fbb66a4440238b7b0e22b96e4c5

Observation baf7aa5c-d312-466c-a63f-247799544128 · outbound

This paper cites Rank CIs definitions and methods A.1.

Quantifying Ranking Uncertainty in LLM Benchmarks Rank CIs definitions and methods A.1

Reference 1945

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.776655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.776655Z digest=sha256:d5dfd812ff71d74cf7c5f86aeca6fef204f766d2ef1f31cf99c339ec9d349009

Observation a7bd5273-8c29-461c-a191-deae2e3f8a1b · outbound

This paper cites and Xie, M.-g.

Quantifying Ranking Uncertainty in LLM Benchmarks and Xie, M.-g

Reference 2005

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.750418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.750418Z digest=sha256:ec129db852ab8a3e8c0ae972ce469994ed886c1a628422f9a54375bff5294c0f

Observation 9e912ea6-43bd-4987-9d89-9cf86f6ff93a · outbound

This paper cites Ranking the scores of algorithms with confidence.

Quantifying Ranking Uncertainty in LLM Benchmarks Ranking the scores of algorithms with confidence

Reference 2006

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.756908Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.756908Z digest=sha256:f6449ca46c3be42255dddaa17e631546db4d594e7d8ab78a344df10269b93b3d

Observation c7959c14-d469-4ead-9123-88fc50639653 · outbound

This paper cites v067.i01.

Quantifying Ranking Uncertainty in LLM Benchmarks v067.i01

Reference 2015

Resolution
malformed identifier
no resolver link, observed 2026-08-02T09:45:26.747218Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.747218Z digest=sha256:e8e9b586703280f472d5b4a3e18b0a72fa9d9e7140bf4a2e15a3930331adb01f

Observation 0e0ff518-4728-4b2e-91b7-ceb05ff3d2c4 · outbound

This paper cites Al Mohamad, D., Goeman, J.

Quantifying Ranking Uncertainty in LLM Benchmarks Al Mohamad, D., Goeman, J

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.715464Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.715464Z digest=sha256:c2c1056bf9d25d82a60a705322ca5c2767446cbb974dabf28e7b9b1eaa471857

Observation 3514908c-2504-42d2-9ea3-a515cef37245 · outbound

This paper cites Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks.

Quantifying Ranking Uncertainty in LLM Benchmarks Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.760955Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.760955Z digest=sha256:5e63c0d94cfdfc512c239031bf782ee0f2e1fe84ef7875acefbd2fb79d80a65a

Observation 42b087ab-ed08-4508-8b08-62be75a5da4b · outbound

This paper cites doi: 10.1093/restud/rdad006.

Quantifying Ranking Uncertainty in LLM Benchmarks doi: 10.1093/restud/rdad006

Reference 2024

Resolution
verified exact
doi, observed 2026-08-02T09:48:22.056526Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-02T09:45:26.767692Z digest=sha256:2a85f85b19c61005bc696cf758ec04b07b9a34906cb723265c873f200e272669

Observation 0d68b735-f2f3-4a20-a2c0-3683e2bae536 · outbound

This paper cites csranks: An R Package for Estimation and Inference Involving Ranks.

Quantifying Ranking Uncertainty in LLM Benchmarks csranks: An R Package for Estimation and Inference Involving Ranks

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-02T09:45:26.753694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T09:45:26.753694Z digest=sha256:7a6a9129d7a006e31f81dce9733f90a7c77245f572bd3311818cbe6e1887268f

Pith citing papers

No inbound Pith citation observations are available.