Paper Citation Record · LEDGER

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation

As of 9 August 2026, this Paper Citation Record lists 18 of 18 outbound references and 0 inbound Pith citation observations for arXiv:2607.28801.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.28801 v1

Coverage vector

measured 18 of 18 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T00:24:09.129500Z

measured 18 of 18 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

18 of 18 outbound references displayed

verified exact0
verified fuzzy0
unresolved17
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 71901d54-e696-49e1-9fb7-68086feb2bf4 · outbound

This paper cites an unresolved cited work.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Unresolved cited work

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.337433Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae4c4257-e350-4b93-9931-7ba31d78942b · outbound

This paper cites no" | "partial.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation no" | "partial

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.459171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b652f6b8-d0ca-4363-997a-e02245f5efbf · outbound

This paper cites no" | "partial.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation no" | "partial

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.527171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7babb2c5-a3ae-42d1-b600-14e458faefea · outbound

This paper cites an unresolved cited work.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.573680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 92bb0f0a-dfff-4bf0-a3a2-113b0da1c287 · outbound

This paper cites indicators.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation indicators

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.658583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9bf64def-82c1-4e3e-a22d-ef528c058aee · outbound

This paper cites an unresolved cited work.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:09.045561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6b0d61b-97e4-4b28-9e74-bbd63b46f414 · outbound

This paper cites id": 0,.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation id": 0,

Reference 7

Resolution: malformed identifier; no resolver link, observed 2026-08-03T00:24:09.129500Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 07bc2473-1133-4dfa-82eb-2bf9deaf358f · outbound

This paper cites an unresolved cited work.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.743785Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f041bf89-8cf9-404c-af89-5bebd5edf38c · outbound

This paper cites Use [] if none apply.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Use [] if none apply

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.794384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a637ccb8-24be-4281-8843-cb94ea8d1144 · outbound

This paper cites an unresolved cited work.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.858764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d398dcca-c530-406a-8137-480ffc9b56f0 · outbound

This paper cites "partial", not 1).

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation "partial", not 1)

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.904349Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a2224b6-7ca7-4aac-9322-d545e90376d7 · outbound

This paper cites an unresolved cited work.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Unresolved cited work

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.985611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 01abc87a-b506-4d56-a5c8-6699f866b788 · outbound

This paper cites Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 118

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.131704Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d18b0e1a-4d83-4284-a968-2162598b044d · outbound

This paper cites Dynabench: Rethinking Benchmarking in NLP.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Dynabench: Rethinking Benchmarking in NLP

Reference 306

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:07.971141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e0a0622-821c-45c4-9802-65320c4f94d0 · outbound

This paper cites Gender Bias in Coreference Resolution.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Gender Bias in Coreference Resolution

Reference 442

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.044702Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20ff151c-eab0-41b8-a60b-ec6f145cc575 · outbound

This paper cites HellaSwag: Can a Machine Really Finish Your Sentence?.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation HellaSwag: Can a Machine Really Finish Your Sentence?

Reference 1275

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.252392Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 22dbdaec-d359-4fc1-a9d6-c564b29e9c3c · outbound

This paper cites Annotation Artifacts in Natural Language Inference Data.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Annotation Artifacts in Natural Language Inference Data

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:07.887822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f6cc7f78-62a1-459f-bd38-2046c02d4b7d · outbound

This paper cites ISBN 979-8-89176-251-0.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation ISBN 979-8-89176-251-0

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-03T00:24:08.191034Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.