Paper Citation Record · LEDGER

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It

As of 17 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2506.23864.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.23864 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T21:45:09.858119Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

verified exact2
verified fuzzy1
unresolved21
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 04b768e8-97c6-47a4-9e6b-72623c83f357 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:11.616138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 6ddfcbc4-d589-44a4-a627-a6805ccc57bc · outbound

This paper cites LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.494636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d9dbd08-14db-4c44-ac8b-4a56e9f2442c · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.592435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 22ed2e5a-77d4-4f14-a3c5-255b268485e6 · outbound

This paper cites Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.680865Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4343a08f-fe5b-4c6f-80de-722db85388de · outbound

This paper cites Holliday, Matthew Mandelkern, and Cedegao E.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Holliday, Matthew Mandelkern, and Cedegao E

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.762323Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0dbf4ed-ec76-4b2b-a4a2-82463cc93e08 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.853315Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9a6e182-35ca-4249-aa51-3bcf20cd5dab · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:11.448608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation c4351088-cf4c-466f-b834-5eab14ae8bc6 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.047011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a20ce4a-cef7-4f14-91c9-c414363f814f · outbound

This paper cites Levenshtein.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Levenshtein

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T21:45:11.281585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e2806cf4-e1a3-4291-8d88-34263ede61be · outbound

This paper cites Learn to Reason Efficiently with Adaptive Length-based Reward Shaping.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Learn to Reason Efficiently with Adaptive Length-based Reward Shaping

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.292468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cf2d6ce1-af97-498d-aed2-b364763e7776 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.397583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02b12aa6-2d16-452a-b062-72d6f98f9aac · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:11.136027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 72af9341-205d-4149-8ae4-fc27e3ebd08d · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.643047Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41ab8d18-7e89-40bf-9857-b35e4732859e · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 14

Resolution: verified exact; doi, observed 2026-08-06T21:45:10.341273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 91356da8-2dc1-4b43-82c7-69dbc087a52e · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 15

Resolution: verified exact; doi, observed 2026-08-06T21:45:10.174421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 0cf6967e-2868-4373-8d53-a9039a7303a9 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.995084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6f1721d-41e5-4de6-80ca-63aabe11e91d · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:10.939571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation d936c27c-6299-4745-aa9f-c3424edae33c · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:10.788391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 47c00e00-2ba2-4f4f-91f5-179082699545 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.333753Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d2aa662-8c54-4ab7-bc5d-a26c3be11446 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.437143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df0b3053-1854-4c72-bb4e-e21f272b49ec · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.540576Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6aae24ad-7f5b-461d-86c6-b3475dc7a39f · outbound

This paper cites Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.632588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02bc54b7-3f06-43ff-98a4-002725d0b6c4 · outbound

This paper cites online" 'onlinestring :=.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It online" 'onlinestring :=

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.718730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20d58dfc-6ae5-4e26-97d6-113dbb567eb5 · outbound

This paper cites write newline.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It write newline

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.858119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.