Paper Citation Record · LEDGER

Real-World Summarization: When Evaluation Reaches Its Limits

As of 14 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 0 inbound Pith citation observations for arXiv:2507.11508.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.11508 v1

Coverage vector

measured 27 of 27 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T17:10:30.705212Z

measured 27 of 27 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

27 of 27 outbound references displayed

verified exact0
verified fuzzy3
unresolved24
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9361ac6c-fc39-4580-8a35-9212a4bb8a32 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:28.475366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d20c4c79-101e-4bc7-bbb9-d1b2020c5a7e · outbound

This paper cites LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks.

Real-World Summarization: When Evaluation Reaches Its Limits LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:28.574651Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3770cd8c-e578-4d4c-a886-5b28b891a5e4 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:28.657912Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 06bd4ded-1f36-43f0-9295-8cba8267cefc · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:28.749044Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1520cf94-8af7-494b-8296-57953f55f884 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:28.821642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be2dd6d7-17b6-4f2d-b316-5ec461ef30c1 · outbound

This paper cites A Survey on LLM-as-a-Judge.

Real-World Summarization: When Evaluation Reaches Its Limits A Survey on LLM-as-a-Judge

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:28.949589Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38b72a91-bd38-4ea4-891e-59c2ba58dc66 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.051592Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d3b41d06-98aa-463b-a036-280cdbecfef1 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.152688Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ce0713b-058c-43bd-bcfc-23edd20cbcaa · outbound

This paper cites Survey of Hallucination in Natural Language Generation.

Real-World Summarization: When Evaluation Reaches Its Limits Survey of Hallucination in Natural Language Generation

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.256672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 60282200-b513-4818-8ffc-1726e841350c · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-06T17:10:32.101185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 01ce55fe-4b76-4577-879f-deec56005e7c · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 11

Resolution: unresolved; raw_fallback, observed 2026-08-06T17:10:31.909636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 7245dc71-82ad-44e1-86b8-ab4be69f2fd6 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.509439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23161c49-e7e9-44f7-b1ca-4eb28bd46d1f · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.575337Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a34fbaef-4487-420d-bb49-5bda3fcc6af8 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.616652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e8b6378e-0913-4e89-b33d-85db15d6b6ab · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.720482Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2b35719-f2cf-45be-a259-e15c4362a3c5 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.806227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 18bce40c-63e1-4261-b07e-4943060fc856 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:29.842953Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f7c86588-5048-426f-b8ac-03186b58ef1f · outbound

This paper cites Chatterji, Faisal Ladhak, and Tatsunori Hashimoto.

Real-World Summarization: When Evaluation Reaches Its Limits Chatterji, Faisal Ladhak, and Tatsunori Hashimoto

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T17:10:31.744191Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 81343b7f-aba1-45b7-bbf0-4787da1333e4 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:30.009993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c1e4e7de-05f1-4953-9262-f453dc3f32cd · outbound

This paper cites Large Language Models Meet NLP: A Survey.

Real-World Summarization: When Evaluation Reaches Its Limits Large Language Models Meet NLP: A Survey

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:30.110514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a19cd71-01a7-45c1-b3ac-66ad75991064 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:30.201921Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ef2b4532-b02b-4962-bf6b-dfa5f7c7f6c3 · outbound

This paper cites Howcroft, Ondrej Platek, and Adarsa Sivaprasad.

Real-World Summarization: When Evaluation Reaches Its Limits Howcroft, Ondrej Platek, and Adarsa Sivaprasad

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T17:10:31.555635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation ab95df65-a545-4e95-921a-407195c97e38 · outbound

This paper cites an unresolved cited work.

Real-World Summarization: When Evaluation Reaches Its Limits Unresolved cited work

Reference 23

Resolution: unresolved; raw_fallback, observed 2026-08-06T17:10:31.356818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 23854cb4-2517-42d3-9cf5-e46dc8bf47d5 · outbound

This paper cites Gemma 3 Technical Report.

Real-World Summarization: When Evaluation Reaches Its Limits Gemma 3 Technical Report

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:30.419533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4c3a7e11-b7e8-4a7c-ab8c-74fb4fef3f3e · outbound

This paper cites GPT-4o System Card.

Real-World Summarization: When Evaluation Reaches Its Limits GPT-4o System Card

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:30.485227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aea69c8b-122b-4702-a359-5d759d28da67 · outbound

This paper cites Dai, and Quoc V.

Real-World Summarization: When Evaluation Reaches Its Limits Dai, and Quoc V

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T17:10:31.184219Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 1e9a4a86-871b-454e-9495-dd7cefcf39e1 · outbound

This paper cites Weinberger, and Yoav Artzi.

Real-World Summarization: When Evaluation Reaches Its Limits Weinberger, and Yoav Artzi

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-06T17:10:30.705212Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.