Pith. sign in

Paper Citation Record · LEDGER

Utility is in the Eye of the User: A Critique of NLP Leaderboards

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 4 inbound Pith citation observations for arXiv:2009.13888.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2009.13888 v4

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 4 of 4 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T15:06:54.866504Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-18T11:01:17.105752Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 0017ebb3-a924-48e8-80d4-3ef1c890c58b · inbound

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation cites this paper.

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-08T15:06:54.866504Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T15:06:54.866504Z digest=sha256:a270484f502fd9b46d7926b017561aa808e7fb42dbf8befee6e82080f0fa5f51

Observation 0c314a30-c5e5-447a-ab89-49843e9caecd · inbound

VLM@school -- Evaluation of AI image understanding on German middle school knowledge cites this paper.

VLM@school -- Evaluation of AI image understanding on German middle school knowledge Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T04:06:29.022554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:06:29.022554Z digest=sha256:66c9e4a797d1101c6f82d54eafa46710123bf2c05267adca0bfb8a6b0beaf8c5

Observation bfee44e5-92ad-4a1e-a4af-f10d0df48641 · inbound

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners cites this paper.

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-18T11:01:17.109691Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-18T10:59:16.139525Z digest=sha256:921d4bc57455a6afe9a63035de6642481e3149384a8de12741b0032e187fbd91

Observation 72a29015-d3a7-4b0e-b559-60bc8b13ba09 · inbound

Unsteady Metrics and Benchmarking Cultures of AI Model Builders cites this paper.

Unsteady Metrics and Benchmarking Cultures of AI Model Builders Utility is in the Eye of the User: A Critique of NLP Leaderboards

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-15T04:55:03.345398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-15T04:54:26.888562Z digest=sha256:140341e5f6cc5c9b4a73db9f968d6dc4822730e04b8de8b9259ae4f1c73e48f9