Paper Citation Record · LEDGER

Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 14 inbound Pith citation observations for arXiv:2109.09774.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2109.09774 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 14 of 14 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T13:05:38.312713Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T09:26:51.598505Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 85d54e9e-9833-4255-b64c-d40c885569ed · inbound

AgentReview: Exploring Peer Review Dynamics with LLM Agents cites this paper.

AgentReview: Exploring Peer Review Dynamics with LLM Agents Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 28

Resolution: verified exact; arxiv_id, observed 2026-05-23T23:38:37.243917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation eacc1515-4c04-404b-8f86-dd730f5c796a · inbound

AI Scientists Fail Without Strong Implementation Capability cites this paper.

AI Scientists Fail Without Strong Implementation Capability Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-07T11:49:01.756223Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c6e0a24d-f2fa-41e2-b70d-4c0bc9deac95 · inbound

Position: The ML Community Must Build an AI-Augmented Peer-Review Ecosystem cites this paper.

Position: The ML Community Must Build an AI-Augmented Peer-Review Ecosystem Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-07T05:22:49.456740Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 60375794-094c-4451-9263-44694ef74aa0 · inbound

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track cites this paper.

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T23:13:13.569893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73ae0fe3-5c05-4d6f-a7ec-62514bcfc46f · inbound

Can We Volunteer Out of the Peer Review Crisis? cites this paper.

Can We Volunteer Out of the Peer Review Crisis? Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-05-12T10:11:27.025524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4b4ae637-db12-4132-ab5e-8b785b70f439 · inbound

The State of Peer Review in Empirical Software Engineering: A Community Survey on Review Load, Quality, and GenAI Use cites this paper.

The State of Peer Review in Empirical Software Engineering: A Community Survey on Review Load, Quality, and GenAI Use Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-07-02T09:26:51.599719Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 5e103de5-3f0c-414a-ad03-d6274eb1a32a · inbound

ReviewGuard: Aligning LLM-Assisted Peer Review with Long-Term Scientific Impact cites this paper.

ReviewGuard: Aligning LLM-Assisted Peer Review with Long-Term Scientific Impact Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 7

Resolution: verified exact; arxiv_id, observed 2026-06-28T20:22:37.152415Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3dc09d89-04b9-43d4-8b1c-37f0755fcf9b · inbound

Towards Automating Scientific Review with Google's Paper Assistant Tool cites this paper.

Towards Automating Scientific Review with Google's Paper Assistant Tool Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 5

Resolution: verified exact; arxiv_id, observed 2026-07-01T17:05:50.914893Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation d4382265-c318-4381-a0aa-5d712d6bf853 · inbound

Catalyst Papers in Artificial Intelligence Research: A Landscape on ICLR from 2017 to 2025 cites this paper.

Catalyst Papers in Artificial Intelligence Research: A Landscape on ICLR from 2017 to 2025 Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 26

Resolution: unresolved; no resolver link, observed 2026-07-12T16:04:50.429639Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c3336dab-856f-41a5-a803-f442ce07a5aa · inbound

Can AI agents conduct open-ended AI research? Early evidence from two case studies cites this paper.

Can AI agents conduct open-ended AI research? Early evidence from two case studies Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-07-30T10:56:35.059444Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2915af06-693b-4391-9ed0-ac2d77cdaca0 · inbound

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review cites this paper.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.846382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bbdaf93a-f21c-4585-ab17-fbb1cacc0f43 · inbound

ReVoicer: Conversational Voice Annotation for Human-Centered, LLM-Assisted Peer Review cites this paper.

ReVoicer: Conversational Voice Annotation for Human-Centered, LLM-Assisted Peer Review Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-04T00:49:01.524244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bee9df1e-ab13-43cc-b9d2-7f9920b8041d · inbound

ReVoicer: Conversational Voice Annotation for Human-Centered, LLM-Assisted Peer Review cites this paper.

ReVoicer: Conversational Voice Annotation for Human-Centered, LLM-Assisted Peer Review Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T04:15:20.355276Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6540a00a-e6de-44cb-99d2-4d1da50ab491 · inbound

A Vision for the Future of an AI-Integrated Research Ecosystem cites this paper.

A Vision for the Future of an AI-Integrated Research Ecosystem Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-08T13:05:38.312713Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.