Paper Citation Record · LEDGER

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review

As of 8 August 2026, this Paper Citation Record lists 31 of 31 outbound references and 0 inbound Pith citation observations for arXiv:2607.27209.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.27209 v1

Coverage vector

measured 31 of 31 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T15:15:45.954615Z

measured 31 of 31 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

31 of 31 outbound references displayed

verified exact0
verified fuzzy0
unresolved27
parse uncertain0
malformed identifier4
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 66fb758c-0d9e-4ffc-9fbd-ebc5fe67612e · outbound

This paper cites We obtain Λ = 341.2 , p= 5.1×10 −3.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review We obtain Λ = 341.2 , p= 5.1×10 −3

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.941466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a77bebf8-c0b9-4e06-81bb-5431eaefbf16 · outbound

This paper cites Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.837048Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 225771a6-f0b3-47f7-8701-d1dd67f67490 · outbound

This paper cites Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.850899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 59f82a07-7a9e-41d4-a6f7-ee97892f578d · outbound

This paper cites doi: 10.18653/v1/ N18-1149.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review doi: 10.18653/v1/ N18-1149

Reference 9

Resolution: malformed identifier; no resolver link, observed 2026-08-02T15:15:45.859643Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d5a24064-d7eb-44ee-9065-e7d889d50c2b · outbound

This paper cites Can large language models provide useful feedback on research papers? A large-scale empirical analysis.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Can large language models provide useful feedback on research papers? A large-scale empirical analysis

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.881309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1ce3e71-9886-420f-9983-66c7d1745e5d · outbound

This paper cites Neil Millar, Bojan Batalo, and Brian Budgell.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Neil Millar, Bojan Batalo, and Brian Budgell

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.889537Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0a88b73e-a8dd-4cf4-aa14-f9077186929f · outbound

This paper cites Joelle Pineau, Philippe Vincent-Lamarre, Koustuv Sinha, Vincent Larivière, Alina Beygelzimer, Flo- rence d’Alché Buc, Emily B.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Joelle Pineau, Philippe Vincent-Lamarre, Koustuv Sinha, Vincent Larivière, Alina Beygelzimer, Flo- rence d’Alché Buc, Emily B

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.894262Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ea4926a7-c33d-4e65-810c-eb6f93386daf · outbound

This paper cites doi: 10.18653/v1/2020.findings-emnlp.112.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review doi: 10.18653/v1/2020.findings-emnlp.112

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.902221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d01fe63d-26ed-475f-b996-ebfb2b830d3a · outbound

This paper cites Buxin Su, Jiayao Zhang, Natalie Collina, Yuling Yan, Didong Li, Kyunghyun Cho, Jianqing Fan, Aaron Roth, and Weijie J Su.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Buxin Su, Jiayao Zhang, Natalie Collina, Yuling Yan, Didong Li, Kyunghyun Cho, Jianqing Fan, Aaron Roth, and Weijie J Su

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.910673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f71fa99f-f580-437d-9c3e-bf0f953b4f3f · outbound

This paper cites arXiv:2408.13430.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review arXiv:2408.13430

Reference 22

Resolution: malformed identifier; no resolver link, observed 2026-08-02T15:15:45.915003Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a3669e08-68e9-48b6-8e8a-5ab1bb248921 · outbound

This paper cites an unresolved cited work.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.923662Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10791afb-b12c-4f61-85d3-45e23c24f27f · outbound

This paper cites 12 A Main Results Figures This appendix collects all figures referenced in the main text.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review 12 A Main Results Figures This appendix collects all figures referenced in the main text

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.931996Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e0f25186-02ee-4c0a-ba88-f5e9006ad717 · outbound

This paper cites auto” (directly from BERTopic keywords) or source=“override.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review auto” (directly from BERTopic keywords) or source=“override

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.946057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4c0c559a-2bb7-407a-ad96-ea462f23ad45 · outbound

This paper cites an unresolved cited work.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.950579Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c197f5c-e2bd-408a-a498-bde2ab12b527 · outbound

This paper cites novel”, “superior.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review novel”, “superior

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.954615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5e58c251-ce35-479a-9c27-21759464ad1b · outbound

This paper cites same score.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review same score

Reference 322

Resolution: malformed identifier; no resolver link, observed 2026-08-02T15:15:45.936543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 50f96f6a-e1a7-4eb3-bbe2-dc55c64cf540 · outbound

This paper cites org/CorpusID:121572396.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review org/CorpusID:121572396

Reference 1927

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.927747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a2c9a4b-b3e3-4eb7-9805-176ac717d5fd · outbound

This paper cites Amir Hossein Kargaran, Nafiseh Nikeghbal, Jing Yang, and Nedjma Djouhra Ousidhoum.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Amir Hossein Kargaran, Nafiseh Nikeghbal, Jing Yang, and Nedjma Djouhra Ousidhoum

Reference 1975

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.863826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8da1311c-48f1-44ab-bec0-440a2dea3da1 · outbound

This paper cites an unresolved cited work.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Unresolved cited work

Reference 2013

Resolution: malformed identifier; no resolver link, observed 2026-08-02T15:15:45.877210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a5191365-4bb2-4963-842b-c1c4f50f69f0 · outbound

This paper cites doi: 10.1145/2732417.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review doi: 10.1145/2732417

Reference 2015

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.873109Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 91171a7d-63ae-4c3e-8594-dad22579e43c · outbound

This paper cites Alina Beygelzimer, Yann N.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Alina Beygelzimer, Yann N

Reference 2016

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.832589Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20530eae-719f-44c8-a57e-eca9e5839c1a · outbound

This paper cites An Open Review of OpenReview: A Critical Analysis of the Machine Learning Conference Review Process.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review An Open Review of OpenReview: A Critical Analysis of the Machine Learning Conference Review Process

Reference 2017

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.919458Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7055a669-46d6-4e53-9abb-4f51f6eeec19 · outbound

This paper cites Corinna Cortes and Neil D.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Corinna Cortes and Neil D

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.841986Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4eaf6312-2f72-4c5d-b5bc-40f4ad7d9f73 · outbound

This paper cites doi: 10.1145/3316774.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review doi: 10.1145/3316774

Reference 2019

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.885477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc11ec61-c6e6-47ab-b442-73b243d7e1fe · outbound

This paper cites Anna Rogers and Isabelle Augenstein.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Anna Rogers and Isabelle Augenstein

Reference 2020

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.898344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2915af06-693b-4391-9ed0-ac2d77cdaca0 · outbound

This paper cites Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.846382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ef8c9dfd-329a-4879-b7a9-5f6b2dabbb88 · outbound

This paper cites 11 Ivan Stelmakh, Nihar B.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review 11 Ivan Stelmakh, Nihar B

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.906290Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3afdbd3d-6faa-4bcc-b99a-0ffecbb2f014 · outbound

This paper cites doi: 10.18653/v1/2023.acl-long.734.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review doi: 10.18653/v1/2023.acl-long.734

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.822170Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7cc05038-dd52-4b48-86a4-606412ad775c · outbound

This paper cites Publication Trends in Artificial Intelligence Conferences: The Rise of Super Prolific Authors.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Publication Trends in Artificial Intelligence Conferences: The Rise of Super Prolific Authors

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.827468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e253ae6-38a8-4bad-b59d-8b9e11f6cd38 · outbound

This paper cites Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.867941Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e69394d7-1c97-4832-a4c2-35c2b8933734 · outbound

This paper cites an unresolved cited work.

Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review Unresolved cited work

Reference 2026

Resolution: unresolved; no resolver link, observed 2026-08-02T15:15:45.855419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.