Pith. sign in

Paper Citation Record · LEDGER

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews

As of 11 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 1 inbound Pith citation observation for arXiv:2604.19502.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.19502 v2

Coverage vector

measured 27 of 27 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-11T11:50:26.030339Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T04:52:00.834543Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

27 of 27 outbound references displayed

  • verified exact1
  • verified fuzzy13
  • unresolved12
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 3442dd42-0843-4151-988f-701da98869ba · outbound

This paper cites OpenAI GPT-5 System Card.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews OpenAI GPT-5 System Card

Reference 1

Resolution
metadata mismatch
local_arxiv, observed 2026-05-10T02:11:56.973494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-07-11T11:50:26.030339Z digest=sha256:486527f1b0d73d83e8d9c8fec885d004159b30627fc49a3593239981d20f97fb

Observation 076bbd1f-ebf3-41e6-9e75-b590639385b7 · outbound

This paper cites Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-11T13:11:23.496191Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:3827855a0a1fed9c85e8c7b0c3d08fc8eb875fb88715821e3966f6d0572b5468

Observation ee13770a-8d63-4782-97f3-c2a4e48368c9 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.568298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:47aa8aae734981f61ed2db52f17aef9e70f5330131d84c58a4ee1e64c20e00f4

Observation 4b3e876f-9359-4a1b-a731-bbeda4b458ff · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.540517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:5fc03eca8e0074ef26c8c259a9f095f7d55ed53aa25f6ee852b5760ba9c00f0f

Observation 7e49d690-278e-41e3-8ce7-a32c9c8f89a6 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.570725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:f8b4340d089874f0d785fff06b0d305927951a2545ea6b1b89f067c1188f66e0

Observation a912e0ea-9024-4376-85aa-b6961b7a0acf · outbound

This paper cites Output JSON: {.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Output JSON: {

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.536250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:484295a4e422cb6b3fb9aa45a3ace0511b29420e9ecc850ce5d0dbc30a9a77c7

Observation 31b8d70a-7bc8-4dc7-a0f3-2526a9429094 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.521540Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:cf7e8e9368d16b1007f4377b9fca6108e267b3ebc14099949fb3893aa80956de

Observation 59822e2a-08f1-4edb-bb96-d512793a28fa · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.547734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:7c256e34347a0fd9b8f69374cb4deaaaecf6c939a05158f2c56a5fa3d17d5759

Observation 9170e825-c9de-4b5e-a789-b1868db9a046 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.575110Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:be0a521cde8019d60f7ef2e7838319f67edd0f44e62a43aaf9c7f48e4c8bc02a

Observation 55b5af7e-29bd-4c76-ae53-b317446f7a1f · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.545217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:9042749c8e26f10b1cb5d28383117747dcdd518239acd69ff7efd77df7872ca6

Observation 12b1b725-00e7-4025-a685-c33f1a2959ef · outbound

This paper cites Output JSON: {.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Output JSON: {

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.528875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:63b34c65acfb58ad80fca5d333569c5e6616fb4c1871a20d4120c530ba7a0284

Observation 2ebba881-0d60-47df-986f-c587ee6dee21 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.552816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:8a7e4a686ede9e4fb4016983709652cb8987a5258bc89ae1ce1421fd1b5ad416

Observation 45a10b5d-8f2b-49d3-84e5-ceddf8b199dd · outbound

This paper cites yes" only if they describe the same point; loosely related or overlapping topics are.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews yes" only if they describe the same point; loosely related or overlapping topics are

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.556970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:1e178cf1f8224b621e9d88e16e8be358eceacd4f036f831478ca9fb35965bf1a

Observation 6cbce760-c54a-427f-acce-197eb1286e6c · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.554755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:fb708d3a3c73dac8ad8521e4fa2d08bb9c19b42daf7f06647a08d6f0ae7f6930

Observation 64e31fab-a975-439c-a415-8f06f48a773d · outbound

This paper cites why" or.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews why" or

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.524045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:598c7211bd10650cbeb477755f110cc7f45f3b10784503d21fad8d1bc8356278

Observation cdf8a53a-3020-4fc4-bee8-923df89288b5 · outbound

This paper cites yes". - **Assign.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews yes". - **Assign

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.561516Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:8bead736a1452e8ac12811ecdd99b1270ee9502a94d96227f3675bb28c1c94a3

Observation 1c14f27c-be88-4128-a2f0-568a45e8429c · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.531339Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:d22c3023799b6d854485be70cba1f19b9fbd7681e7756fabba0842d2d51bb02a

Observation fc3ac65e-fb1b-449f-9fb3-82435aec043d · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.566077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:baba6c241ffe80ad588173f9bc11e609687f286a0a925309f8b1abad07988ff3

Observation 92d021d5-8389-41be-ae4c-1b8644ba1bd9 · outbound

This paper cites yes" for keyword matches alone; the explanatory intent must be satisfied. 29 Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews # Output Format {{.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews yes" for keyword matches alone; the explanatory intent must be satisfied. 29 Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews # Output Format {{

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.563879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:3762ab71522f98b3465c31de27dd7f010b5abad81162d5b9f2c8da62410697c3

Observation 5fd12722-8c61-430b-b8b4-d498dd913593 · outbound

This paper cites This category captures assessments of whether the work introduces new ideas, methods, or perspectives that advance the field.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category captures assessments of whether the work introduces new ideas, methods, or perspectives that advance the field

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.519305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:ef690de52315132fd82106db8dd6f13f79e6372b7e977b15feffdaacec7a870c

Observation 1087915b-8e0a-4ffc-b21c-7aed34f25027 · outbound

This paper cites This includes assessments of mathemati- cal rigor, logical consistency, and methodological validity.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This includes assessments of mathemati- cal rigor, logical consistency, and methodological validity

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.550549Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:cd883415aac09d9d3bbc98cd4f4c74c82179c0a6afbc82eebe21fa50a7845424

Observation e64ccbe9-994e-429f-9fb9-ca95b9673e5e · outbound

This paper cites This category includes evaluations of experimental setup, data quality, statistical analysis, and result interpretation.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category includes evaluations of experimental setup, data quality, statistical analysis, and result interpretation

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.559250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:2fe8045f5b9f3f5b222f949c8aac18cf8f6187b021fc731b91184c5a45ab1aa0

Observation 17a5e7a1-9c57-4c7f-9fee-86f006a12aa6 · outbound

This paper cites This includes assessments of paper organization, writing clarity, figure quality, and overall presentation effectiveness.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This includes assessments of paper organization, writing clarity, figure quality, and overall presentation effectiveness

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.534144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:9a477e889f6aa576513d0d4e7f772760752e685a3ea51cade9ae498b8481add7

Observation e9510c24-a87b-4d54-be0d-68f683ac517d · outbound

This paper cites This category captures evaluations of the work’s importance, potential applications, and contribution to the field.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category captures evaluations of the work’s importance, potential applications, and contribution to the field

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.542946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:f2a0100faf409c10d9e95a665190e1e1f688af45a30f7cc4407401b869af44a9

Observation b00b8b82-98cc-4af3-af38-8809600f2f38 · outbound

This paper cites This includes assessments of whether sufficient information is provided for reproducing the results, code availability, and parameter documentation.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This includes assessments of whether sufficient information is provided for reproducing the results, code availability, and parameter documentation

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.573102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:8b4fd8cb7b03e83c3090269edc5168aa59b6f96c31a92e4a5fb2fe97fea649f7

Observation 22c692aa-3588-4559-9e16-27a454011c07 · outbound

This paper cites This category includes assessments of whether relevant prior work is properly cited and discussed, and whether the work is properly positioned within the existing literature.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category includes assessments of whether relevant prior work is properly cited and discussed, and whether the work is properly positioned within the existing literature

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.526529Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:66dfd131954c426b3d2d3b28e6e853acdafd16c4b82efa113a3d486e2f95af12

Observation 35b4eed7-7731-453c-bfa4-0f4b1b181321 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.538229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:e5e3b740e3a84e802c445dd4844d6c4eb16d84c99363935104b4d6c7f653b660

Pith citing papers

Observation eb520d27-456e-4a95-9e39-2d11f7f5683b · inbound

RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review cites this paper.

RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-04T04:52:00.834543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T04:52:00.834543Z digest=sha256:d6dcfe443990d3121a5f7f0787180382fa2f273442af61b290117f6277904813