Paper Citation Record · LEDGER

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference

As of 16 August 2026, this Paper Citation Record lists 12 of 12 outbound references and 0 inbound Pith citation observations for arXiv:2501.00560.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.00560 v2

Coverage vector

measured 12 of 12 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T22:51:45.854198Z

measured 12 of 12 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

12 of 12 outbound references displayed

verified exact0
verified fuzzy2
unresolved9
parse uncertain1
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bd654b90-80ff-4576-92c1-9a81974aee74 · outbound

This paper cites an unresolved cited work.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-10T22:51:46.031621Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 7dbe37c6-a164-4350-b8d4-858adbb92a23 · outbound

This paper cites an unresolved cited work.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-10T22:51:46.017241Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation b29d9375-b0f4-444f-87dd-eeec607c2bc9 · outbound

This paper cites an unresolved cited work.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Unresolved cited work

Reference 3

Resolution: parse uncertain; raw_fallback, observed 2026-08-10T22:51:46.003326Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation b649136d-6675-48e7-bfe4-73cd6d1bb762 · outbound

This paper cites In Proceedings of the 18th Con- ference of the European Chapter of the Association for Computational Linguistics, EACL 2024 - Volume 1: Long Papers, St.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference In Proceedings of the 18th Con- ference of the European Chapter of the Association for Computational Linguistics, EACL 2024 - Volume 1: Long Papers, St

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T22:51:46.059595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 082c3b24-4b68-4219-8160-83facebafea4 · outbound

This paper cites MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-10T22:51:45.820775Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38645a52-7bed-43fe-806f-d945404d69b1 · outbound

This paper cites poor quality.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference poor quality

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T22:51:46.045190Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation d33d4cd8-361f-4452-9221-1ac1d36e1970 · outbound

This paper cites an unresolved cited work.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-10T22:51:45.988333Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 1ea2b6f3-5e1f-443a-b91f-1f5a23fc5fbf · outbound

This paper cites an unresolved cited work.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-10T22:51:45.974353Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 50be9836-8e8d-4c41-a469-89c5026fa4b9 · outbound

This paper cites Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat

Reference 1952

Resolution: unresolved; no resolver link, observed 2026-08-10T22:51:45.801126Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 74680828-3254-44c4-98b2-cb4ef5a4f344 · outbound

This paper cites Qwen2 Technical Report.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference Qwen2 Technical Report

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-10T22:51:45.825812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f29b4d73-98fa-4bda-8836-6a20f766ed5b · outbound

This paper cites RewardBench: Evaluating Reward Models for Language Modeling.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference RewardBench: Evaluating Reward Models for Language Modeling

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-10T22:51:45.811041Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 271d9820-784c-460e-abbd-2ffefc3299dd · outbound

This paper cites The Llama 3 Herd of Models.

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference The Llama 3 Herd of Models

Reference 6052

Resolution: unresolved; no resolver link, observed 2026-08-10T22:51:45.806392Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.