Paper Citation Record · LEDGER

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales

As of 14 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 2 inbound Pith citation observations for arXiv:2505.19334.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.19334 v1

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:20:44.729615Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T16:31:22.105667Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

22 of 22 outbound references displayed

verified exact1
verified fuzzy9
unresolved12
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation bada98a4-26da-4719-bf34-e27e754a2f3a · outbound

This paper cites Claude 3.5 Sonnet Model Card Addendum.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Claude 3.5 Sonnet Model Card Addendum

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:47.074489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation a7e99f5b-3825-433d-9e15-ae2717cf36b0 · outbound

This paper cites TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:43.365116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c70c0681-baf4-466b-88a4-eaa96bf3038b · outbound

This paper cites Craswell, B.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Craswell, B

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:46.878523Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 98104382-54a6-464f-a0af-d00988a313a0 · outbound

This paper cites Craswell, B.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Craswell, B

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:46.600984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 95af5f82-6eef-4610-b38d-3e62bf379b10 · outbound

This paper cites MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:43.713978Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 875f5bb0-3f32-4c8c-abc4-8db628ac6ef6 · outbound

This paper cites Khramtsova, S.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Khramtsova, S

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:46.355807Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 0f74e242-1fc5-4b9d-b5b2-dd32b4a37677 · outbound

This paper cites an unresolved cited work.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-07T14:20:46.203577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 417c438b-2225-4df3-8dc7-2f3a5219f234 · outbound

This paper cites an unresolved cited work.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-07T14:20:46.060560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 347308fe-c2db-4d8a-a3ca-514341f0eb9f · outbound

This paper cites Zero-Shot Listwise Document Reranking with a Large Language Model.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Zero-Shot Listwise Document Reranking with a Large Language Model

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:43.998472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f845e4f-5961-45f0-a7be-6d3082821b2b · outbound

This paper cites A Closer Look at AUROC and AUPRC under Class Imbalance.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales A Closer Look at AUROC and AUPRC under Class Imbalance

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:44.037920Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 11ef16ee-6b4f-4cb6-b5a3-c2fb5d0200dc · outbound

This paper cites DIRAS: Efficient LLM Annotation of Document Relevance in Retrieval Augmented Generation.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales DIRAS: Efficient LLM Annotation of Document Relevance in Retrieval Augmented Generation

Reference 11

Resolution: verified exact; local_arxiv, observed 2026-08-07T14:20:44.930574Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 947c7355-6292-40e5-9ea9-791044a2ace9 · outbound

This paper cites Re-Ranking Step by Step: Investigating Pre-Filtering for Re-Ranking with Large Language Models.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Re-Ranking Step by Step: Investigating Pre-Filtering for Re-Ranking with Large Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:44.222237Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 26d336fa-bc04-4a18-bb84-a8349a6a2e92 · outbound

This paper cites Oosterhuis, R.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Oosterhuis, R

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:45.941440Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation e7daa9bc-33de-49f5-b456-a87dd4de1d91 · outbound

This paper cites GPT-4o System Card.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales GPT-4o System Card

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:45.798623Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 62645983-975a-4984-ad6c-d9d52f1bcc00 · outbound

This paper cites Top-Down Partitioning for Efficient List-Wise Ranking.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Top-Down Partitioning for Efficient List-Wise Ranking

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:44.321000Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2834ec7f-0e32-402f-8736-a0de769bd237 · outbound

This paper cites Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:44.377649Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 51bc969d-4237-4c69-857e-7952fb9305b4 · outbound

This paper cites Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T14:20:44.450158Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20f4ed25-deba-468e-9475-30ad7e9160b5 · outbound

This paper cites an unresolved cited work.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-07T14:20:45.673661Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation f3010cad-cff4-4214-8976-6294b24aef16 · outbound

This paper cites an unresolved cited work.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-08-07T14:20:45.535064Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 23c17904-e2fe-4073-afdb-0126c87f7873 · outbound

This paper cites Thakur, N.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Thakur, N

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:45.394069Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 23929802-d690-4c45-bfdb-de3f9d91e81c · outbound

This paper cites Zhuang, Z.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Zhuang, Z

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:45.203104Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 13d6bbaa-ec8b-43e2-a637-4eb91300a2be · outbound

This paper cites Zhuang, H.

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales Zhuang, H

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:20:45.086966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Pith citing papers

Observation ab59bb61-5108-4003-b851-317da5fac6f6 · inbound

Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAG cites this paper.

Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAG Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-04T16:31:22.105667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 60d6611d-80e7-4075-bdc7-7f1a931e4b2c · inbound

LLM-Guided Monte Carlo Tree Search over Knowledge Graphs: Composing Mechanistic Explanations for Drug-Disease Pairs cites this paper.

LLM-Guided Monte Carlo Tree Search over Knowledge Graphs: Composing Mechanistic Explanations for Drug-Disease Pairs Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-12T03:06:18.257975Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.