Pith. sign in

Paper Citation Record · LEDGER

Can We Use Large Language Models to Fill Relevance Judgment Holes?

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 10 inbound Pith citation observations for arXiv:2405.05600.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2405.05600 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 10 of 10 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 10 of 10 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:42:47.373137Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-16T14:22:59.155730Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 896e37bd-4420-440b-b58a-955634184988 · inbound

MedPAIR: Measuring Physicians and AI Relevance Alignment in Medical Question Answering cites this paper.

MedPAIR: Measuring Physicians and AI Relevance Alignment in Medical Question Answering Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T12:42:47.373137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T12:42:47.373137Z digest=sha256:91d9e6b2fd591275ae04ea9d7b6db15b9c0055f5d3c212fa08930f6d07977c30

Observation 32e5d81f-779f-43c0-828d-0c2eccee9b01 · inbound

Leveraging LLMs to Evaluate Usefulness of Document cites this paper.

Leveraging LLMs to Evaluate Usefulness of Document Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T05:11:38.203547Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T05:11:38.203547Z digest=sha256:7f047f753dfecb241806794fe910625df0424593f359f70cfcab314007c5ac80

Observation f6d2a5e3-6d9b-48e0-b5e0-1141a96a4997 · inbound

Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement cites this paper.

Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T22:11:48.297439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:11:48.297439Z digest=sha256:cf200047af2006dfa9b4a6805f1631de8ee34d7b37e243be35749ccb78059799

Observation d9ee5d5b-1a92-4d24-bd32-664317f39040 · inbound

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications cites this paper.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.629492Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.629492Z digest=sha256:cd9049b121e2efed4de1741a54ee366fbef3b835e1fa4919370e77c275484cdc

Observation 16667c40-3204-4412-9b6f-0b6354f2d896 · inbound

When LLMs Disagree: Diagnosing Relevance Filtering Bias and Retrieval Divergence in SDG Search cites this paper.

When LLMs Disagree: Diagnosing Relevance Filtering Bias and Retrieval Divergence in SDG Search Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T20:42:31.751568Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T20:42:31.751568Z digest=sha256:61327fd48eef80c09f2ca2834d50abdf95f1bd0efbef4c7d7e9dfa9e798254db

Observation 3d61a8f9-4c98-414f-a52b-df08af21d2a5 · inbound

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems cites this paper.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.899164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.899164Z digest=sha256:f4d890643d085e11af5b91dccd273f38fbcd0ecc8d9fe368ce64ae99bee130a5

Observation 4e55de38-3c98-46fa-bc43-2ca872946aeb · inbound

Criteria-Based LLM Relevance Judgments cites this paper.

Criteria-Based LLM Relevance Judgments Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T18:00:21.149269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:00:21.149269Z digest=sha256:85206c39ca3d16ed24bb0beab9e4614dfcb6b4f2c08d5888330cc0922db0572b

Observation dd2b07aa-6b26-439d-bb3f-761eb1037303 · inbound

LLMs as Assessors: Right for the Right Reason? cites this paper.

LLMs as Assessors: Right for the Right Reason? Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-16T14:22:59.158283Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-16T14:22:54.504927Z digest=sha256:df0a52190ad0b60302c874efc06b0a8ec562ee0062ef7fe86649b16d3dc67560

Observation 8acaeac9-154b-42eb-aa3b-5c99e54b00a8 · inbound

Hybrid Pooling with LLMs via Relevance Context Learning cites this paper.

Hybrid Pooling with LLMs via Relevance Context Learning Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-16T06:07:25.688182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-16T06:05:23.257866Z digest=sha256:9ee70264d5c1992dfb52cb00b65b7d6a47d400b1c0e9099f6a8658e2cac45d2b

Observation 70ecc1b3-0e4b-4d65-856b-96235429e614 · inbound

Advancing Relevance Measurement with Vision-Language Models for Web-Scale Search cites this paper.

Advancing Relevance Measurement with Vision-Language Models for Web-Scale Search Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-04T07:15:51.836938Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T07:15:51.836938Z digest=sha256:6f96f3904af6f8a166ac75e0ef8702a6c4e71b8c80831055fb7460bf5b329bc5