Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links
Paper Citation Record · LEDGER
The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
As of 15 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 15 inbound Pith citation observations for arXiv:2211.02570.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-12T15:58:47.600485Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Reference resolution
0 of 0 outbound references displayed
- verified exact0
- verified fuzzy0
- unresolved0
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
9
arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Outbound references
No outbound reference observations are available for this paper version.
Pith citing papers
Observation 8c67e5e5-81c0-44dc-87a4-d46a433706d4 · inbound
A Framework for Evaluating LLMs Under Task Indeterminacy cites this paper.
A Framework for Evaluating LLMs Under Task Indeterminacy The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 38
- Resolution
- unresolved
- no resolver link, observed 2026-08-12T15:58:47.600485Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1bf086a1-1473-4f05-926d-a886fe577d57 · inbound
Distilling Desired Comments for Enhanced Code Review with Large Language Models cites this paper.
Distilling Desired Comments for Enhanced Code Review with Large Language Models The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 16
- Resolution
- unresolved
- no resolver link, observed 2026-08-10T23:28:51.174753Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5416d00d-e426-43e3-b3f8-320805f1e9c1 · inbound
Wisdom of the Crowd, Without the Crowd: A Socratic LLM for Asynchronous Deliberation on Perspectivist Data cites this paper.
Wisdom of the Crowd, Without the Crowd: A Socratic LLM for Asynchronous Deliberation on Perspectivist Data The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 94
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T20:48:31.636739Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0fa68997-5ce4-4b6f-8542-71b4187c96c1 · inbound
From Ground Truth to Measurement: A Statistical Framework for Human Labeling cites this paper.
From Ground Truth to Measurement: A Statistical Framework for Human Labeling The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 17
- Resolution
- verified exact
- arxiv_id, observed 2026-05-11T07:30:58.105755Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 082b2c00-2958-421e-af5e-7efc05c3b16d · inbound
Calibrating Model-Based Evaluation Metrics for Summarization cites this paper.
Calibrating Model-Based Evaluation Metrics for Summarization The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 126
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-10T06:41:36.962031Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 94e7bd5a-5166-423b-bed9-6b76fe16a62f · inbound
Who Watches the Watchmen? Humans Disagree With Translation Metrics on Unseen Domains cites this paper.
Who Watches the Watchmen? Humans Disagree With Translation Metrics on Unseen Domains The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 13
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-10T06:11:20.415010Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 7efcb0a0-acb5-42e7-a697-a67d3e0b8635 · inbound
Whose Story Gets Told? Positionality and Bias in LLM Summaries of Life Narratives cites this paper.
Whose Story Gets Told? Positionality and Bias in LLM Summaries of Life Narratives The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 156
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-10T01:04:50.346979Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 47ff62d8-ad8e-4cfb-b728-52e595b2081b · inbound
Implicit Humanization in Everyday LLM Moral Judgments cites this paper.
Implicit Humanization in Everyday LLM Moral Judgments The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 37
- Resolution
- verified exact
- arxiv_id, observed 2026-05-15T01:33:27.040591Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation bf0915ce-acc6-47db-8b54-6e7662f2b70e · inbound
Learning from Disagreement: Clinician Overrides as Implicit Preference Signals for Clinical AI in Value-Based Care cites this paper.
Learning from Disagreement: Clinician Overrides as Implicit Preference Signals for Clinical AI in Value-Based Care The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 17
- Resolution
- verified exact
- arxiv_id, observed 2026-05-12T10:21:30.292855Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 886f22dd-80e6-4b9d-8185-d02c52672c0e · inbound
Learning from Disagreement: Clinician Overrides as Implicit Preference Signals for Clinical AI in Value-Based Care cites this paper.
Learning from Disagreement: Clinician Overrides as Implicit Preference Signals for Clinical AI in Value-Based Care The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 17
- Resolution
- verified exact
- arxiv_id, observed 2026-05-20T23:43:50.993092Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 75ed9390-ce68-49ba-87bd-f26dc01b1ed2 · inbound
Understanding Annotator Safety Policy with Interpretability cites this paper.
Understanding Annotator Safety Policy with Interpretability The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 57
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-11T17:21:08.646818Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 44b4c975-f7f9-4550-86d7-a382cfadb2cf · inbound
Does Capability Transfer to Subjective Behavior -- and Would Our Instruments Tell Us? A Self-Evolving, Trust-by-Construction Evaluation Paradigm cites this paper.
Does Capability Transfer to Subjective Behavior -- and Would Our Instruments Tell Us? A Self-Evolving, Trust-by-Construction Evaluation Paradigm The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 91
- Resolution
- verified exact
- arxiv_id, observed 2026-06-29T13:03:26.721572Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation ff4b7409-52b7-4ac0-adb5-2a6f3ea2ea1b · inbound
Personal Salience: Highlighting Is Social, but Individuality Lives in Selection cites this paper.
Personal Salience: Highlighting Is Social, but Individuality Lives in Selection The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 5
- Resolution
- verified exact
- arxiv_id, observed 2026-07-03T03:37:35.845268Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 4b5dfbf5-c4b8-4c25-856f-2b6c9bc730de · inbound
Factions Within, Uncertain Across: Within-Document Reader Sub-Groups in Social Highlighting cites this paper.
Factions Within, Uncertain Across: Within-Document Reader Sub-Groups in Social Highlighting The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 5
- Resolution
- verified exact
- arxiv_id, observed 2026-07-03T13:08:07.843654Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 9a926d8a-a2b9-4a7c-b19d-38c8417df219 · inbound
Exposure is not manifestation: measurement target and output resolution jointly determine which behavioural-faithfulness evaluator wins cites this paper.
Exposure is not manifestation: measurement target and output resolution jointly determine which behavioural-faithfulness evaluator wins The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
Reference 27
- Resolution
- unresolved
- no resolver link, observed 2026-08-02T07:44:05.241524Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.