Paper Citation Record · LEDGER

Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 29 inbound Pith citation observations for arXiv:2103.14749.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2103.14749 v4

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 29 of 29 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 29 of 29 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-09T04:45:34.602333Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T08:49:41.632097Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation ae4bee83-4dc3-49df-9e32-52238d2e61be · inbound

Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications cites this paper.

Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 15

Resolution: verified exact; arxiv_id, observed 2026-05-24T01:08:41.948583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation cb113683-04c4-4100-9fa5-7dcd2199b93e · inbound

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI cites this paper.

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 17

Resolution: metadata mismatch; arxiv_id, observed 2026-05-17T00:44:01.690041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 05fdc43a-0a68-41be-aaad-864ab2683443 · inbound

Do Large Language Model Benchmarks Test Reliability? cites this paper.

Do Large Language Model Benchmarks Test Reliability? Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-09T04:45:34.602333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 906ea888-465e-4af4-a526-fd00a2f4b67d · inbound

Network Intrusion Datasets: A Survey, Limitations, and Recommendations cites this paper.

Network Intrusion Datasets: A Survey, Limitations, and Recommendations Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 158

Resolution: unresolved; no resolver link, observed 2026-08-08T14:44:41.854110Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8b001dc8-5ec3-459b-acf6-207481d05d37 · inbound

TMLC-Net: Transferable Meta Label Correction for Noisy Label Learning cites this paper.

TMLC-Net: Transferable Meta Label Correction for Noisy Label Learning Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-08T11:50:06.274969Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 62238fca-fcb3-4dbc-b782-a8949f7f8a78 · inbound

ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models cites this paper.

ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T20:55:05.895061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6564c559-b69d-4101-bf50-bc41bfde0b53 · inbound

The Achilles Heel of AI: Fundamentals of Risk-Aware Training Data for High-Consequence Models cites this paper.

The Achilles Heel of AI: Fundamentals of Risk-Aware Training Data for High-Consequence Models Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-07T15:29:34.923297Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 44cd219f-29c8-47d5-bc64-9c0ee8395bae · inbound

When VLMs Meet Image Classification: Test Sets Renovation via Missing Label Identification cites this paper.

When VLMs Meet Image Classification: Test Sets Renovation via Missing Label Identification Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T15:10:10.178439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c983470c-c349-46e1-9e9a-ff4b00faa454 · inbound

Machine Unlearning for Robust DNNs: Attribution-Guided Partitioning and Neuron Pruning in Noisy Environments cites this paper.

Machine Unlearning for Robust DNNs: Attribution-Guided Partitioning and Neuron Pruning in Noisy Environments Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-07T04:10:33.552063Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d581c8ac-9371-4066-90de-ec9b09c9c99f · inbound

GFLC: Graph-based Fairness-aware Label Correction for Fair Classification cites this paper.

GFLC: Graph-based Fairness-aware Label Correction for Fair Classification Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 9984

Resolution: unresolved; no resolver link, observed 2026-08-07T00:00:21.325181Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e61dbde6-c28c-4c7c-8d89-c116a8b5d06c · inbound

First-of-its-kind AI model for bioacoustic detection using a lightweight associative memory Hopfield neural network cites this paper.

First-of-its-kind AI model for bioacoustic detection using a lightweight associative memory Hopfield neural network Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-06T17:40:19.810351Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 735d93c6-57d2-4076-b1c0-99856465a8ed · inbound

Multimodal-Guided Dynamic Dataset Pruning for Robust and Efficient Data-Centric Learning cites this paper.

Multimodal-Guided Dynamic Dataset Pruning for Robust and Efficient Data-Centric Learning Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T16:45:02.589586Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4b3f88df-eb48-4c24-9b32-10475d3c1ecf · inbound

Advancing Mental Disorder Detection: A Comparative Evaluation of Transformer and LSTM Architectures on Social Media cites this paper.

Advancing Mental Disorder Detection: A Comparative Evaluation of Transformer and LSTM Architectures on Social Media Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-06T16:43:46.776213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1c85b76-e1e6-4e7f-b84f-3a570739fec6 · inbound

Image Recognition with Vision and Language Embeddings of VLMs cites this paper.

Image Recognition with Vision and Language Embeddings of VLMs Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-04T19:24:21.475663Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cdd606df-3baf-4f78-9f09-0af27a748c93 · inbound

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning cites this paper.

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 17

Resolution: metadata mismatch; arxiv_id, observed 2026-05-18T01:20:34.418769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 538af51a-99cf-4371-af49-aea48be821c7 · inbound

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning cites this paper.

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 1999

Resolution: unresolved; no resolver link, observed 2026-08-04T00:11:51.702024Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 94067a78-7cdd-491b-b535-394938cf65af · inbound

PaTAS: A Framework for Trust Propagation in Neural Networks Using Subjective Logic cites this paper.

PaTAS: A Framework for Trust Propagation in Neural Networks Using Subjective Logic Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-03T20:19:44.099592Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7db6f62e-1de8-4d6d-b77a-8e2f1417505b · inbound

Representation Unlearning: Forgetting through Information Compression cites this paper.

Representation Unlearning: Forgetting through Information Compression Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-03T06:59:18.572514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 120e7793-8c65-47a7-8bf5-281f9c6479f3 · inbound

Noise is not always detrimental: the capacity of quantum batteries is enhanced in black holes cites this paper.

Noise is not always detrimental: the capacity of quantum batteries is enhanced in black holes Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 36

Resolution: unresolved; no resolver link, observed 2026-07-13T09:29:29.046109Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 333fe779-501d-49ee-81fd-ba6230820886 · inbound

Semantic Trimming and Auxiliary Multi-step Prediction for Generative Recommendation cites this paper.

Semantic Trimming and Auxiliary Multi-step Prediction for Generative Recommendation Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 36

Resolution: verified exact; arxiv_id, observed 2026-05-10T22:30:50.716942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 04d406b2-0b06-452c-a1cb-0acbbca4b45b · inbound

Beyond Black-Box Labels: Interpretable Criteria for Diagnosing Subjective NLP Tasks cites this paper.

Beyond Black-Box Labels: Interpretable Criteria for Diagnosing Subjective NLP Tasks Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 2

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T06:41:36.875706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation a803ab18-8460-41a3-a06e-4bb99044d7c9 · inbound

Evaluation Revisited: A Taxonomy of Evaluation Concerns in Natural Language Processing cites this paper.

Evaluation Revisited: A Taxonomy of Evaluation Concerns in Natural Language Processing Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 21

Resolution: metadata mismatch; arxiv_id, observed 2026-05-13T22:53:23.358641Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d085801d-28cc-4707-abe8-e8ab6d8f6c1c · inbound

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks cites this paper.

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 51

Resolution: metadata mismatch; arxiv_id, observed 2026-06-29T16:33:39.671679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ce9465aa-659b-456a-a37c-3c98149b61e3 · inbound

Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets cites this paper.

Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 7

Resolution: verified exact; arxiv_id, observed 2026-06-29T08:53:16.473620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b4ed5274-eeda-4b73-b64c-57ed3b2d434b · inbound

Learning to Annotate Delayed and False AEB Events: A Practical System for Extreme Class Imbalance and Asymmetric Label Noise cites this paper.

Learning to Annotate Delayed and False AEB Events: A Practical System for Extreme Class Imbalance and Asymmetric Label Noise Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 23

Resolution: metadata mismatch; arxiv_id, observed 2026-07-04T01:09:19.667230Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3796f0b2-e934-442e-a549-4c610d763e0f · inbound

MMGist: A Comprehensive Multimodal Benchmark for 2027 cites this paper.

MMGist: A Comprehensive Multimodal Benchmark for 2027 Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 5

Resolution: metadata mismatch; arxiv_id, observed 2026-07-04T08:49:41.633870Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c8e8a57a-9880-4be8-9c03-8b7aa0cb71ca · inbound

A Novel Method to Evaluate Models on Unreliable, Noisy and Inconsistent Labels: Adaptive Resolution Label Aggregation (ARLA) cites this paper.

A Novel Method to Evaluate Models on Unreliable, Noisy and Inconsistent Labels: Adaptive Resolution Label Aggregation (ARLA) Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 19

Resolution: unresolved; no resolver link, observed 2026-07-14T06:14:56.071808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d3000d0-13a7-4bfb-8455-5a40d5cdd5d4 · inbound

BACON: Budgeted Human Calibration for Modeling and Evaluation with Multiple AI Judges cites this paper.

BACON: Budgeted Human Calibration for Modeling and Evaluation with Multiple AI Judges Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-02T10:02:37.001079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f2a424e3-bfad-492c-af98-d2b9780de8c4 · inbound

Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings cites this paper.

Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 107

Resolution: unresolved; no resolver link, observed 2026-08-01T06:18:10.049087Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.