Paper Citation Record · LEDGER

What Do Machine Learning Researchers Mean by "Reproducible"?

As of 19 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 0 inbound Pith citation observations for arXiv:2412.03854.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.03854 v1

Coverage vector

measured 13 of 13 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T22:05:53.920212Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

13 of 13 outbound references displayed

verified exact2
verified fuzzy2
unresolved7
parse uncertain0
malformed identifier1
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 487f5e55-1aab-4db4-9201-dac7ec187504 · outbound

This paper cites Code Smells in Machine Learning Systems.

What Do Machine Learning Researchers Mean by "Reproducible"? Code Smells in Machine Learning Systems

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-11T22:05:53.894301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0000210-c02d-475d-9cf3-0300a8d61e12 · outbound

This paper cites an unresolved cited work.

What Do Machine Learning Researchers Mean by "Reproducible"? Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-11T22:05:54.188169Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation d14a39b1-92d4-429e-ada4-92c0d9ce4449 · outbound

This paper cites Towards a Rigorous Evaluation of Time-series Anomaly Detection.

What Do Machine Learning Researchers Mean by "Reproducible"? Towards a Rigorous Evaluation of Time-series Anomaly Detection

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-11T22:05:53.903223Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 904c5b88-49f9-4a7b-8d0e-8caa768551fe · outbound

This paper cites Understanding deep learning requires rethinking generalization.

What Do Machine Learning Researchers Mean by "Reproducible"? Understanding deep learning requires rethinking generalization

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-11T22:05:53.920212Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 477e324a-8a9e-4079-88ed-2a9dc3723ae8 · outbound

This paper cites Global Ecology and Biogeography , 17(2): 145–151.

What Do Machine Learning Researchers Mean by "Reproducible"? Global Ecology and Biogeography , 17(2): 145–151

Reference 2008

Resolution: malformed identifier; no resolver link, observed 2026-08-11T22:05:53.911795Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d0f96e5-ca8d-4961-a042-913c4bcd8a71 · outbound

This paper cites HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO.

What Do Machine Learning Researchers Mean by "Reproducible"? HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO

Reference 2017

Resolution: unresolved; no resolver link, observed 2026-08-11T22:05:53.884166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe24bc3f-0c00-4cc9-8043-5030859a57a5 · outbound

This paper cites Is rotation forest the best classifier for problems with continuous features?.

What Do Machine Learning Researchers Mean by "Reproducible"? Is rotation forest the best classifier for problems with continuous features?

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-08-11T22:05:53.865703Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1363cf5d-13de-49c7-a885-552f6f5112bb · outbound

This paper cites On the Replicability and Reproducibility of Deep Learning in Software Engineering.

What Do Machine Learning Researchers Mean by "Reproducible"? On the Replicability and Reproducibility of Deep Learning in Software Engineering

Reference 2020

Resolution: verified exact; local_arxiv, observed 2026-08-11T22:05:54.067551Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1f2ed059-e799-4dcf-8620-08ee585627b9 · outbound

This paper cites In Proceedings of the 45th In- ternational ACM SIGIR Conference on Research and De- velopment in Information Retrieval , SIGIR ’22, 2790–2800.

What Do Machine Learning Researchers Mean by "Reproducible"? In Proceedings of the 45th In- ternational ACM SIGIR Conference on Research and De- velopment in Information Retrieval , SIGIR ’22, 2790–2800

Reference 2022

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T22:05:54.174905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 20279a08-b301-40f1-ae1d-1b874c149817 · outbound

This paper cites Hyperparameter Optimization Is Deceiving Us, and How to Stop It.

What Do Machine Learning Researchers Mean by "Reproducible"? Hyperparameter Optimization Is Deceiving Us, and How to Stop It

Reference 2023

Resolution: verified exact; local_arxiv, observed 2026-08-11T22:05:54.148294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 61ab5c37-316e-4b16-9ece-191a5c0d1500 · outbound

This paper cites In Proceedings of the 2nd ACM Conference on Reproducibility and Replicability, ACM REP ’24, 36–45.

What Do Machine Learning Researchers Mean by "Reproducible"? In Proceedings of the 2nd ACM Conference on Reproducibility and Replicability, ACM REP ’24, 36–45

Reference 2024

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T22:05:54.201139Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation db1b821f-6747-4aad-a775-4d9f74fdbb89 · outbound

This paper cites Show Your Work: Improved Reporting of Experimental Results.

What Do Machine Learning Researchers Mean by "Reproducible"? Show Your Work: Improved Reporting of Experimental Results

Reference 2194

Resolution: unresolved; no resolver link, observed 2026-08-11T22:05:53.879583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 37c3d6e8-ec3c-437e-9613-5d1d819291bc · outbound

This paper cites Learning with Holographic Reduced Representations.

What Do Machine Learning Researchers Mean by "Reproducible"? Learning with Holographic Reduced Representations

Reference 2932

Resolution: metadata mismatch; local_arxiv, observed 2026-08-11T22:05:54.108465Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Pith citing papers

No inbound Pith citation observations are available.