Paper Citation Record · LEDGER

Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 11 inbound Pith citation observations for arXiv:2402.03927.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2402.03927 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T16:26:32.043593Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

18
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation aa10e7b4-9a06-4dc0-b1da-7b7e75627246 · inbound

LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks cites this paper.

LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-08T16:26:32.043593Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 921a5f53-8fbf-46ae-bcb6-104c57184294 · inbound

AIMS.au: A Dataset for the Analysis of Modern Slavery Countermeasures in Corporate Statements cites this paper.

AIMS.au: A Dataset for the Analysis of Modern Slavery Countermeasures in Corporate Statements Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-08T14:04:30.135125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ddc01214-47f7-460b-9fbd-5013d2f2b2e6 · inbound

Emergent LLM behaviors are observationally equivalent to data leakage cites this paper.

Emergent LLM behaviors are observationally equivalent to data leakage Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T14:05:14.101878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 75c04252-af6e-42d3-a26c-52a51f0b002d · inbound

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning cites this paper.

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 2

Resolution: verified exact; arxiv_id, observed 2026-05-18T01:20:34.441271Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 062d1044-d54a-40c0-a1ca-11441b92821b · inbound

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning cites this paper.

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-08-04T00:11:50.195992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b55e2365-36b5-4ea6-90cc-8c6fa82d3493 · inbound

Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation cites this paper.

Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-03T03:04:43.114913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bfaa887b-ade1-4646-a0a7-6f870dfecc1a · inbound

Strengthening Human-Centric Chain-of-Thought Reasoning Integrity in LLMs via a Structured Prompt Framework cites this paper.

Strengthening Human-Centric Chain-of-Thought Reasoning Integrity in LLMs via a Structured Prompt Framework Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 14

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T18:55:44.564388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 25c2bb43-9552-4f13-828e-94a4ddb9dc64 · inbound

Interactive Evaluation Requires a Design Science cites this paper.

Interactive Evaluation Requires a Design Science Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-20T10:58:14.113824Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 4419564c-2605-4cd4-bf4d-3f18199ce9b6 · inbound

Pretraining Data Exposure in Large Language Models: A Survey of Membership Inference, Data Contamination, and Security Implications cites this paper.

Pretraining Data Exposure in Large Language Models: A Survey of Membership Inference, Data Contamination, and Security Implications Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 2

Resolution: metadata mismatch; arxiv_id, observed 2026-06-30T17:24:56.552879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation e555ed24-e24f-4bbe-9cde-1e3c834064bc · inbound

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection cites this paper.

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs

Reference 2

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T03:36:30.289844Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation bbf8c6c6-a404-471a-bc98-cb11d8e6cc14 · inbound

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection cites this paper.

Reference 2

Resolution: metadata mismatch; arxiv_id, observed 2026-07-04T00:39:16.467562Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.