Paper Citation Record · LEDGER

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores

As of 19 August 2026, this Paper Citation Record lists 38 of 38 outbound references and 0 inbound Pith citation observations for arXiv:2608.02985.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.02985 v1

Coverage vector

measured 38 of 38 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T04:31:04.475518Z

measured 38 of 38 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

38 of 38 outbound references displayed

verified exact1
verified fuzzy11
unresolved25
parse uncertain0
malformed identifier0
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation aa84cace-faa1-4012-bd2f-d475aca4e98c · outbound

This paper cites Look-ahead-bench: A standardized benchmark of look-ahead bias in point-in-time LLMs for finance.arXiv preprint arXiv:2601.13770,.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Look-ahead-bench: A standardized benchmark of look-ahead bias in point-in-time LLMs for finance.arXiv preprint arXiv:2601.13770,

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.345601Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6eff41d-17eb-4136-a1c6-7c3725515f50 · outbound

This paper cites an unresolved cited work.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-08T04:31:05.033066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2578518a-f8ae-4224-b19e-e50c39d6686a · outbound

This paper cites an unresolved cited work.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-08T04:31:04.978959Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b21ca94e-9c29-49a0-85fc-b6201c56ca47 · outbound

This paper cites an unresolved cited work.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-08T04:31:05.090136Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 57e002fd-a558-4c7a-acf4-fe54ebfd2a4b · outbound

This paper cites Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.364840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 88949916-c22c-436b-aa7b-4bae0dce7452 · outbound

This paper cites Table 4 is the map: each theoretical claim of Sections 3 to 5 and the experiment whose headline result carries it.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Table 4 is the map: each theoretical claim of Sections 3 to 5 and the experiment whose headline result carries it

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.072640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 62b7d53d-17d2-42c7-90eb-eefe20d0813a · outbound

This paper cites Summoning the Oracle to Slay It: Mitigating Look-Ahead Bias in Financial Backtesting with Large Language Models.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Summoning the Oracle to Slay It: Mitigating Look-Ahead Bias in Financial Backtesting with Large Language Models

Reference 9

Resolution: verified exact; local_arxiv, observed 2026-08-08T04:31:04.780051Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 34e6a539-1707-4c8c-83d1-cb68f3072666 · outbound

This paper cites ExAnte: A Benchmark for Ex-Ante Inference in Large Language Models.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores ExAnte: A Benchmark for Ex-Ante Inference in Large Language Models

Reference 10

Resolution: metadata mismatch; local_arxiv, observed 2026-08-08T04:31:04.765917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f10255f9-bef7-4875-8408-e3c823662b4e · outbound

This paper cites Proving Test Set Contamination in Black Box Language Models.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Proving Test Set Contamination in Black Box Language Models

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.382539Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f3bb58b-25dc-4411-b7fa-83f44904762a · outbound

This paper cites Pitfalls in Evaluating Language Model Forecasters.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Pitfalls in Evaluating Language Model Forecasters

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.385535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c1155d93-b9f5-4885-bd2a-7d502bc2c26c · outbound

This paper cites A Comprehensive Survey of Contamination Detection Methods in Large Language Models.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores A Comprehensive Survey of Contamination Detection Methods in Large Language Models

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.388470Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 765eb102-f051-4d11-bad6-a9e8a45ace8c · outbound

This paper cites Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.391835Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d15f498-479f-4ef2-a62c-23e136f7c027 · outbound

This paper cites NLP evaluation in trouble: On the need to measure LLM data contamination for each benchmark.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores NLP evaluation in trouble: On the need to measure LLM data contamination for each benchmark

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.099410Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 853a2f93-9126-4740-8770-3eedf6e9fa71 · outbound

This paper cites Quantifying the effect of test set contamination on generative evaluations.arXiv preprint arXiv:2601.04301,.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Quantifying the effect of test set contamination on generative evaluations.arXiv preprint arXiv:2601.04301,

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.398711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc60c097-8936-407a-b34d-3e600514dff0 · outbound

This paper cites Colin White, Samuel Dooley, Manley Roberts, Arka Pal, et al.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Colin White, Samuel Dooley, Manley Roberts, Arka Pal, et al

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.405329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4342b7b-c2a5-44d1-bc7c-7682006aeb82 · outbound

This paper cites LiveBench: A Challenging, Contamination-Limited LLM Benchmark.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores LiveBench: A Challenging, Contamination-Limited LLM Benchmark

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.408456Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 772e1434-6b8e-4cfa-937d-653c40d82d9d · outbound

This paper cites Benchmark Data Contamination of Large Language Models: A Survey.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Benchmark Data Contamination of Large Language Models: A Survey

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.411806Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6d5b39f-7720-483f-a62c-bd18e18337aa · outbound

This paper cites DatedGPT: Preventing Lookahead Bias in Large Language Models with Time-Aware Pretraining.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores DatedGPT: Preventing Lookahead Bias in Large Language Models with Time-Aware Pretraining

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.415388Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 372bad00-77da-4547-981f-6351c5a94418 · outbound

This paper cites Rethinking Benchmark and Contamination for Language Models with Rephrased Samples.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Rethinking Benchmark and Contamination for Language Models with Rephrased Samples

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.418737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41e2cb85-5083-426e-b99e-3fe4ba1df6b5 · outbound

This paper cites Detecting Data Contamination in LLMs via In-Context Learning.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Detecting Data Contamination in LLMs via In-Context Learning

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.422329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cf2f86c7-c6f3-492d-bfa4-9deb7ac76e34 · outbound

This paper cites A Careful Examination of Large Language Model Performance on Grade School Arithmetic.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.425762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8b6905b3-5d1a-4114-b422-92d06516544b · outbound

This paper cites an unresolved cited work.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Unresolved cited work

Reference 28

Resolution: unresolved; raw_fallback, observed 2026-08-08T04:31:05.063406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation db180450-b928-4133-9961-150004c49a3a · outbound

This paper cites an unresolved cited work.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Unresolved cited work

Reference 29

Resolution: unresolved; raw_fallback, observed 2026-08-08T04:31:05.053534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 59330655-316d-4c44-b6a5-75ccfaa33fd2 · outbound

This paper cites an unresolved cited work.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-08-08T04:31:05.043282Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 38c1209c-35c2-409b-8cae-1b0c3fa5eb29 · outbound

This paper cites Controls are MiniMax-M3 and Claude-Opus-4.7, whose January 2026 cutoffs leave no leakage discontinuity inside the tested window.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Controls are MiniMax-M3 and Claude-Opus-4.7, whose January 2026 cutoffs leave no leakage discontinuity inside the tested window

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.022778Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e5bd1bdb-b5eb-4a63-841f-2cd158db3496 · outbound

This paper cites Eachproblemcarriesitscontest release date, so a model can only have trained on a problem’s solution if the contest occurred before the model’s training cutoff.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Eachproblemcarriesitscontest release date, so a model can only have trained on a problem’s solution if the contest occurred before the model’s training cutoff

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.000807Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 9e29a8fe-3126-4a30-9921-726385db38a5 · outbound

This paper cites paraphrases.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores paraphrases

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:04.968317Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1686ff19-2009-461f-a0d6-df65bd193856 · outbound

This paper cites Treatment–control PRC excess by domain and pooled, under Platt and isotonic calibration.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Treatment–control PRC excess by domain and pooled, under Platt and isotonic calibration

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:04.955926Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e8e041c5-3ade-46a3-b70c-5f8d4a85de48 · outbound

This paper cites Because the leakage estimand is ajumprather than a level, protocol level effects cancel unless they vary sharply in time.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Because the leakage estimand is ajumprather than a level, protocol level effects cancel unless they vary sharply in time

Reference 910

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.011782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 65fe6454-1ca9-49f2-83ea-6f93f1670b22 · outbound

This paper cites Chronologically Consistent Large Language Models.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Chronologically Consistent Large Language Models

Reference 1978

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.368666Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c79b8ee5-2332-4943-a681-58e9ec2b1c02 · outbound

This paper cites Detecting lookahead bias in LLM forecasts.arXiv preprint arXiv:2512.23847,.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Detecting lookahead bias in LLM forecasts.arXiv preprint arXiv:2512.23847,

Reference 1987

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.361204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5faa8654-e29e-4563-88e5-c5054eb22f46 · outbound

This paper cites The sharp-bounds framing of Theorem 2 follows partial identification (Manski, 2003; Imbens & Manski, 2004).

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores The sharp-bounds framing of Theorem 2 follows partial identification (Manski, 2003; Imbens & Manski, 2004)

Reference 2010

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.081622Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation c0328c06-8a03-4415-88fd-e754b03f040c · outbound

This paper cites Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?

Reference 2017

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.401902Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0004f2f-ec5b-48d7-ae3c-becedf7c2733 · outbound

This paper cites Time machine GPT.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Time machine GPT

Reference 2022

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.108653Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 5028d306-cf6b-4a91-acca-f6e123629764 · outbound

This paper cites Composition controls have cutoffsafterthe latest problem (Gemini-2.5-Pro, DeepSeek-R1, and the published 2025-cutoff pool).

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Composition controls have cutoffsafterthe latest problem (Gemini-2.5-Pro, DeepSeek-R1, and the published 2025-cutoff pool)

Reference 2023

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:04.990275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 3b6506ba-f4ae-43db-9bd6-7e0531d18027 · outbound

This paper cites Do Membership Inference Attacks Work on Large Language Models?.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Do Membership Inference Attacks Work on Large Language Models?

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.357384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8ba30b76-3c39-4208-82c9-d9ee8bfc293e · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-08T04:31:04.372400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f3c8b989-f5b5-40e6-8984-7503679df9e1 · outbound

This paper cites Language models are few-shot learners.

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores Language models are few-shot learners

Reference 2026

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T04:31:05.118711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Pith citing papers

No inbound Pith citation observations are available.