Paper Citation Record · LEDGER

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models

As of 11 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 2 inbound Pith citation observations for arXiv:2501.09653.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.09653 v2

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T19:50:26.350896Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:22:17.415772Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-13T18:28:06.508570Z

Reference resolution

22 of 22 outbound references displayed

verified exact0
verified fuzzy11
unresolved11
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 32cd6c9a-ed47-4d53-a604-fa560f507c42 · outbound

This paper cites The stack: 3 tb of permissively licensed source code, 2022.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models The stack: 3 tb of permissively licensed source code, 2022

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.791526Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 9d79d3a3-843e-47f0-9daf-1b7e97c04b80 · outbound

This paper cites Redpajama: An open source recipe to reproduce llama training dataset, 2023.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Redpajama: An open source recipe to reproduce llama training dataset, 2023

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.775920Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation f1ec69a4-72ea-4a7a-ba15-18ff0a8612b6 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models StarCoder 2 and The Stack v2: The Next Generation

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.236643Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61fbb405-c742-47ba-bd51-671564934b13 · outbound

This paper cites A catalog of data smells for coding tasks.ACM Trans.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models A catalog of data smells for coding tasks.ACM Trans

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.758844Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation c546c69e-978d-4b6d-ad92-baa32996cf85 · outbound

This paper cites The stack: 3 TB of permissively licensed source code.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models The stack: 3 TB of permissively licensed source code

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.740445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 582ad22a-532c-4cb4-88ce-174941e824ce · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.255810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d475b252-2ae1-481c-9f95-8c6ad422a892 · outbound

This paper cites Codeparrot dataset.https://huggingface.co/datasets/transformersbook/codeparrot.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Codeparrot dataset.https://huggingface.co/datasets/transformersbook/codeparrot

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.722564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 5a0a4397-ce97-4c2a-88d2-4621e41bc977 · outbound

This paper cites an unresolved cited work.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-10T19:50:26.705021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation eff1370b-756b-4a39-a1e1-b341cef9d4f2 · outbound

This paper cites An Interpretability Illusion for BERT.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models An Interpretability Illusion for BERT

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.272331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d6c4f8a-1814-4f9d-a5db-917340256045 · outbound

This paper cites An exploratory investigation into code license infringements in large language model training datasets.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models An exploratory investigation into code license infringements in large language model training datasets

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.685896Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 6dc5b22e-3442-486c-89cb-d5656deac552 · outbound

This paper cites Starcoder: may the source be with you!Transactions on Machine Learning Research, 2023.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Starcoder: may the source be with you!Transactions on Machine Learning Research, 2023

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.669535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 6218cef3-306b-49d1-bf6d-edc106f533e9 · outbound

This paper cites Cambridge University Press, USA, 2nd edition, 2014.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Cambridge University Press, USA, 2nd edition, 2014

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.647165Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 74f867ac-3513-4f85-9bf0-9c41be3f13bf · outbound

This paper cites The adverse effects of code duplication in machine learning models of code.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models The adverse effects of code duplication in machine learning models of code

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.624499Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 46e3267d-f668-4896-8794-ae2ce8aa7a92 · outbound

This paper cites an unresolved cited work.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-10T19:50:26.602813Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation ff82f540-b4ed-4ab6-b4ce-fb3bc8ba6d3c · outbound

This paper cites an unresolved cited work.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-10T19:50:26.584472Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation b2101cb2-3c37-4de4-ba9c-606dbabf325a · outbound

This paper cites an unresolved cited work.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-10T19:50:26.567725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 23482c3a-1483-45ac-91ea-ad8626ff1d4b · outbound

This paper cites CodeGemma: Open Code Models Based on Gemma.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models CodeGemma: Open Code Models Based on Gemma

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.319592Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ecdc893f-4828-4d3a-8582-72f04ebfcdd1 · outbound

This paper cites Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.326780Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8195bafe-a8e1-44aa-afb6-be5c0c8f5907 · outbound

This paper cites Is this code written in english? a study of the natural language of comments and identifiers in practice.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Is this code written in english? a study of the natural language of comments and identifiers in practice

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.550097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 1f44501d-be99-4ba8-a249-ddf3e8540134 · outbound

This paper cites Part of speech tagging: a systematic review of deep learning and machine learning approaches.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Part of speech tagging: a systematic review of deep learning and machine learning approaches

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T19:50:26.531393Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 3e057c20-0f21-4e07-b6ee-e3367cecabe9 · outbound

This paper cites The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.343962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d9b122a-cda0-4ea2-99e0-2e1fa64e5b17 · outbound

This paper cites LLM Dataset Inference: Did you train on my dataset?.

The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models LLM Dataset Inference: Did you train on my dataset?

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-10T19:50:26.350896Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation fcc12f47-8625-41b7-bed7-8728820880de · inbound

$\texttt{Droid}$: A Resource Suite for AI-Generated Code Detection cites this paper.

$\texttt{Droid}$: A Resource Suite for AI-Generated Code Detection The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T18:22:17.415772Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38caf268-6979-4b42-8769-078f2e11a548 · inbound

Automated Attention Pattern Discovery at Scale in Large Language Models cites this paper.

Automated Attention Pattern Discovery at Scale in Large Language Models The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-07-17T02:20:31.035222Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.