Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-06T22:10:26.307678Z
Paper Citation Record · LEDGER
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements
As of 21 August 2026, this Paper Citation Record lists 41 of 41 outbound references and 4 inbound Pith citation observations for arXiv:2506.22419.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-05T15:25:39.816721Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Reference resolution
41 of 41 outbound references displayed
- verified exact0
- verified fuzzy7
- unresolved33
- parse uncertain0
- malformed identifier1
- metadata mismatch0
External citation measurements
0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Outbound references
Observation ef68c330-fbe1-4189-b150-d0946711f4bd · outbound
This paper cites Consider both creative and practical ideas.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Consider both creative and practical ideas
Reference 1
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:34.889822Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 2c7c01d1-46e5-47ec-a432-1dbb696342cb · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 2
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:34.712611Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation a1fb0bfb-74f4-4604-9cc4-f973a53cd9b3 · outbound
This paper cites I trust you to make good decisions, so do not ask me for permission to make any code changes.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements I trust you to make good decisions, so do not ask me for permission to make any code changes
Reference 3
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:34.538667Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 6c765828-05a7-4d17-ac35-0d43d6834c6e · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 4
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:34.361362Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation d2324944-ac71-4e75-aada-031cde08df6b · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 5
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:34.187901Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation b892da07-2db9-428d-8177-5bd9424e6f99 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 6
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:34.000463Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation e782e554-c209-498f-b713-37bb24870c37 · outbound
This paper cites Level 2 hint generation prompt Given the current code, changelog, and next code, provide a detailed natural language description of the improvements made.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Level 2 hint generation prompt Given the current code, changelog, and next code, provide a detailed natural language description of the improvements made
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:33.841269Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 32f2cc76-80f2-452a-9c34-ea7c93a87345 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 8
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:33.704241Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 3556d527-1f0e-4610-ac21-bdc09c6d8833 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 9
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:33.543350Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation ae756bd9-ebdd-4462-84f0-7b9bff672b4c · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 10
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:33.371554Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation b7fe7217-5b1f-4061-8126-8ef6849b3eb7 · outbound
This paper cites 30 Level 3 hint generation prompt Given the current code, changelog, and next code, pseudo codes and text description, generate a formal paper-like summary of the improvements.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements 30 Level 3 hint generation prompt Given the current code, changelog, and next code, pseudo codes and text description, generate a formal paper-like summary of the improvements
Reference 11
- Resolution
- malformed identifier
- raw_fallback, observed 2026-08-06T22:10:33.221483Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 2fa41f00-31ff-49ca-957e-80392d0894fe · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 12
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:33.055489Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 151860b4-907d-43ba-9d31-21d4c3b70495 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 13
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:32.910378Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 91e75e7a-d784-41b8-8f6e-327736d1bad3 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 14
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:32.782074Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 21be2c77-2edf-40f9-ae1f-8bd16ba8ff7d · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 15
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:32.491176Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 9aa45e5a-402b-4164-95f2-06995d76a5e4 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 16
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:32.193860Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 6e88f953-cad3-447c-a653-ff0c4bc2614b · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 17
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:31.915006Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation a237938b-8a27-45c8-befd-83775802303a · outbound
This paper cites Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
Reference 18
- Resolution
- unresolved
- no resolver link, observed 2026-08-06T22:10:24.529827Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 25c851ca-c5d4-42c5-ad15-3679634a9c07 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 19
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:31.681070Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 315768e0-fbeb-4014-9203-9f6616875f59 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 20
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:31.395471Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 9f91ae06-fb0a-42d0-b261-b554a9374b5f · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 21
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:31.120828Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation fc0c13b8-4460-4817-b6de-ed8deb37f729 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 22
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:30.859780Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation f27d5909-21f8-4f2f-8c07-778296c23348 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 23
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:30.642869Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 3b603881-dd62-4278-a572-be9b3c5211b7 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 24
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:30.347248Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation fde11861-4108-4507-86ef-170b1c3023b5 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 25
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:30.186562Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation f056e03f-b582-4a61-811f-e5ad4ab12370 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 26
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:30.034753Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation cb7c10cf-d0fe-43a2-a77b-8faa70c680c6 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 27
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:29.876777Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 62a7fe16-7511-4013-84eb-a1309e22ca61 · outbound
This paper cites Our modifications require minimal code changes while achieving 5B token convergence equivalent to baseline 10B token performance.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Our modifications require minimal code changes while achieving 5B token convergence equivalent to baseline 10B token performance
Reference 28
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:29.706265Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 298434f6-7134-4192-b735-3ff5bb172fa1 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 29
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:29.525019Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation dd1c972f-40ef-4cc7-b924-ef7423c9b06a · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 30
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:29.345309Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 44d3e601-a9e0-4887-946c-00a585f6d88a · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 31
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:29.210616Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 4ba32774-b25e-4009-8cd9-c79c045b2d43 · outbound
This paper cites Methodology ### 2.1 Rotary Position Encoding Traditional approaches concatenate positional embeddings to token embeddings.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Methodology ### 2.1 Rotary Position Encoding Traditional approaches concatenate positional embeddings to token embeddings
Reference 32
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:29.042061Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 9b678762-30e0-4749-8c62-feeaa5dac082 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 33
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:28.888127Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation f642248e-d235-4a01-8b43-60df2d159a95 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 34
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:28.721285Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation bafc83e6-e025-4fbc-a70c-811a29da37d1 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 35
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:28.464178Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 60238ea6-2b29-4cbc-8d5d-2fb39044bffd · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 36
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:28.129955Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation eb2cc67e-74a8-4869-afb2-2d33397b5baa · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 37
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:27.797722Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation a4f8d59d-d266-4186-98e6-c5d6ad28eb69 · outbound
This paper cites Implementation Details ### 4.1 Critical Code Changes Core modifications from baseline implementation: ‘‘‘python # Additions class Rotary(nn.Module):.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Implementation Details ### 4.1 Critical Code Changes Core modifications from baseline implementation: ‘‘‘python # Additions class Rotary(nn.Module):
Reference 38
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:27.481307Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 6b8896be-035c-4d01-a816-b744074fc905 · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 39
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:27.259542Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 33a996bd-f716-4e77-87f7-76a70e1a794c · outbound
This paper cites an unresolved cited work.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Unresolved cited work
Reference 40
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T22:10:26.990546Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 9f2036b4-70af-4710-a98f-d5b7d972d12a · outbound
This paper cites Our results suggest that careful component co-design remains crucial for efficient large model training.
The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements Our results suggest that careful component co-design remains crucial for efficient large model training
Reference 41
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T22:10:26.661850Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Pith citing papers
Observation 42d1ed8e-193b-4050-adaf-b11dc069e03c · inbound
Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design cites this paper.
Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements
Reference 37
- Resolution
- verified exact
- arxiv_id, observed 2026-05-20T18:58:53.838508Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation b8357966-cb94-4292-b8d8-44847eae559c · inbound
Toward Generalist Autonomous Research via Hypothesis-Tree Refinement cites this paper.
Toward Generalist Autonomous Research via Hypothesis-Tree Refinement The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements
Reference 169
- Resolution
- verified exact
- arxiv_id, observed 2026-06-27T09:40:47.000467Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 7b2e2449-9181-457e-8d5a-a561f9258e10 · inbound
A-Evolve-Training: Autonomous Post-Training of a 30B Model cites this paper.
A-Evolve-Training: Autonomous Post-Training of a 30B Model The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements
Reference 2
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-03T05:27:40.447908Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.
Observation 5ad5ec6b-29f7-425c-b6e3-044dbecd29ae · inbound
Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details cites this paper.
Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements
Reference 114
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T15:25:39.816721Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.