Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T17:34:19.857293Z
Paper Citation Record · LEDGER
As of 11 August 2026, this Paper Citation Record lists 66 of 66 outbound references and 8 inbound Pith citation observations for arXiv:2412.08819.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T17:34:19.857293Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-06T17:01:33.201477Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-07-02T03:46:32.285662Z
66 of 66 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 080e479a-d1aa-401c-a67d-c11e647d55b4 · outbound
HARP: A challenging human-annotated math reasoning benchmark Chatgpt, 2024
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 3f96f858-73d7-4a8b-be5b-030891b4d940 · outbound
HARP: A challenging human-annotated math reasoning benchmark Training Verifiers to Solve Math Word Problems
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 16a420f4-4a86-49af-a7b1-a8ef7c01ce97 · outbound
HARP: A challenging human-annotated math reasoning benchmark Measuring mathematical problem solving with the MATH dataset
Reference 3
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation de6b80d4-fe55-414a-870e-b634fe5182a5 · outbound
HARP: A challenging human-annotated math reasoning benchmark Learning to reason with llms, 2024
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6e1c5102-e9fe-4f2f-a2cd-1bbb9c9b2027 · outbound
HARP: A challenging human-annotated math reasoning benchmark Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8a2e0a48-9b59-45e8-ac1a-f3b8ac19d505 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation a0bcf2d8-d305-4da1-ab7a-299d8adc1715 · outbound
HARP: A challenging human-annotated math reasoning benchmark Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselves
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f5786bc6-c11f-4e22-817c-333a4cdd35f2 · outbound
HARP: A challenging human-annotated math reasoning benchmark The Llama 3 Herd of Models
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f28e3a18-3242-497d-8408-8726aeec69bd · outbound
HARP: A challenging human-annotated math reasoning benchmark Data diversity matters for robust instruction tuning,
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 784b433b-36f8-4e23-9228-587c27d7f4a1 · outbound
HARP: A challenging human-annotated math reasoning benchmark Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5c146d61-d15e-4ac8-9d1b-6d92489a81c0 · outbound
HARP: A challenging human-annotated math reasoning benchmark Data Diversity Matters for Robust Instruction Tuning
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1d45a0cf-0e39-4880-ab84-13741379adc0 · outbound
HARP: A challenging human-annotated math reasoning benchmark Xwin-lm, 9 2023
Reference 12
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 83c817e7-3ec0-462f-89e1-80d6044ca40f · outbound
HARP: A challenging human-annotated math reasoning benchmark STaR: Bootstrapping Reasoning With Reasoning
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7d9bf9fd-901a-47c9-a242-26fd61d4e88c · outbound
HARP: A challenging human-annotated math reasoning benchmark Hello, gpt-4o, 2024
Reference 14
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 229da6c0-15b8-4363-9a31-6067f97830fb · outbound
HARP: A challenging human-annotated math reasoning benchmark Introducing the next generation of claude, 2024
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 78c4e2cc-60e4-474d-ace9-37c94080dac1 · outbound
HARP: A challenging human-annotated math reasoning benchmark Solving quantitative reasoning problems with language models
Reference 16
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 81ce59c0-e3f5-4259-bcf3-ab3719a02e2d · outbound
HARP: A challenging human-annotated math reasoning benchmark Evaluating Large Language Models Trained on Code
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 90f8dd49-73ab-4ce4-93e8-3b5545222d3d · outbound
HARP: A challenging human-annotated math reasoning benchmark Changing Answer Order Can Decrease MMLU Accuracy
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5dff412e-a531-43cb-a59d-68ca93ea8d71 · outbound
HARP: A challenging human-annotated math reasoning benchmark Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2c3e9ad9-a431-4c10-b7b2-f6e82ee5b09c · outbound
HARP: A challenging human-annotated math reasoning benchmark Testing information, 2024
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 004c34a2-0270-415e-a792-1cceeb8345ab · outbound
HARP: A challenging human-annotated math reasoning benchmark Omni-math: A universal olympiad level mathematic benchmark for large language models,
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 428f568d-3a82-490b-acc5-251c23c4b7d2 · outbound
HARP: A challenging human-annotated math reasoning benchmark Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d4eb36ff-f067-4941-b53e-5e2ab3f92be1 · outbound
HARP: A challenging human-annotated math reasoning benchmark Introducing computer use, a new claude 3.5 sonnet, and claude 3.5 haiku, 2024
Reference 23
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 88df54c5-7cd8-4376-8cf3-d44cc4b71f5d · outbound
HARP: A challenging human-annotated math reasoning benchmark Openwebmath: An open dataset of high-quality mathematical web text, 2023
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 188d4292-397c-462a-94c2-74e9afd10170 · outbound
HARP: A challenging human-annotated math reasoning benchmark Open-LLM-Leaderboard: From Multi-choice to Open-style Questions for LLMs Evaluation, Benchmark, and Arena
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2efcd1d2-87fe-4223-af5d-8a923f59a299 · outbound
HARP: A challenging human-annotated math reasoning benchmark Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 206d0c5e-20bb-46d0-a8ec-6eb56ffcb2cd · outbound
HARP: A challenging human-annotated math reasoning benchmark Claude 3.5 sonnet, 2024
Reference 27
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation c41a89d4-f75b-4505-aade-5f7fbd999cd4 · outbound
HARP: A challenging human-annotated math reasoning benchmark Redpajama: an open dataset for training large language models, Oct 2023
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation d3d6593b-e74b-4a57-850c-752a03a06229 · outbound
HARP: A challenging human-annotated math reasoning benchmark Keep Guessing? When Considering Inference Scaling, Mind the Baselines
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 2f63f094-49b2-43eb-ac65-29d216b92852 · outbound
HARP: A challenging human-annotated math reasoning benchmark Time spent thinking in online chess reflects the value of computation, Oct 2022
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation b5c65b1d-79b4-44f0-a2c5-7c950230e371 · outbound
HARP: A challenging human-annotated math reasoning benchmark V-STaR: Training Verifiers for Self-Taught Reasoners
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6cb9b301-1ad3-4483-95a2-a675fc773bc9 · outbound
HARP: A challenging human-annotated math reasoning benchmark Quantifying Variance in Evaluation Benchmarks
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 08221698-9596-406e-894b-d2f80709db9e · outbound
HARP: A challenging human-annotated math reasoning benchmark Testing language models on a held-out high school national finals exam
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 286fcd5b-e4d4-49c0-82eb-4dbe1ed3d619 · outbound
HARP: A challenging human-annotated math reasoning benchmark MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6864c502-3dbc-4ecf-b948-b44014a6541f · outbound
HARP: A challenging human-annotated math reasoning benchmark FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5d1392fc-f062-4c28-ad58-286ae3a831b5 · outbound
HARP: A challenging human-annotated math reasoning benchmark A Careful Examination of Large Language Model Performance on Grade School Arithmetic
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2fdc50ab-f912-4b5d-90f6-fff5be4a5271 · outbound
HARP: A challenging human-annotated math reasoning benchmark Scale’s seal research lab launches expert-evaluated llm leaderboards, 2024
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 4a6323dd-70cb-4a72-869e-b0d8c4f904b8 · outbound
HARP: A challenging human-annotated math reasoning benchmark Answer :\ n$ANSWER
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 7a0518cd-120a-4150-bcde-84b54b3d16b6 · outbound
HARP: A challenging human-annotated math reasoning benchmark RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cac344a3-8986-427b-9205-5c0e7c7a110d · outbound
HARP: A challenging human-annotated math reasoning benchmark Lampinen, Stephanie C
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation af65e82a-0fe6-4850-bd7c-1df6f7df985a · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation bd0dc6b0-997e-4138-bc49-95cd54a1bcc7 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation cb5e5df4-8c4e-49f3-a500-3706a1325485 · outbound
HARP: A challenging human-annotated math reasoning benchmark The area of S is the area of the hexagon with vertices wk, which is 9 √ 3 2
Reference 44
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 4279aa4d-674f-4a4c-ba98-8d708e9fd9d6 · outbound
HARP: A challenging human-annotated math reasoning benchmark t5 = 1 t4 = 1
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 719a4869-0873-4673-a2e0-afc6afa9ed32 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 11f7798d-bfe8-43f0-8f15-7d1daae92721 · outbound
HARP: A challenging human-annotated math reasoning benchmark t8 = 1 +t8/2 = 1 +t4 = 1 + 3 = 4
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation aa43fd98-9ec3-4eff-a085-d4852b1b9eed · outbound
HARP: A challenging human-annotated math reasoning benchmark t11 = 1 t10 = 1 4/3 = 3
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation ec2af754-ef09-4dd7-ae48-89f06c0312aa · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 8bd601f8-f54f-4ef9-8ca3-639c50ebb827 · outbound
HARP: A challenging human-annotated math reasoning benchmark t14 = 1 +t14/2 = 1 +t7 = 1 +2 3 = 5
Reference 50
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 994473d6-4b1c-486c-9314-e14f0afd17a0 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 51
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation ab0c6a93-5e41-4e94-aee8-dec732980ed1 · outbound
HARP: A challenging human-annotated math reasoning benchmark t17 = 1 t16 = 1
Reference 52
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 7eb4150f-2fa1-4c84-b4d1-6175dc5aa1b7 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 53
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 2f28deb4-8072-48dc-b8f0-1f558e8d1e6f · outbound
HARP: A challenging human-annotated math reasoning benchmark t20 = 1 +t20/2 = 1 +t10 = 1 +4 3 = 7
Reference 54
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 21954628-3140-4ec5-85d4-2f53ca579a08 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 52713562-15a3-4f72-b1a3-1d57247ae990 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 5c1dc497-2e93-4f43-971e-090d5d610f1b · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 296afc59-afc6-432d-a749-6fa1f685a73c · outbound
HARP: A challenging human-annotated math reasoning benchmark t25 = 1 t24 = 1 7/2 = 2
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 100c5cfa-8059-46d5-b9ce-f9cddd92d478 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 59
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 4526bc41-104a-47bf-9549-0b241a8874b5 · outbound
HARP: A challenging human-annotated math reasoning benchmark t86 = 1 +t43 = 1 +1 t42 = 1 + 1 1+t21 = 1 + 1 1+ 3 7 = 1 +1 10 7 = 1 +7 10 = 17
Reference 60
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation bf11f43d-54ce-40db-96a3-f8908a543937 · outbound
HARP: A challenging human-annotated math reasoning benchmark t174 = 1+t87 = 1+10 17 = 27
Reference 61
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 11d80079-384e-4acb-a209-725ca965aa54 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 62
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 52e71fd5-a22b-48c1-914d-0ea903d5f83b · outbound
HARP: A challenging human-annotated math reasoning benchmark t1392 = 1 +t696 = 1 +61 17 = 78
Reference 63
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 98d495be-22b7-4d82-b056-41dc07eb986a · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 64
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation d1ce1236-6d87-4eea-b30a-e348fec83a66 · outbound
HARP: A challenging human-annotated math reasoning benchmark sinks" (vertices with no outgoing edges) or
Reference 65
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 5dd73c09-db56-4040-bbd9-dec686974790 · outbound
HARP: A challenging human-annotated math reasoning benchmark ## Step 8: Apply the Law of Cosines to triangle O1MO2 Using the Law of Cosines on triangle O1M O2, we can relate the side lengths to the given angle ∠O1M O2 = 60◦
Reference 66
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation ec23b7cb-29f8-48eb-ba38-d55ba4d90ce5 · outbound
HARP: A challenging human-annotated math reasoning benchmark Unresolved cited work
Reference 2024
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 0a5cc932-9adb-4387-a388-e1f093099b4d · inbound
MathArena: Evaluating LLMs on Uncontaminated Math Competitions HARP: A challenging human-annotated math reasoning benchmark
Reference 36
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation da373034-26dd-401d-b93d-14e5b682b48f · inbound
A Survey of Deep Learning for Geometry Problem Solving HARP: A challenging human-annotated math reasoning benchmark
Reference 2019
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7917bd7d-861b-4f80-9ded-b4b348468bba · inbound
MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimization HARP: A challenging human-annotated math reasoning benchmark
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 43746aa5-ec9c-4df8-8e5c-4f0de72a7011 · inbound
Towards High Data Efficiency in Reinforcement Learning with Verifiable Reward HARP: A challenging human-annotated math reasoning benchmark
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 43d53863-abe6-482e-8d13-ea891e3004a2 · inbound
EngiBench: A Benchmark for Evaluating Large Language Models on Engineering Problem Solving HARP: A challenging human-annotated math reasoning benchmark
Reference 50
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 9f1dda6a-cbfc-4247-b7ba-4190b6b18fff · inbound
Re$^2$Math: Benchmarking Theorem Retrieval in Research-Level Mathematics HARP: A challenging human-annotated math reasoning benchmark
Reference 25
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation eff1eb27-23a6-46d0-9ba9-939084390f85 · inbound
RLVR Datasets and Where to Find Them: Tracing Data Lineage for Better Training Data HARP: A challenging human-annotated math reasoning benchmark
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 18fdea39-2b56-4a2d-8b13-7633204e5076 · inbound
CrowdMath: A Dataset of Crowdsourced Mathematical Research Discussions HARP: A challenging human-annotated math reasoning benchmark
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.