Pith. sign in

Paper Citation Record · LEDGER

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests

As of 13 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 2 inbound Pith citation observations for arXiv:2506.04894.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.04894 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T10:35:02.149902Z

measured 26 of 26 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-20T09:22:06.285118Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-20T09:23:10.509262Z

Reference resolution

24 of 24 outbound references displayed

  • verified exact0
  • verified fuzzy6
  • unresolved18
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e77ef952-976b-4ba7-94ab-d1b4ac2d1122 · outbound

This paper cites A Survey of Large Language Models.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests A Survey of Large Language Models

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.064673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.064673Z digest=sha256:53dcaeae71a90ee45251337a93710a4b36a45475f14e438d6e50211ca170df45

Observation 26129e3c-be2f-4187-b8b5-68cf2eba32cc · outbound

This paper cites https://openai.com/o1/, 2024.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests https://openai.com/o1/, 2024

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:35:02.400755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.068921Z digest=sha256:02fac5bdeacedfd45f595f017268de03779e765dd21c8210b6f7c440d9dbea6e

Observation ee4e85c7-7869-4b11-a110-3191341deefd · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.072166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.072166Z digest=sha256:9293b5f267677cf9dccb3227cbfa45b1c6a8ee5fde46d732be1bda77c7b99e86

Observation 8297e588-252c-468d-9eac-ec1d5cc78065 · outbound

This paper cites an unresolved cited work.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:35:02.390764Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.075898Z digest=sha256:2597ede564922ad6cd63ce611f9f71afbaa1da010dbe0a11eeb8cede67700df3

Observation 3f1773dd-1287-4e9a-be38-143068c21443 · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.078965Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.078965Z digest=sha256:3a7f85e3b2e1f25f3df75eda3baf768ce6b6d48d8f1e34ee396660c66f0e5243

Observation 0153c955-1265-4112-80d0-b32548f7555f · outbound

This paper cites Can Language Models Solve Olympiad Programming?.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Can Language Models Solve Olympiad Programming?

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.083166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.083166Z digest=sha256:ea23a79cd07f47f5b7400f4bea24a424664a373ce42396b30f5fd0058151ba65

Observation 7d8cdb37-b2b4-48b3-9ac1-14879d128c64 · outbound

This paper cites CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.087340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.087340Z digest=sha256:e6e9fe6c3c9b6b87cb05065e0243b545a50208609961a02a024cd3fb9cbc6dcb

Observation 88feea31-4c79-4398-9151-0cb66d8085c7 · outbound

This paper cites Reflexion: Language Agents with Verbal Reinforcement Learning.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Reflexion: Language Agents with Verbal Reinforcement Learning

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.091598Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.091598Z digest=sha256:acdb8dc684868a76cee3475edffcd28cd2f5e5d69d7b346aeab68cac63c7f1c3

Observation ff232cf5-5847-4411-a246-d0c2a69f316f · outbound

This paper cites an unresolved cited work.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:35:02.379835Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.095896Z digest=sha256:d465f2eae6a252f86dfa074c4da2058f4e8be6d16af62ed9646c28744caceef1

Observation b71aa269-6c29-43ee-8021-8794b2ccca8a · outbound

This paper cites Program Synthesis with Large Language Models.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Program Synthesis with Large Language Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.099581Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.099581Z digest=sha256:374b94ee97d246263ecd731ac441853d25a5d9140f593dae548f964d4cc3a52b

Observation 6cf597c2-5c45-42d9-bec7-0a2af91442fe · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Measuring Coding Challenge Competence With APPS

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.102815Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.102815Z digest=sha256:69ff9f5abce048ef8f0c6272b9370a4fa65f8c3159bb99daefba911df99acb95

Observation 857463fc-6d53-45ae-bf67-fbd019d0a77c · outbound

This paper cites Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Freitas, Koray Kavukcuoglu, and Oriol Vinyals.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Freitas, Koray Kavukcuoglu, and Oriol Vinyals

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:35:02.370461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.106739Z digest=sha256:765c75d3d741b1b73b092bc8a973f923cf77672b975f13ca43d6977a8781a69d

Observation 313fd987-6613-4c39-8bd6-c6425ed2de53 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.109846Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.109846Z digest=sha256:0b88b626e711d7df5a66b0720f8b63cd9ce8d41526d17dfa97dbeeb7f463b024

Observation 20962425-cee4-4456-8526-4482cde1277e · outbound

This paper cites Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.113373Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.113373Z digest=sha256:751784ce58537acba8efe9cf09bec904ee023890c5a908db89aafdf1fe2b0397

Observation 64625227-ca3c-4f83-aa9e-2cf775e2a563 · outbound

This paper cites Multi-turn rl training for cuda kernel generation.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Multi-turn rl training for cuda kernel generation

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:35:02.360452Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.117383Z digest=sha256:74cb70504d2d236df821f4968a89d1eb0f4f1aa17e52c64d568f2addf3f54102

Observation ac9e268a-8594-43a4-8285-48859606379a · outbound

This paper cites Is Self-Repair a Silver Bullet for Code Generation?.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Is Self-Repair a Silver Bullet for Code Generation?

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.120455Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.120455Z digest=sha256:f5093306cbb864709aee0666c6c9c97060fde3634aa6a87a2f4cc4954e46904b

Observation b1e36e96-768f-4d86-a294-6eddbee9cf53 · outbound

This paper cites OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.124225Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.124225Z digest=sha256:7a18262fa1a15671f4137394b6f191f6e06616c5b6970fa25fd295068aaa6176

Observation 003e6e37-0338-4fdb-989d-6c79e5794682 · outbound

This paper cites SPoC: Search-based Pseudocode to Code.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests SPoC: Search-based Pseudocode to Code

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:35:02.350049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.127317Z digest=sha256:31aeeadc6d76423144a597b65f706501e0bf4e545fcce5eb418c4c2eb3d95f8d

Observation 141f6732-d71d-414f-a849-015d7191659a · outbound

This paper cites Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.130547Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.130547Z digest=sha256:bd77bbf1cfb99e8b33964ab6d50f694aa3c34acbecdb2f9b662e0f49e965465e

Observation bcb97050-bb2e-477c-914b-4236db4aa6d2 · outbound

This paper cites an unresolved cited work.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:35:02.339445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.134377Z digest=sha256:f0776f919b2b2a6c585a79e006ccbf3f9553e514ad02cdc5b4c9d5e93a84fbd3

Observation 80de60c8-3f66-40a9-913c-4d607dae410c · outbound

This paper cites QwQ-32b: Embracing the power of reinforcement learning, March 2025.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests QwQ-32b: Embracing the power of reinforcement learning, March 2025

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:35:02.328705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.138061Z digest=sha256:7ab2c476f3d8b0ae1e2985f21beed8d4ac17225e7749994c47e054c7555e4c16

Observation 91706d69-cc3c-4652-96bf-4e1f55e08da2 · outbound

This paper cites An Empirical Study on Eliciting and Improving R1-like Reasoning Models.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests An Empirical Study on Eliciting and Improving R1-like Reasoning Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T10:35:02.142063Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:35:02.142063Z digest=sha256:156fffed8d777d56bbc1b2003f75b7f519fadd77e7beae9e5dfebe30b427d5c7

Observation fa1eb5f7-65cb-4f62-883a-f2706f29a21f · outbound

This paper cites an unresolved cited work.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:35:02.317935Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.146268Z digest=sha256:11bd5d95754dfb4a65ee203dcd7531c37cb008efde49137287f6b74ae3275e59

Observation 49a4dd87-d001-41d3-b3c7-cd905c9f2adf · outbound

This paper cites Category1EnglishName.

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests Category1EnglishName

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:35:02.307798Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-07T10:35:02.149902Z digest=sha256:e061aa0dd4e7820220dc18429ef726d9dd826508bc645e34b04895ba50f2be82

Pith citing papers

Observation e4539fd5-b99d-4d9f-a2a4-64a894d074c0 · inbound

Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs cites this paper.

Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests

Reference 50

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T02:46:18.912715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-05-12T02:44:33.143247Z digest=sha256:e2311e51650751668c9a457aaf0e0d3b1e5fe9b5ea9a2ad83980ec0ebf17be0f

Observation cd3847b9-467e-4bdf-bfa5-13c1fb21692a · inbound

A-ProS: Towards Reliable Autonomous Programming Through Multi-Model Feedback cites this paper.

A-ProS: Towards Reliable Autonomous Programming Through Multi-Model Feedback ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-20T09:23:10.510877Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-05-20T09:22:06.285118Z digest=sha256:bc94658a156643827749e60a28e00b8185f92e36234b6ede61f980fd163ee16c