Paper Citation Record · LEDGER

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming

As of 10 August 2026, this Paper Citation Record lists 15 of 15 outbound references and 1 inbound Pith citation observation for arXiv:2606.12864.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.12864 v1

Coverage vector

measured 15 of 15 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-27T06:52:30.614374Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T22:23:17.976138Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-04T22:23:18.915548Z

Reference resolution

15 of 15 outbound references displayed

verified exact0
verified fuzzy0
unresolved10
parse uncertain0
malformed identifier3
metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0f4be170-14fa-46e7-89bd-c22b1c25487e · outbound

This paper cites Jimenez, C.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Jimenez, C

Reference 1

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 471ad097-e5c2-4228-bcab-e2c834dea4b5 · outbound

This paper cites TACO: Topics in Algorithmic COde generation dataset.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming TACO: Topics in Algorithmic COde generation dataset

Reference 2

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T14:48:33.592487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 513d91d4-592d-4de0-8c6f-88bb91cf3123 · outbound

This paper cites Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando De Freitas, Koray Kavukcuoglu, and Oriol Vinyals.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando De Freitas, Koray Kavukcuoglu, and Oriol Vinyals

Reference 3

Resolution: metadata mismatch; doi, observed 2026-06-27T07:00:40.323725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 27ed8b84-3500-4519-aaae-bee34a06abbf · outbound

This paper cites These excluded types often require multi-file submissions or non-static hack protocols, which introduce ambiguity and incompatibility with current LLM benchmarking standards.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming These excluded types often require multi-file submissions or non-static hack protocols, which introduce ambiguity and incompatibility with current LLM benchmarking standards

Reference 4

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7782e900-6b31-4342-b5a6-07aceae449a1 · outbound

This paper cites an unresolved cited work.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ce0ca4c-1ef4-4839-88e3-b7f3fd524ac5 · outbound

This paper cites self-hacks.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming self-hacks

Reference 6

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2d66d39-fb90-4b15-ad77-a3fb41316cac · outbound

This paper cites To address this, we re-evaluate every candidate buggy submission against the current judge; any submission that now passes all test cases is discarded.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming To address this, we re-evaluate every candidate buggy submission against the current judge; any submission that now passes all test cases is discarded

Reference 7

Resolution: malformed identifier; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d45db790-0477-4469-8138-6e479bfa7a4d · outbound

This paper cites an unresolved cited work.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7026fd7e-b6fc-43fc-a3ec-6f73be30db42 · outbound

This paper cites an unresolved cited work.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Unresolved cited work

Reference 9

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f116d690-f510-44a1-9f0f-d5d7136ab9e7 · outbound

This paper cites an unresolved cited work.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Unresolved cited work

Reference 10

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95ad8817-c61b-49e3-b39d-de06984eec81 · outbound

This paper cites Both Wrong.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Both Wrong

Reference 11

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2db74d5-041c-4abb-9af2-d29ad213a7e3 · outbound

This paper cites an unresolved cited work.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e096322b-48aa-40b2-8b90-1a1304165dcf · outbound

This paper cites monolithic.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming monolithic

Reference 13

Resolution: malformed identifier; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 37da58a3-b551-4d75-83c3-0387d680b80e · outbound

This paper cites This suggests that the models’ high performance on older “Hard” problems is partially attributable to memorization of canonical solutions present in the training data.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming This suggests that the models’ high performance on older “Hard” problems is partially attributable to memorization of canonical solutions present in the training data

Reference 14

Resolution: unresolved; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aa732e87-93ec-43a5-b125-e72c67ae9358 · outbound

This paper cites low-signal.

Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming low-signal

Reference 15

Resolution: malformed identifier; no resolver link, observed 2026-06-27T06:52:30.614374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation d890f4df-2eee-4a47-850c-4faf06fd4129 · inbound

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch cites this paper.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming

Reference 27

Resolution: verified exact; local_arxiv, observed 2026-08-04T22:23:19.019371Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.