Paper Citation Record · LEDGER

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming

As of 18 August 2026, this Paper Citation Record lists 69 of 69 outbound references and 1 inbound Pith citation observation for arXiv:2505.16667.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.16667 v1

Coverage vector

measured 69 of 69 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:02:55.765520Z

measured 70 of 70 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-12T02:46:48.375901Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-12T07:31:24.581383Z

Reference resolution

69 of 69 outbound references displayed

verified exact1
verified fuzzy46
unresolved21
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7a25e39c-2331-4d59-8606-ce3716da216c · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:07.142889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1fab8258-cc2c-43ac-86bc-17921a4f6b1a · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:07.008079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 96767571-1153-41d1-b3da-5902d0c674ac · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T15:02:48.062606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1ce9737-673c-4d26-a891-c69aaf18a5f2 · outbound

This paper cites I Need Help! Evaluating LLM's Ability to Ask for Users' Support: A Case Study on Text-to-SQL Generation.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming I Need Help! Evaluating LLM's Ability to Ask for Users' Support: A Case Study on Text-to-SQL Generation

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T15:02:48.117992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a8148796-bf20-4ddd-a12f-3bd7473f8a86 · outbound

This paper cites Code Error Identifications:.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Code Error Identifications:

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:58.305506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 2f07d8ed-3c00-4e2c-bbcf-e0a25267a72e · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:06.859520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a954b9d6-5bb6-48f2-b71a-3c1aaa90b17f · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:06.705457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 53f5fdb9-771a-48eb-b400-603068d770e7 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:06.560486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 6af30ef3-5c35-46a7-9d43-cbe932dce9a1 · outbound

This paper cites Problem Requirements.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Problem Requirements

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:06.368204Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5249abb5-d134-4278-96af-cf316ca4c229 · outbound

This paper cites - Each test case consists of: - A line containing two integers n (the number of mushrooms) and x (the maximum toxicity level).

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - Each test case consists of: - A line containing two integers n (the number of mushrooms) and x (the maximum toxicity level)

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:06.272133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation be7ec0df-eb46-43f7-b148-35990b9de201 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:06.103131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e09d626f-2428-4428-ace5-c9516c1ef86d · outbound

This paper cites Functionality:.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Functionality:

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:05.957870Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a21960a9-c93d-44f6-8bde-601785c94c0c · outbound

This paper cites - For each test case: - The first line contains two integers n and x (1 ≤ n ≤ 2 × 105, 1 ≤ x ≤ 109) — the number of mushrooms and the maximum toxicity level.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - For each test case: - The first line contains two integers n and x (1 ≤ n ≤ 2 × 105, 1 ≤ x ≤ 109) — the number of mushrooms and the maximum toxicity level

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:05.802225Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 48d825d2-f05d-41c1-9965-fdc74c7f9398 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:05.611786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a7b6918b-dd74-4646-83aa-6a9ea23e66a2 · outbound

This paper cites Problem Requirements.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Problem Requirements

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:05.452759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 9cdd9b5a-9493-4119-b42e-712a6767c977 · outbound

This paper cites Input Format.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Input Format

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:05.232691Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 8ec99dfe-3890-473a-ac03-955ac647f529 · outbound

This paper cites Output Format.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Output Format

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:05.027439Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0fed5cda-d266-46a9-bd03-ed0e9667c5ba · outbound

This paper cites Functionality.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Functionality

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:04.878141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 26090cc2-2531-44b2-b3f6-6972add82a0b · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:04.754337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1bca4c59-c0ba-47d2-8a32-24bb62499b5f · outbound

This paper cites - While g is greater than x, reduce g by the toxicity level of the mushroom at the start index and increment start.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - While g is greater than x, reduce g by the toxicity level of the mushroom at the start index and increment start

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:04.562306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 37752c03-7ebb-4d7a-9356-9a9979739d7f · outbound

This paper cites Unsatisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unsatisfied

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:04.402627Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 4a639408-4021-46b6-8edd-28eb4fa4977a · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:04.260502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0a4513df-5120-4842-9a0e-0c192633ee04 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:04.139306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 12273d04-93ed-4818-bbbd-80ad99619088 · outbound

This paper cites The sliding window approach is well-suited for such range-based sum queries, especially when dealing with only positive integers (as toxicity levels ai are ≥ 1).

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming The sliding window approach is well-suited for such range-based sum queries, especially when dealing with only positive integers (as toxicity levels ai are ≥ 1)

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:03.992060Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 9ce68a56-0af9-4c85-b01f-6c198d0fc8e7 · outbound

This paper cites Algorithm.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Algorithm

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:03.844585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 9265f3a5-458a-43d2-a67b-2b020a45fc07 · outbound

This paper cites If it does, we reset ‘g‘ to zero and stop counting subsegments starting from that index.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming If it does, we reset ‘g‘ to zero and stop counting subsegments starting from that index

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:03.544233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b90e8e60-3508-4076-a1ce-003bc42d6828 · outbound

This paper cites - Specifically, if the sum goes above ‘x‘, the subsegment is invalid, and we should break out of the loop.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - Specifically, if the sum goes above ‘x‘, the subsegment is invalid, and we should break out of the loop

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:03.197978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 4ec26ae2-6ce6-494a-be47-3053bfe9fe78 · outbound

This paper cites For a subsegment to be valid, the cumulative sum should not exceed ‘x‘ at any time.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming For a subsegment to be valid, the cumulative sum should not exceed ‘x‘ at any time

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:02.984627Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a4fda03a-0cac-430d-9cbb-2d8d7034a73e · outbound

This paper cites This allows for fast sum calculation without needing to sum over each range repeatedly.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming This allows for fast sum calculation without needing to sum over each range repeatedly

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:02.701195Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 18bbf3f6-e39c-4762-ae19-da3117a2b9c6 · outbound

This paper cites \n".join(map(str, results))) if name ==.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming \n".join(map(str, results))) if __name__ ==

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:02.506426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1caaba83-d371-42c1-9825-96c85f8437a3 · outbound

This paper cites This results in a wrong value being returned when reset conditions are not handled correctly.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming This results in a wrong value being returned when reset conditions are not handled correctly

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:02.271197Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 05b46bcf-e6bd-4d25-bf32-8d34aca1d747 · outbound

This paper cites - Semantic errors:.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming - **Semantic errors**:

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:02.128594Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 8b67d647-09e0-46cf-8eef-7ae8e61cbef3 · outbound

This paper cites As a result, the toxicity reset logic does not properly skip over invalid ranges.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming As a result, the toxicity reset logic does not properly skip over invalid ranges

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:01.923412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 2f2c6f44-5696-485a-be1e-8235e76f789d · outbound

This paper cites \n".join(map(str, results))) if name ==.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming \n".join(map(str, results))) if __name__ ==

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:01.734466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3dbf22ec-b59f-4884-95ba-64d46627013f · outbound

This paper cites Operation Errors Operation is applied to an inappropriate data type.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Operation Errors Operation is applied to an inappropriate data type

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:01.547502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 099de1e6-8300-4071-83e4-d93ecbce36e4 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 38

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:03:01.350242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation f6b16ee5-333c-47a2-ab19-9d548675abf9 · outbound

This paper cites Declaration Errors Declaration Error: Incorrect or duplicate declaration of variables or functions.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Declaration Errors Declaration Error: Incorrect or duplicate declaration of variables or functions

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:01.111561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 49b30225-787e-4ee2-800f-5e18114d99b4 · outbound

This paper cites (while, for) Reference Errors 1.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming (while, for) Reference Errors 1

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:00.843386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation c060cce1-fa54-4712-a5fa-3768d11b22ce · outbound

This paper cites Calculation Errors 1.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Calculation Errors 1

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:00.595016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e1b81bf5-67df-4b66-8864-4c3d83a20886 · outbound

This paper cites Incomplete Errors Missing essential logical steps: The code generation is incom- plete.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Incomplete Errors Missing essential logical steps: The code generation is incom- plete

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:00.297565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5a8f3a5f-85af-40a9-9965-b06fe912bc7e · outbound

This paper cites Problem Requirements.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Problem Requirements

Reference 55

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:58.004128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 296c533f-d7b2-45cf-b207-51ee47046db3 · outbound

This paper cites Functionality.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Functionality

Reference 56

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:57.823376Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 2b3a94dc-4e6c-412c-9dd5-90590eb79d5b · outbound

This paper cites Algorithm.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Algorithm

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:57.702961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation d757e505-5946-4d67-9743-040453a6e5da · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 58

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:57.552500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1cc03882-8956-4464-8648-557023f46dd4 · outbound

This paper cites Bug Identification.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Bug Identification

Reference 59

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:57.418899Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3e236d2d-85fc-4600-a56a-1c5435c93eda · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 61

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:57.279254Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5ec73366-8783-4b87-b61d-e4b4bf54e600 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:57.010478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0d2aa046-564e-441e-97d4-4368df5a5726 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 64

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.838570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation fa6d61a8-dd59-4eed-9af1-d546bb2ca321 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 75

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.710264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5c51b3cc-34d7-48db-949c-e535421367c0 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 76

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:58.085812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation fd91c022-715d-4b5b-946e-40136040bd63 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 77

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.549112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 02f0bdf7-3304-49c4-bc5c-40ff0bdd8b72 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 78

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:57.130721Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 86e30da0-4c92-45f2-93e9-081168f32a3c · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 79

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.481253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation c13b2ac4-c9fa-4b4f-86c1-13f1d8bcf7e3 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 80

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.370498Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0b36a5a7-6e89-46a5-ae37-b53908c7aa11 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 91

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.251731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 7e7a3dbd-da8e-4ca4-88e2-bb3b40ca319b · outbound

This paper cites Function Call Error: Incorrect function name, wrong arguments, or incorrect method call target.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Function Call Error: Incorrect function name, wrong arguments, or incorrect method call target

Reference 92

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:03:00.015029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 64ac74b3-c3c6-4d8a-a76a-2263f5081a5b · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 93

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:59.818367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation f839bcd1-eae3-4ee7-a581-0aeb091812f5 · outbound

This paper cites Punctuation Error: Errors in punctuation, such as missing semicolons, commas, or brackets.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Punctuation Error: Errors in punctuation, such as missing semicolons, commas, or brackets

Reference 94

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:59.579407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a7c07968-ab59-410d-9688-01cd770d01bf · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 95

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:59.430543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation ae06f97c-03fa-49eb-9a6a-c7092ce820ad · outbound

This paper cites Code Semantic Correctness: You should concentrate on issues related to control flow, references, calculations, incompleteness, logical direction and suboptimal errors.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming **Code Semantic Correctness**: You should concentrate on issues related to control flow, references, calculations, incompleteness, logical direction and suboptimal errors

Reference 96

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:59.285983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation ecf0fecb-a3f1-4be5-bf1a-3ef6313aeac2 · outbound

This paper cites Loop Error: Error leading to infinite loops or incorrect loop exits.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Loop Error: Error leading to infinite loops or incorrect loop exits

Reference 97

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:59.128212Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 76b148af-74d1-4b90-9d20-d535da386f7c · outbound

This paper cites Wrong Variable: Calling the wrong variable.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Wrong Variable: Calling the wrong variable

Reference 98

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:58.973388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 01d29579-5ac5-4729-9915-4cd34818c450 · outbound

This paper cites Incorrect Comparison Operation.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Incorrect Comparison Operation

Reference 99

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:58.781077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 38b0a65c-0b52-4d73-81c0-de582409c783 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 100

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:58.598700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e51c7753-69c5-44bd-93ae-431133803676 · outbound

This paper cites an unresolved cited work.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Unresolved cited work

Reference 101

Resolution: unresolved; raw_fallback, observed 2026-08-07T15:02:58.419166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 9f6f7f39-bb0a-4bb8-bdce-c75105260479 · outbound

This paper cites satisfied.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming satisfied

Reference 102

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T15:02:56.158821Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b953cf99-8413-4401-a79a-cafdede46ebb · outbound

This paper cites Code Llama: Open Foundation Models for Code.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Code Llama: Open Foundation Models for Code

Reference 2003

Resolution: unresolved; no resolver link, observed 2026-08-07T15:02:47.998947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e7469eab-ea21-4a10-9f36-544021202550 · outbound

This paper cites A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends

Reference 2023

Resolution: malformed identifier; no resolver link, observed 2026-08-07T15:02:48.170023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f56b17c-eda8-49a1-a261-4261d07e08b0 · outbound

This paper cites Coffee-Gym: An Environment for Evaluating and Improving Natural Language Feedback on Erroneous Code.

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming Coffee-Gym: An Environment for Evaluating and Improving Natural Language Feedback on Erroneous Code

Reference 2024

Resolution: verified exact; local_arxiv, observed 2026-08-07T15:02:56.047744Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Pith citing papers

Observation e265146a-2671-4599-ae69-af2b76872885 · inbound

When Independent Sampling Outperforms Agentic Reasoning cites this paper.

When Independent Sampling Outperforms Agentic Reasoning ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming

Reference 21

Resolution: verified exact; arxiv_id, observed 2026-05-12T07:31:24.585979Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.