Paper Citation Record · LEDGER

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure

As of 23 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 1 inbound Pith citation observation for arXiv:2506.12278.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.12278 v1

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:59:57.155640Z

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T22:23:18.237307Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T02:28:24.338817Z

Reference resolution

32 of 32 outbound references displayed

verified exact0
verified fuzzy0
unresolved32
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

0
pith, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 8b2839ec-2f8c-47cd-80a4-0d0fccdb0135 · outbound

This paper cites URL: " 'urlintro :=.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure URL: " 'urlintro :=

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.449687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6bae24c5-efac-42ed-8b35-d3c0a7b056f8 · outbound

This paper cites write newline.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure write newline

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.488543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9357e788-225b-474c-a621-88c5dadac4e2 · outbound

This paper cites Program Synthesis with Large Language Models.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Program Synthesis with Large Language Models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.528534Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0fcd630-95d4-4a1c-8cf3-72eac5cb2b66 · outbound

This paper cites CodeT: Code Generation with Generated Tests.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure CodeT: Code Generation with Generated Tests

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.577526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2c973e75-acea-4a9d-9d4b-13a3edf2bd11 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:58.535412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5ec18424-40c3-4059-ab3c-58815dc5dec9 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:58.441772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation b6de7f7d-4bb7-4f45-b2d0-b29c985193c0 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:58.293660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4758ddc3-7b90-4bbe-82f4-52b61c663c71 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Measuring Coding Challenge Competence With APPS

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.796486Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d0816bf-0534-4ead-8f52-90685a61d73d · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:58.125813Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 579d2730-740a-4c4a-b838-42d053e23109 · outbound

This paper cites Qwen2.5-Coder Technical Report.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Qwen2.5-Coder Technical Report

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.909403Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d885ef1-8f1a-4e6d-8d0b-4b74e4a8a81a · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:55.967202Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72f97c88-b4e1-481f-8359-f5d747b3c45d · outbound

This paper cites Mistral 7B.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Mistral 7B

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.011602Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e8e3f768-a80e-443a-9303-c26bbbe2ec9a · outbound

This paper cites Preference Optimization for Reasoning with Pseudo Feedback.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Preference Optimization for Reasoning with Pseudo Feedback

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.058442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ab15e48-f62f-414a-b04d-f652a415dbcc · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.102230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e088c84-d7d5-4cc4-ac74-4ab1c6de13d2 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.156125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f386c15-9adc-4574-8705-18903fad0810 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:57.995930Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 7225e502-4e22-4b42-8d75-dfaad8008844 · outbound

This paper cites Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.261209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 84c7e1cf-d8ef-41dd-b371-cce4142af3e8 · outbound

This paper cites The Llama 3 Herd of Models.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure The Llama 3 Herd of Models

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.303293Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6c82f0ca-7153-41d4-ad1d-71a6882961f5 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.348914Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd7fbad9-537e-4b7d-8d93-047f1f0cd5fa · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.419184Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 248077a6-a411-41f8-99c7-4985da679302 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:57.832291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 810dafbc-04e9-4c04-99f7-dc9cec0e641b · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:57.722344Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation b5959592-d82d-4bd1-9378-89fa9519ac30 · outbound

This paper cites Gemma 3 Technical Report.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Gemma 3 Technical Report

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.591993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4cf7ca66-c79b-4ff0-9773-ddb70e485aa2 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:57.569425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e6092ee4-0bcb-4b59-9662-6d0b599e2ddb · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.704854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 572a3131-a99b-4f23-952b-17e21831f1ab · outbound

This paper cites TESTEVAL: Benchmarking Large Language Models for Test Case Generation.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure TESTEVAL: Benchmarking Large Language Models for Test Case Generation

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.751560Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82778f0a-c4d0-4191-882f-3d21a15b90c5 · outbound

This paper cites Qwen3 Technical Report.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Qwen3 Technical Report

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.812729Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 037b10f5-6452-4d97-8b18-524b3ee79a94 · outbound

This paper cites Qwen2 Technical Report.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Qwen2 Technical Report

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.888058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d7f9b05-be02-4689-b1e4-4e1934392f1d · outbound

This paper cites Qwen2.5 Technical Report.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Qwen2.5 Technical Report

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:56.935507Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 87e3b6f0-bf66-4c79-a1bc-9e4cc155d542 · outbound

This paper cites HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:57.050750Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f58fb4c-a7b5-49c2-a05d-1aa415111917 · outbound

This paper cites an unresolved cited work.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-08-07T00:59:57.459436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 96f2f7ac-5c99-4447-b9bd-70e4f8488d2b · outbound

This paper cites ALGO: Synthesizing Algorithmic Programs with LLM-Generated Oracle Verifiers.

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure ALGO: Synthesizing Algorithmic Programs with LLM-Generated Oracle Verifiers

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T00:59:57.155640Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation e45ec79c-5879-4031-a6ac-3a2f2c27ff7c · inbound

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch cites this paper.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure

Reference 29

Resolution: verified exact; local_arxiv, observed 2026-08-04T22:23:18.639334Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.