Pith. sign in

Paper Citation Record · LEDGER

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

As of 20 August 2026, this Paper Citation Record lists 49 of 49 outbound references and 4 inbound Pith citation observations for arXiv:2604.24703.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.24703 v1

Coverage vector

measured 49 of 49 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-08T03:07:06.924437Z

measured 53 of 53 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T04:15:28.983324Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-02T01:16:24.932912Z

Reference resolution

49 of 49 outbound references displayed

  • verified exact18
  • verified fuzzy8
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d57a7d5e-d135-4668-a9ef-060a4d4363bd · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.530253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:bf36818768c3e1be6dcce0284fcfb81922dbb78737be4cd2f5d2ba4a9a6203ee

Observation e0b30893-280e-48c9-9026-ac2fbd32a4b6 · outbound

This paper cites Program Synthesis with Large Language Models.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Program Synthesis with Large Language Models

Reference 2

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:35.651235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:beef099531c21a9b3522c91e21ab68ff2ddef676e6a7eaa086960766a1815289

Observation b696675f-ac02-41b7-9b36-6177e93f3596 · outbound

This paper cites Brown, Benjamin Mann, Nick Ryder, et al.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Brown, Benjamin Mann, Nick Ryder, et al

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.527108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:14239457b8399db4050d325f2f14c67a06b146d357c8bb65bfeb241e065f05e0

Observation 42cf42bf-571e-45c2-b83f-5de79cdaf9c8 · outbound

This paper cites NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Reference 4

Resolution
verified exact
doi, observed 2026-05-09T00:34:27.966157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:652b6bdf861b503f0817a1427ae2259440a9d5b12a34112c0f08314ea8346e45

Observation 84414a4b-9c18-4ab6-b048-eb00d2b8fb84 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Evaluating Large Language Models Trained on Code

Reference 6

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:35.230445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:a2aa5d67bc531dbf37c59309e9424e6a17ffc98a893c0ebe9ff53fd839cbb035

Observation 42b1a013-332e-4d29-964c-cc408d008fe6 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.533221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:57b1f59129b9ef0c80e5c42cd960170ecfdb2d0ce836a3e6cd2ac10d4e0cd3e1

Observation 20307a8f-6bb5-49d1-8bd6-db9e5c29132e · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.518717Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:cc726393eecf954eb063658d799aa0249e46b40f337dc9480f46c63a995b97bf

Observation ab3c4f7a-d59b-4b85-96b6-f0fca7c84579 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.513429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:6042a426ec15c220507c5901de6b606b89e55a43275647c57e3e72bc106447b1

Observation c328605b-fb4f-4ef5-8254-7beb444bfca7 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 10

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:35.855445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:e9ee1c7439ec358f10f0c099783fb354435e2ed8f547c79a8778c83a75e9a390

Observation be1b776d-5eec-4ea0-964d-c2bd95049e0c · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-09T00:34:27.971119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:d2b33c4a42d1e208de24e123ff8b49f90dfc265a6d5b211ec4db5e96230f2fd2

Observation 7cc92354-e4c2-41ce-b867-4ccd70de6dc0 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.510182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:19597d982eb1377e32000e53afe4080e0232c13676c98d15e6a57ca66c45e8a4

Observation 7261f562-6e3f-438f-a8e4-513752bc1aed · outbound

This paper cites Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, et al.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, et al

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.522324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:67cfe5e906473c198b14035c7f0542f8fa9cad4eedbdb9faa681d76dd504f9c6

Observation 3a40d39f-1cf4-47c6-87f8-71d0b0227163 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.537577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:68ebf25377e33afcc55db7ff9be8f9846fddbc641566c529fab6ed096fd84f83

Observation 0009d40a-5784-48be-9ff4-6a6a88af15e8 · outbound

This paper cites Qwen2.5-Coder Technical Report.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Qwen2.5-Coder Technical Report

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:34.550339Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:9ef2d3f3b1020355d1e6adf26de8b8fc7c3b905f3dd48d300891f639db34074d

Observation 65aecbdb-2bec-4692-a153-2338d8a450dd · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 16

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:34.990352Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:799944048d4e70fe5549fe272177e03ca2de799c41187d7e33777112aa70807f

Observation 4b425951-e5eb-4829-89d9-5eb336dd5075 · outbound

This paper cites Automated repair of ambiguous problem descriptions for llm-based code generation,.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Automated repair of ambiguous problem descriptions for llm-based code generation,

Reference 17

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:16:32.529961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:995ea0a9bd0f7d79f0e9cb19202f840da048a5527f1b8129bdc5b9084fa2e0ed

Observation 66fb0c0f-cf7f-42ba-a0b8-861052a40c34 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.545575Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:e82370abd00b009f1c2586e05454287752bde4b79e849795a53a265fa33a2bab

Observation 198ab81f-943e-426d-98b9-64b4c293c359 · outbound

This paper cites When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 19

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:16:34.336735Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:fd18f27335bc5c24893046cf40f2f68d94e6701f2c56df297b9d2a4e9f5793ac

Observation a0656451-8f1e-4808-a23f-a201698ae773 · outbound

This paper cites ACM Trans.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis ACM Trans

Reference 20

Resolution
verified exact
doi, observed 2026-05-09T00:34:27.979900Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:5c36afccfd1df2867b7681673530fb9836e2cd5cfedc38a7c773841a3f5fe974

Observation e9cec5d3-0fe5-404e-a0cc-48f4156b5110 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.505980Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:f337c72f4008e1c6920ca1303902a69588a59371a3f82f1f7320caa1f9f412d5

Observation 5b0dd6e1-4b21-4614-ae54-72b8f8930637 · outbound

This paper cites Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:08986987936574946f36943013b83e7158d48868aab5a0d3c73c5e475d23a4ee

Observation 4476c9c4-e3e1-4fba-b503-42db211b6fe2 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.493361Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:526c9a46f7c40a71c6331acf182d6cc333188b24d1560f94429b358c02869548

Observation 6c74e30e-2bff-4618-87c9-0cf917b7ce7e · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis StarCoder 2 and The Stack v2: The Next Generation

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-05-12T17:28:23.399599Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:3a6d45f0f249e7091f4149949476adbc259eee7c785b76f0419198c09d930c32

Observation 503e258d-1bf7-48cf-8718-f70a3e1676c5 · outbound

This paper cites Lahiri, and Sid- dhartha Sen.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Lahiri, and Sid- dhartha Sen

Reference 25

Resolution
metadata mismatch
arxiv_id, observed 2026-05-09T00:34:27.976541Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:24ba0123b02f77135d58a67abc2461a9ce1c8eebe8b98678e594a68a9edce3b0

Observation e728304b-51cc-429b-bdd1-070e2a3570ca · outbound

This paper cites Matthews.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Matthews

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.496475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:539bf3740df45a7bc47d7710af65104b59182ee47f09db9964cfee58d6bb30cc

Observation 6afee0b5-40d8-41c6-9dce-d781471431d7 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.501881Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:13568edc334fd1553c38b9cd1786b794d962d7007148010ca8609fc18062d402

Observation 326edbdb-762f-4a6e-8b74-d3d9496f9991 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-05-09T00:34:27.962680Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:696529969ab13e86137630ae3dd6ee5b7df3590c2dc4ecfa2b8d88a7e0d54de8

Observation 2ca8e452-baff-49e3-b456-99fc1ad6ac41 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.541572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:9493b69d91a2af3a7019bc058b758b25c2cc479f5f60fd75ad57fcaba29a7cd2

Observation 0f557631-d571-4694-a884-026e19692152 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.550295Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:9ae8afc69a2443c6aa3fa6503491027a1810749ab981ac8c15acc4010a120469

Observation 46d4a249-821d-4cdc-bbe3-a369abb73a29 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.490884Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:95715baae8de0407cb02eb740f9b5ad5b4a6836f4e9786dbc29a46b85e255c98

Observation 85cc2cc0-445a-4df5-8f35-0721e10a55c6 · outbound

This paper cites The Impact of AI on Developer Productivity: Evidence from GitHub Copilot.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis The Impact of AI on Developer Productivity: Evidence from GitHub Copilot

Reference 32

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:36.005374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:6a9a22379682f088457957d92f6ef5a8dbd60548db141befc72e7951046f490e

Observation 44537e20-4a6e-41c9-bd61-76205c3df51e · outbound

This paper cites A Multi-Language Perspective on the Robustness of LLM Code Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis A Multi-Language Perspective on the Robustness of LLM Code Generation

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:33.668355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:bb8feb2e07abde0cbbf09095c335717033cf25266f7b56981867ab5a55714ddb

Observation 10a62b5d-9430-4198-b65e-b26be492ed74 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.485441Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:3bc0bf0e760861b63aa23cd7ab1e7e9716fadb29878d75798d9c352ada574db0

Observation 7f45209d-3fad-40bf-8d73-e10eb8121799 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Code Llama: Open Foundation Models for Code

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:33.998909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:2a908c64d163bd95bb07058820b75a4e07e1e4b32d95fbb3a519476d497aa7ff

Observation 26f0669a-751e-4a8f-a723-43a3915635be · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.482738Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:8af0f1dc4cdb79ceb2a64a6b6949b3a8291f645aec56c91f0d1e0b9c3807da0d

Observation e38fa3c6-2e91-4234-a290-78512fc7b7aa · outbound

This paper cites Exploring the Robustness of Large Language Models for Solving Programming Problems.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Exploring the Robustness of Large Language Models for Solving Programming Problems

Reference 37

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:16:33.396088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:acaa785e77b95ed3a3fbf784456fae54f2c0af283c4dcbdcd83dbadde4f3f070

Observation 11427511-b106-46e1-bec2-d3c268d1d422 · outbound

This paper cites Saha, and Joanna Santos.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Saha, and Joanna Santos

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.488324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:5b8f36ca0ed8ae295c7343d4eaef477c37d209a2e0a1e2b99f9fdc294c0e2c92

Observation 6c6dc3b7-39a5-48c2-aab2-b0f3e38525b0 · outbound

This paper cites InProceedings of the IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM).

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis InProceedings of the IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM)

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.475044Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:20a52a8e6c0ab2ef742fcc9cd8d6a3b4ab4501e4e0df678144aea610cd49cd5f

Observation b9d71154-5bf7-483f-94ee-a84647211ac8 · outbound

This paper cites 2025.µFiX: Fixing Large Language Models’ Specification Misunderstanding for Better Code Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis 2025.µFiX: Fixing Large Language Models’ Specification Misunderstanding for Better Code Generation

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.477898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:47fc0b968565dffd087169c210c49f90e6369ccbfc00e1df046016f2582d6140

Observation 7dab856a-19c1-45be-a5da-47077a6d3d32 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.472310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:d467a6fc56ec77da1f93769a88b6e5eb62834abe1e70cb47bb037c5e624ffa28

Observation 113b63b1-d8c1-45e4-9ebc-351389202833 · outbound

This paper cites 2009.Requirements Engineering - From System Goals to UML Models to Software Specifications.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis 2009.Requirements Engineering - From System Goals to UML Models to Software Specifications

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.469682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:cd86ff48f9617e7a07166c85a1f89aa588b5ec124ea2b10c8e4d31a2862ff961

Observation b2484cae-d64e-44ae-8506-9b40efcf1116 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.480221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:1f7d98aeb2e260fabacd21326e0f5fbadb9477f811238686edaeb4c65182c887

Observation e45089ff-6489-4862-b69c-a0eee99fbc38 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.455930Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:d9d18a91beadf8dcd5a9d7091d3fa93d11c8629359fdf1324e9aff3e2e4fdcb0

Observation c489368c-7c85-4915-a984-4e0680f3a25d · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.453203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:554b3344acea6c6d0f5b4ff9dc2b18c8c6c87843fc5a67a8c0ea26d913c4deb1

Observation 27a8b123-b7be-4e3d-a7c2-a565f9847580 · outbound

This paper cites Wu and Fatemeh H.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Wu and Fatemeh H

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.458515Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:cf93f50dbd474a5c69c9a8ccad1045b588022efa0f2444a11353aaddd40fd088

Observation e46563de-befa-46c9-b95f-df37e175a67a · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.461150Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:f3255c09ae8f286b6c9030c865f7d112ce63e8b96b1165b38eedc2389e42d7b6

Observation 715c9d2f-c098-40c5-bffe-bc5d1fdd6210 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 48

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.466614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:e6655ee8cf1d682e0567c0159e760f36f86df2e6c9da5baf91fc4a2429f76c95

Observation 917050a2-db85-48c7-981d-eee6e8853573 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.463715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:8f9385bc186c7e6ee471b7363d2e8fdf3f70a0ed024e87dcc690d92d53b66547

Observation 3de16972-e9f0-4db8-9a77-aaa53304d2d7 · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 50

Resolution
verified exact
arxiv_id, observed 2026-05-14T19:30:10.582609Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:1ce8282adda64fd5eea2875b56aa2f5e587be41ebda1bffd898429659e182d1f

Pith citing papers

Observation 600e7d5d-35b3-4ccc-aff0-3135ad555c0f · inbound

Agent System Operations: Categorization, Challenges, and Future Directions cites this paper.

Agent System Operations: Categorization, Challenges, and Future Directions Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 93

Resolution
verified exact
local_arxiv, observed 2026-07-02T01:16:24.934327Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-06-28T12:14:21.322860Z digest=sha256:9fc8576184011d02ce2fd11e9ceb633594fc55596709f3b7fc45769f3ffaad1b

Observation 02a9404e-2b81-41fd-b3e3-eb45f64ef39d · inbound

From Failing to Passing: Evolving Natural Language Prompt Optimization Rules for LLM Code Generation cites this paper.

From Failing to Passing: Evolving Natural Language Prompt Optimization Rules for LLM Code Generation Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 2

Resolution
unresolved
no resolver link, observed 2026-07-11T08:31:24.850506Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T08:31:24.850506Z digest=sha256:3758273f992478f8399b392e3e7b347c207533fce3b96852fef677e94bbebadd

Observation 186ee387-bd30-4bca-997c-cf59a64bda0f · inbound

On the risk of coding before testing: An empirical study on LLM-based test generation workflow cites this paper.

On the risk of coding before testing: An empirical study on LLM-based test generation workflow Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 52

Resolution
unresolved
no resolver link, observed 2026-07-11T08:12:23.512737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T08:12:23.512737Z digest=sha256:438f20c76c7918e40617d70fae64ceac41d2698a291e4c87fe8c6a3b8a085a65

Observation 380c359b-0dcc-40b1-aa4f-1c65b788884a · inbound

AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation cites this paper.

AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T04:15:28.983324Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T04:15:28.983324Z digest=sha256:3404ddb04a401c18cfbbb67034895691b2627bdd7396f449d27578f023f5b56e