Paper Citation Record · LEDGER

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

As of 7 August 2026, this Paper Citation Record lists 43 of 43 outbound references and 11 inbound Pith citation observations for arXiv:2507.20439.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.20439 v1

Coverage vector

measured 43 of 43 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T13:38:53.742442Z

measured 54 of 54 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T14:46:30.803463Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

43 of 43 outbound references displayed

verified exact3
verified fuzzy1
unresolved38
parse uncertain0
malformed identifier0
metadata mismatch1

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 9df98d93-dda8-4a14-b4d0-f058be2027d3 · outbound

This paper cites IEEE Recommended Practice for Software Requirements Specifications.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions IEEE Recommended Practice for Software Requirements Specifications

Reference 1

Resolution: verified exact; raw_fallback, observed 2026-08-06T13:38:55.205137Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a27cb455-ca01-4845-932d-4b37bcdd76f2 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:47.768131Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23de4ca7-f7e8-4054-8996-c4466765f738 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:39:00.084889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c6a564b6-62bf-444e-bc17-df086f55d3ee · outbound

This paper cites Program Synthesis with Large Language Models.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Program Synthesis with Large Language Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:48.144648Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0fac6cd1-51e4-41fa-9b8b-0bb56846416b · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:59.929664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 87fd0afb-5e94-4171-9253-850d8306a7ec · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:59.673488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation eff87302-791c-471f-ba3b-c2a38e176e51 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Evaluating Large Language Models Trained on Code

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:48.655287Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b13455d5-6388-4554-8959-e2e884814991 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:48.816979Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6a20980-cb7d-4729-a40e-20159448581b · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:49.100177Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 365d18e0-4cd8-49f8-9f39-dde997ede50a · outbound

This paper cites Systematic Evaluation of GPT-3 for Zero-Shot Personality Estimation.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Systematic Evaluation of GPT-3 for Zero-Shot Personality Estimation

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:49.217874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 161d3724-ede3-4f83-94cc-e2353ac70e94 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Measuring Coding Challenge Competence With APPS

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:49.326645Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 725e18f3-d124-42a1-99bc-91ff4d39a635 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:49.436262Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8c056224-3794-45f4-8d08-3fad5c1eee98 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:49.547770Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ca011c1e-cbf9-4062-8c5e-770820f1c436 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:59.481548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 2fed75e1-c953-40cd-b241-b8c68755a4c1 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:59.337232Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f85e91c9-e344-4da7-833b-a4e2fd9a7e11 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:59.122903Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ee94a9d0-b71b-42cf-8498-dc7de55822a9 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:58.949258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 5358355d-f85f-46c2-ab56-11a97fdb9406 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:50.268739Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20e2a215-9354-4920-b9b5-6e3907489b99 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 22

Resolution: metadata mismatch; raw_fallback, observed 2026-08-06T13:38:54.736511Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a18c74fa-41c2-4b64-9e60-c3939ed13364 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:50.555980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aface219-411c-4fbe-9a10-cfbfea79d036 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:58.616747Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 982fa63d-cedf-4c65-9275-22cf2d04f7b1 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 25

Resolution: verified exact; doi, observed 2026-08-06T13:38:54.019782Z

Source-reported events for the cited work

correction dated 2022-04-04. Source: crossref record 10.1007/s00766-022-00378-4->10.1007/s00766-021-00367-z:correction, observed 2026-07-11T02:57:50.434999+00:00. This notice travels one citation hop only.

Observation fa8f5d74-5fa1-4823-8f1e-083426e837c7 · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:51.181674Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 39c13da2-363a-4edd-8061-d9b3ceb02ba4 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 27

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:58.387181Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 45e8c2d1-c011-4765-8ee6-54bf5031f8ad · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 28

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:57.675628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 74c4d79d-8833-4016-9175-2a3328b65748 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 29

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:58.007097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e34977af-ddde-4c41-b37f-5331bc09f3cb · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:57.302392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation dc21c2dd-ad0a-4abe-bfc5-21ccb202e113 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:57.436680Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 7f9f76a7-6b47-4e1d-8575-5cde5af1b13c · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:57.053010Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 7362a76e-f3f8-4a6d-b97a-5d3d60c1cc65 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Code Llama: Open Foundation Models for Code

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:51.815907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61318ea6-a0f4-41c4-8f1b-7d14faacdcbc · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 34

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:56.559707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 2542d470-b572-492f-803d-c90b569f308b · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 35

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:56.839141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 353dce04-6766-4e73-870b-f95226b2934c · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 36

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:56.312009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e37dd0df-15a1-48b8-85a3-2fda37ee3973 · outbound

This paper cites Recent Advances in Software Effort Estimation using Machine Learning.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Recent Advances in Software Effort Estimation using Machine Learning

Reference 37

Resolution: verified exact; local_arxiv, observed 2026-08-06T13:38:54.305710Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 0cfa7f88-6cea-4a69-8188-34069b47c5d3 · outbound

This paper cites Is Your AI-Generated Code Really Safe? Evaluating Large Language Models on Secure Code Generation with CodeSecEval.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Is Your AI-Generated Code Really Safe? Evaluating Large Language Models on Secure Code Generation with CodeSecEval

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:52.828980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d00f9a7-7715-4037-9396-90903b31b54f · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 39

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:56.058687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation cbc77a68-d9ca-4d9d-a33d-29c36136f676 · outbound

This paper cites DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:53.175435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8a3ba20e-0ce5-4251-8cc3-30bc68fb2477 · outbound

This paper cites ReCode: Robustness Evaluation of Code Generation Models.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions ReCode: Robustness Evaluation of Code Generation Models

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:53.002137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 71430e1e-2df9-4de9-8f9f-1a75c545da80 · outbound

This paper cites LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-06T13:38:53.452180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f86c9d45-f912-4324-9e17-cf9f78ff88d5 · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 43

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:55.836809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a1570c58-f6a5-43b8-b3bc-45a685e623fc · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 44

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:55.486547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 365c216c-8b0a-48cd-a867-06d1e6cf07da · outbound

This paper cites an unresolved cited work.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Unresolved cited work

Reference 45

Resolution: unresolved; raw_fallback, observed 2026-08-06T13:38:55.691351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f0cc826d-8542-49ee-b570-66ae34b1b1de · outbound

This paper cites Software: Practice and experience 52, 1 (2022), 39–65.

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions Software: Practice and experience 52, 1 (2022), 39–65

Reference 2022

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T13:38:58.753242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Pith citing papers

Observation 198ab81f-943e-426d-98b9-64b4c293c359 · inbound

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis cites this paper.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-11T22:16:34.336735Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 70807c01-e5e1-4017-aeca-80197e2fbaef · inbound

When Prompt Under-Specification Improves Code Correctness: An Exploratory Study of Prompt Wording and Structure Effects on LLM-Based Code Generation cites this paper.

When Prompt Under-Specification Improves Code Correctness: An Exploratory Study of Prompt Wording and Structure Effects on LLM-Based Code Generation When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-05-11T22:17:08.166144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 77d8fa42-aa49-4696-b4b2-df3eb3d40d82 · inbound

ClarifyCodeBench: Evaluating LLMs on Clarifying Ambiguous Requirements for Code Generation cites this paper.

ClarifyCodeBench: Evaluating LLMs on Clarifying Ambiguous Requirements for Code Generation When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-07-02T08:46:48.648730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fe9cb4ff-ad6e-4b67-b6d8-139a902c8018 · inbound

Underspecification does not imply Incoherence: The Risks of Semantic Collapse in Coding Models cites this paper.

Underspecification does not imply Incoherence: The Risks of Semantic Collapse in Coding Models When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-07-03T09:07:47.017340Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation b9f16e6d-8e35-411a-8ed3-6728eba63bfd · inbound

Guiding Human Validation of LLM-Generated Code via Verifiable Literate Programming cites this paper.

Guiding Human Validation of LLM-Generated Code via Verifiable Literate Programming When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 79

Resolution: verified exact; arxiv_id, observed 2026-07-03T08:47:49.713356Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation bb9764c9-2676-429e-8063-7ebddb3de03f · inbound

Obey, Diverge, Collapse: Blind Obedience to Incorrect Instructions Drives Code LLMs to Irrecoverable Code Semantic Collapse cites this paper.

Obey, Diverge, Collapse: Blind Obedience to Incorrect Instructions Drives Code LLMs to Irrecoverable Code Semantic Collapse When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 24

Resolution: unresolved; no resolver link, observed 2026-07-11T17:45:46.872944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 158d4e41-4d94-43b7-a6fc-b6a5bb766ec5 · inbound

From Failing to Passing: Evolving Natural Language Prompt Optimization Rules for LLM Code Generation cites this paper.

From Failing to Passing: Evolving Natural Language Prompt Optimization Rules for LLM Code Generation When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 18

Resolution: unresolved; no resolver link, observed 2026-07-11T08:31:24.850506Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1bd8e22d-9906-4da1-90b9-62a267294cc7 · inbound

On the risk of coding before testing: An empirical study on LLM-based test generation workflow cites this paper.

On the risk of coding before testing: An empirical study on LLM-based test generation workflow When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 51

Resolution: unresolved; no resolver link, observed 2026-07-11T08:12:23.512737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d2e8f86-3a11-4e4b-bc0e-b731365ec346 · inbound

Automatically Evolving Prompt Guidelines for Task-Specific Optimization cites this paper.

Automatically Evolving Prompt Guidelines for Task-Specific Optimization When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-02T14:46:30.803463Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c853259f-c273-4ff6-b6a2-3bac8e2e1e11 · inbound

AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation cites this paper.

AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-01T04:15:29.179347Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2b7984f4-f449-4cc1-9e8d-bd32b8930620 · inbound

VClare: Resolving Imperfect Specifications in LLM-Based Verilog Generation cites this paper.

VClare: Resolving Imperfect Specifications in LLM-Based Verilog Generation When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 9

Resolution: unresolved; no resolver link, observed 2026-07-30T23:35:19.791382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.