Paper Citation Record · LEDGER

An Empirical Study of the Non-determinism of ChatGPT in Code Generation

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 11 inbound Pith citation observations for arXiv:2308.02828.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2308.02828 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T12:58:05.623259Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-24T03:55:59.649374Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation f03f1396-e185-44d4-9960-42fa563fa4db · inbound

CodeMind: Evaluating Large Language Models for Code Reasoning cites this paper.

CodeMind: Evaluating Large Language Models for Code Reasoning An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 45

Resolution: verified exact; arxiv_id, observed 2026-05-24T03:55:59.653750Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 062d7830-b111-4850-9aa7-cd55e6fb166f · inbound

On Iterative Evaluation and Enhancement of Code Quality Using GPT-4o cites this paper.

On Iterative Evaluation and Enhancement of Code Quality Using GPT-4o An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-08T12:58:05.623259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9521dc3-06bb-487f-ad55-40d14889c3dc · inbound

Theoretical Benefit and Limitation of Diffusion Language Model cites this paper.

Theoretical Benefit and Limitation of Diffusion Language Model An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-07T20:56:23.111096Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fbffb1b7-0c94-4fd5-960f-8daa18b15ed9 · inbound

Knowledge-Enhanced Program Repair for Data Science Code cites this paper.

Knowledge-Enhanced Program Repair for Data Science Code An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-07T20:37:30.787061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4aca4d47-e4b5-4494-8911-32ae20c3b70b · inbound

Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects cites this paper.

Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-07T15:29:06.864738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5cce1f86-dc76-4c07-9735-5c24990f59cb · inbound

Fault Localisation and Repair for DL Systems: An Empirical Study with LLMs cites this paper.

Fault Localisation and Repair for DL Systems: An Empirical Study with LLMs An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-07T11:10:32.049198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 974da0fe-cf1f-4843-85a9-b7f554ac70dc · inbound

Synthetic Heuristic Evaluation: A Comparison between AI- and Human-Powered Usability Evaluation cites this paper.

Synthetic Heuristic Evaluation: A Comparison between AI- and Human-Powered Usability Evaluation An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-06T20:38:56.675833Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation edcfbdb7-c434-4a4d-a75a-b37ee0f7422a · inbound

Compiled AI: Deterministic Code Generation for LLM-Based Workflow Automation cites this paper.

Compiled AI: Deterministic Code Generation for LLM-Based Workflow Automation An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 12

Resolution: verified exact; arxiv_id, observed 2026-05-10T23:40:51.582602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1d1cc71e-c609-41cd-be06-c078ef862029 · inbound

Co-Located Tests, Better AI Code: How Test Syntax Structure Affects Foundation Model Code Generation cites this paper.

Co-Located Tests, Better AI Code: How Test Syntax Structure Affects Foundation Model Code Generation An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 22

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T12:01:05.205896Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 8605fe87-f9ce-485e-a020-e9a7974deccc · inbound

Introducing Background Temperature to Characterise Hidden Randomness in Large Language Models cites this paper.

Introducing Background Temperature to Characterise Hidden Randomness in Large Language Models An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 7

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T19:21:07.514412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation bf75eb89-5d89-4956-8e2c-226473f03b92 · inbound

Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answers cites this paper.

Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answers An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-02T05:40:05.494011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.