Pith. sign in

Paper Citation Record · LEDGER

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models

As of 9 August 2026, this Paper Citation Record lists 23 of 23 outbound references and 2 inbound Pith citation observations for arXiv:2502.06039.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.06039 v1

Coverage vector

measured 23 of 23 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T17:00:30.502504Z

measured 25 of 25 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T18:41:18.266271Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

23 of 23 outbound references displayed

  • verified exact0
  • verified fuzzy14
  • unresolved7
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a3a855af-b95d-4b38-bbb6-fa99390cd2ed · outbound

This paper cites Do users write more insecure code with ai assistants?.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Do users write more insecure code with ai assistants?

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-08T17:00:30.424474Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T17:00:30.424474Z digest=sha256:f9862ec7201db7a97248d073473d44bd8f7fdce6bfd32d391c1d203b6c216edc

Observation e6817bca-ce47-40cd-a6b9-bbac6c595fc6 · outbound

This paper cites A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-08T17:00:30.428292Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T17:00:30.428292Z digest=sha256:038d2cf0ad5154483eb3844a086c85a53d9b3fddf324457de9d573a1723ad54e

Observation 94da71c1-07be-4b2e-8c93-73439d4d942c · outbound

This paper cites Llmseceval: A dataset of natural language prompts for security evaluations,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Llmseceval: A dataset of natural language prompts for security evaluations,

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.903664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.432535Z digest=sha256:96f7d7e6fbac51201d05dbdbe7d05e873823388896b17741f05ddfe26243197e

Observation 0195563c-8341-4d13-a7fe-67b9a87a9060 · outbound

This paper cites Securityeval dataset: mining vulnerability examples to evaluate machine learning-based code generation techniques,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Securityeval dataset: mining vulnerability examples to evaluate machine learning-based code generation techniques,

Reference 4

Resolution
malformed identifier
doi_truncated, observed 2026-08-08T17:00:30.533448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.436487Z digest=sha256:275b82ee0d4b359558bb9abb9e4947bb8a7f5c77f03c88ccf9a235d48fb5e2fd

Observation 61cd14df-9602-4338-9e02-688cc7c10dff · outbound

This paper cites find bug variants with patterns that look like source code.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models find bug variants with patterns that look like source code

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.894366Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.440815Z digest=sha256:e2e469de4ba2c6b98fe8cd450afe9ac781fcb6a6c363e7fec980a2e89669253c

Observation e44c594f-6f4d-4a7d-82db-ca8dc16d0851 · outbound

This paper cites an unresolved cited work.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-08T17:00:30.884908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.444731Z digest=sha256:193f4d27983b8f6984e8b1da9bb24a1cf9021cafb0e43c5e0ca688d7a33432f7

Observation 8d6dd596-0f46-4873-b478-2d286e71d9e6 · outbound

This paper cites Security Weaknesses of Copilot-Generated Code in GitHub Projects: An Empirical Study.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Security Weaknesses of Copilot-Generated Code in GitHub Projects: An Empirical Study

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T17:00:30.448721Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T17:00:30.448721Z digest=sha256:74e40513ff97e3f928dac03e9dcd09fa2f4c971138456f58f97af74559b857a3

Observation e527895d-dd42-4076-83d5-c76061acfa99 · outbound

This paper cites Asleep at the keyboard? assessing the security of github copilot’s code contributions,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Asleep at the keyboard? assessing the security of github copilot’s code contributions,

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.875332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.452922Z digest=sha256:a31ef3db744ab47744177106869a27323105b0a79e2d3186a70deaaa618c1920

Observation 40fc6567-0669-4cad-8e63-d286c876512b · outbound

This paper cites How secure is code generated by chatgpt?.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models How secure is code generated by chatgpt?

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.865601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.456529Z digest=sha256:2ee3fa784769437e1d4c0dbbe9becc746f6d1f9335b91413d9475d3bfbf35c0a

Observation ad637ca4-12c8-44a0-b4aa-c4921128ea8a · outbound

This paper cites [Online].

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models [Online]

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.856238Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.460295Z digest=sha256:b13b1d36a031b9e9fcfb2907725c60e1c9b4dcc5f53439d97abd6bd9099f6ba3

Observation 3e89f275-13dc-49a2-8358-52d8b34ab118 · outbound

This paper cites Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-08T17:00:30.464049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T17:00:30.464049Z digest=sha256:72acab5b3a1b6b50dc9c606f430eee62d2e7687b5734915364cb3576291220cc

Observation bf89ba3a-87da-4c2c-983b-1add75420d1e · outbound

This paper cites Original-date: 2021-09-30T16:06:12Z.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Original-date: 2021-09-30T16:06:12Z

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.846712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.467834Z digest=sha256:f238fd2a5f9754332ba1c1c629841b802a94dcdebb4e0ad35a77a0f3af88bd39

Observation 848f49fe-884f-49cc-b185-3f1c7d932551 · outbound

This paper cites Time to separate from stackoverflow and match with chatgpt for encryption,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Time to separate from stackoverflow and match with chatgpt for encryption,

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.837505Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.471049Z digest=sha256:24085360f4f2cff91ec353c7a61e880b5e2a16c0ac98016d967a32e3629972a0

Observation 4a62ff18-4144-4c7f-83d2-93a00c91306b · outbound

This paper cites Chatgpt’s potential in cryptography misuse detection: A compara- tive analysis with static analysis tools,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Chatgpt’s potential in cryptography misuse detection: A compara- tive analysis with static analysis tools,

Reference 14

Resolution
metadata mismatch
raw_fallback, observed 2026-08-08T17:00:30.659880Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.476952Z digest=sha256:251cbb6fc68bd07896ba902f5ec92aae39da3cde5ad10336171e2ce34a6d5759

Observation 6b4bbb02-05f1-4d65-a38b-885ee715680a · outbound

This paper cites Prompting Techniques for Secure Code Generation: A Systematic Investigation.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Prompting Techniques for Secure Code Generation: A Systematic Investigation

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-08T17:00:30.480022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T17:00:30.480022Z digest=sha256:c47861fc6449413005edf9c1ff76f7a46e4f5671f553836bdcfd98264d2d5b4c

Observation a851e3c6-22a2-4084-8903-793b80e2fb8f · outbound

This paper cites Purplellama codeshield,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Purplellama codeshield,

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.817234Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.483183Z digest=sha256:b96166fe2b5d117be2841be15e1160d8619a2e17ead37acb4437479a428ef6d4

Observation fc6f1deb-a487-4314-acbc-b6c798abfd91 · outbound

This paper cites Llm security guard for code,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Llm security guard for code,

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.806053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.486186Z digest=sha256:35c8c43ca27216d41f07d9c4f9d508a73ad7121a8d81e86a04c6510e199438cf

Observation dc357e86-6ef7-406e-8759-94dda40dc5d7 · outbound

This paper cites GitHub Copilot Chat and pull request summaries are now powered by GPT-4o · GitHub Changelog,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models GitHub Copilot Chat and pull request summaries are now powered by GPT-4o · GitHub Changelog,

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.782871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.492431Z digest=sha256:43fca2a04c9f3ca742edb1afc53b4d659305b4feaaab3b2636280c9d8f1b7feb

Observation 8407446b-5ffd-4074-8534-5cb6d257f681 · outbound

This paper cites Available: https://api.semanticscholar.or g/CorpusID:269502004.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Available: https://api.semanticscholar.or g/CorpusID:269502004

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.794592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.489224Z digest=sha256:d6cd61206d499a2bd5d3602df483fc6b9665338187e45d6ebff2289dee7d1a28

Observation 34acae99-0fca-4852-9386-4adb322ccafd · outbound

This paper cites Betterchatgpt,.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Betterchatgpt,

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.759530Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.502504Z digest=sha256:cda283b79d523dc035c3c1ebb1d20562b532c9b283c3590378e0eb615003b9ad

Observation f8018117-2623-4ea0-abfa-17d93060d32b · outbound

This paper cites Available: https://github.blog/changelo g/2024-07-31-github-copilot-chat-and-pull-request-sum maries-are-now-powered-by-gpt-4o/.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Available: https://github.blog/changelo g/2024-07-31-github-copilot-chat-and-pull-request-sum maries-are-now-powered-by-gpt-4o/

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.772147Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.496003Z digest=sha256:9aa05369ba40611229f373f8eb2a06d8e19ba92a4ba3db863be8f00ff97e8ba9

Observation f09206d3-a19c-45a9-aa1f-f86038d13837 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Evaluating Large Language Models Trained on Code

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-08T17:00:30.498975Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T17:00:30.498975Z digest=sha256:90ca6fff8813e03aa911442d768373682837ee635667d2f5a5b91c9a36441445

Observation ffca8383-e35a-4c57-a6a6-d28c8b9a6d1e · outbound

This paper cites Available: https://arxiv.org/abs/2406.061 64.

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Available: https://arxiv.org/abs/2406.061 64

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T17:00:30.827903Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T17:00:30.474073Z digest=sha256:7e041a7e0ef2558dca75aa8b108fff7f0b04bfaeb88cc1923f2f1ecbe68c3c60

Pith citing papers

Observation 2f3baa25-29d5-4bc0-863f-78f3f5d84b53 · inbound

WildCode Revisited: A Comprehensive Empirical Study on the Security of LLM-Generated Code cites this paper.

WildCode Revisited: A Comprehensive Empirical Study on the Security of LLM-Generated Code Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-03T18:41:18.266271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T18:41:18.266271Z digest=sha256:71517000b592b7af6558944398116bea0c0468e314eb963332e58ee91b4ecd3e

Observation bd1eae40-6734-4481-9eed-29c9891ec775 · inbound

The Illusion of Secure LLM Code: Closing the Security Gap via Iterative Reprompting cites this paper.

The Illusion of Secure LLM Code: Closing the Security Gap via Iterative Reprompting Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-07-30T15:13:30.346665Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-30T15:13:30.346665Z digest=sha256:f343070368db7ab50cb88aca9807cddf42287c332fc49e153b3906147b402c84