Paper Citation Record · LEDGER

Large Language Models for Software Engineering: A Systematic Literature Review

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 43 inbound Pith citation observations for arXiv:2308.10620.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2308.10620 v6

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 43 of 43 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 43 of 43 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:38:21.776451Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

116
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 58b65e0e-10f7-4313-8b3a-2c5aef213568 · inbound

Exploring Code Analysis: Zero-Shot Insights on Syntax and Semantics with LLMs cites this paper.

Exploring Code Analysis: Zero-Shot Insights on Syntax and Semantics with LLMs Large Language Models for Software Engineering: A Systematic Literature Review

Reference 39

Resolution: verified exact; arxiv_id, observed 2026-05-24T08:14:10.396065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 92cc1d46-845a-405f-aff6-5e49ba2d32d2 · inbound

CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology cites this paper.

CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology Large Language Models for Software Engineering: A Systematic Literature Review

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-24T03:58:51.165127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fce6a6c5-45b7-4da0-8bb1-703455ba3d94 · inbound

StarCoder 2 and The Stack v2: The Next Generation cites this paper.

StarCoder 2 and The Stack v2: The Next Generation Large Language Models for Software Engineering: A Systematic Literature Review

Reference 214

Resolution: metadata mismatch; arxiv_id, observed 2026-05-12T17:28:22.818724Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 963744e9-fd3d-42d8-8c3d-26803208c635 · inbound

A Survey on Large Language Models for Code Generation cites this paper.

A Survey on Large Language Models for Code Generation Large Language Models for Software Engineering: A Systematic Literature Review

Reference 102

Resolution: verified exact; arxiv_id, observed 2026-05-13T20:18:06.526885Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 8b981a48-9616-4e36-bed4-85af95f0e189 · inbound

Towards Agentic Runtime Healing cites this paper.

Towards Agentic Runtime Healing Large Language Models for Software Engineering: A Systematic Literature Review

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-05-23T22:15:50.013465Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e7ffdd6e-a690-447d-a287-0745da9f861f · inbound

PatchTrack: A Comprehensive Analysis of ChatGPT's Influence on Pull Request Outcomes cites this paper.

PatchTrack: A Comprehensive Analysis of ChatGPT's Influence on Pull Request Outcomes Large Language Models for Software Engineering: A Systematic Literature Review

Reference 36

Resolution: verified exact; arxiv_id, observed 2026-05-22T16:14:58.884871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ca58a551-d335-44ba-9eb6-312449d84261 · inbound

Knowledge Graph Based Repository-Level Code Generation cites this paper.

Knowledge Graph Based Repository-Level Code Generation Large Language Models for Software Engineering: A Systematic Literature Review

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T15:38:21.776451Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4974d9a7-0bc3-4e05-acd1-80d4f69be230 · inbound

Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects cites this paper.

Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects Large Language Models for Software Engineering: A Systematic Literature Review

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T15:29:07.891230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 024347ab-f9a1-48f7-9775-dc1269507ec0 · inbound

A Comprehensive Study on the Use of Word Embedding Models in Software Engineering Domain cites this paper.

A Comprehensive Study on the Use of Word Embedding Models in Software Engineering Domain Large Language Models for Software Engineering: A Systematic Literature Review

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-07T14:46:00.136973Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32113471-a8b7-4923-9850-9af0f4475126 · inbound

LLM Performance for Code Generation on Noisy Tasks cites this paper.

LLM Performance for Code Generation on Noisy Tasks Large Language Models for Software Engineering: A Systematic Literature Review

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T12:45:40.068254Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e12d899e-0bb8-419c-b6e8-58920b7b3028 · inbound

Evaluating the Performance and Efficiency of Sentence-BERT for Code Comment Classification cites this paper.

Evaluating the Performance and Efficiency of Sentence-BERT for Code Comment Classification Large Language Models for Software Engineering: A Systematic Literature Review

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-07T05:12:42.933953Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5eb7935-f47c-4b0b-898b-7f69faa644b8 · inbound

ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Space cites this paper.

ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Space Large Language Models for Software Engineering: A Systematic Literature Review

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-07T04:39:48.969431Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5a6ed35a-4553-4f53-a659-76f2ebaf4d85 · inbound

Augmenting the Generality and Performance of Large Language Models for Software Engineering cites this paper.

Augmenting the Generality and Performance of Large Language Models for Software Engineering Large Language Models for Software Engineering: A Systematic Literature Review

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-07T04:06:06.446728Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e662d74-7016-482e-a020-4bf0e1743a1c · inbound

The role of large language models in UI/UX design: A systematic literature review cites this paper.

The role of large language models in UI/UX design: A systematic literature review Large Language Models for Software Engineering: A Systematic Literature Review

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-06T19:49:17.301964Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f5ee6666-9f37-46e1-a914-ed438125c404 · inbound

Static Analysis as a Feedback Loop: Enhancing LLM-Generated Code Beyond Correctness cites this paper.

Static Analysis as a Feedback Loop: Enhancing LLM-Generated Code Beyond Correctness Large Language Models for Software Engineering: A Systematic Literature Review

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-05T18:40:05.627097Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 74c7d181-b0d7-4632-bae3-d44f585b9bae · inbound

EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention cites this paper.

EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention Large Language Models for Software Engineering: A Systematic Literature Review

Reference 22

Resolution: malformed identifier; arxiv_id, observed 2026-05-18T20:56:51.796198Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 03e06574-ea5d-41aa-84a1-e53e7ac8e4ac · inbound

Symphony: A Decentralized Multi-Agent Framework for Scalable Collective Intelligence cites this paper.

Symphony: A Decentralized Multi-Agent Framework for Scalable Collective Intelligence Large Language Models for Software Engineering: A Systematic Literature Review

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-05T15:18:04.596443Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e27745e-8c82-47a2-be16-1ba00ef53074 · inbound

Development of Automated Software Design Document Review Methods Using Large Language Models cites this paper.

Development of Automated Software Design Document Review Methods Using Large Language Models Large Language Models for Software Engineering: A Systematic Literature Review

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-04T18:26:17.786155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32817274-bbab-48c5-96f1-77f8fb489bbe · inbound

Neurosymbolic Characterization for Reliable Access Control Policy Analysis cites this paper.

Neurosymbolic Characterization for Reliable Access Control Policy Analysis Large Language Models for Software Engineering: A Systematic Literature Review

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-04T08:28:59.282250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3f0c45f9-9b90-4ae2-a54e-c43e527117b7 · inbound

From Competition to Collaboration: Designing Sustainable Mechanisms Between LLMs and Online Forums cites this paper.

From Competition to Collaboration: Designing Sustainable Mechanisms Between LLMs and Online Forums Large Language Models for Software Engineering: A Systematic Literature Review

Reference 26

Resolution: metadata mismatch; arxiv_id, observed 2026-05-16T07:47:33.209534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 733eddb8-9708-4607-8e36-06df871ad089 · inbound

Comparing AI Coding Agents: A Task-Stratified Analysis of Pull Request Acceptance cites this paper.

Comparing AI Coding Agents: A Task-Stratified Analysis of Pull Request Acceptance Large Language Models for Software Engineering: A Systematic Literature Review

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-16T05:27:23.155421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 40b3328d-0721-40a8-afbe-a236deac92f2 · inbound

SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair cites this paper.

SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair Large Language Models for Software Engineering: A Systematic Literature Review

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T20:17:26.823662Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e757045-7894-4665-b5e7-adb4d597c79f · inbound

Story Point Estimation Using Large Language Models cites this paper.

Story Point Estimation Using Large Language Models Large Language Models for Software Engineering: A Systematic Literature Review

Reference 18

Resolution: metadata mismatch; arxiv_id, observed 2026-05-15T15:30:07.568241Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation eaa4c4d7-6f1c-44b4-b9d5-eb68861a47b4 · inbound

An End-to-End Approach for Fixing Concurrency Bugs via SHB-Based Context Extractor cites this paper.

An End-to-End Approach for Fixing Concurrency Bugs via SHB-Based Context Extractor Large Language Models for Software Engineering: A Systematic Literature Review

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-05-10T23:05:49.735964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d974bb2b-b5af-4156-b016-c7dc292b7231 · inbound

Fairness in Multi-Agent Systems for Software Engineering: An SDLC-Oriented Rapid Review cites this paper.

Fairness in Multi-Agent Systems for Software Engineering: An SDLC-Oriented Rapid Review Large Language Models for Software Engineering: A Systematic Literature Review

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-11T07:26:00.812227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 053d8230-1adf-4e5b-a991-b9883a1004a6 · inbound

VeriGraphi: A Multi-Agent Framework of Hierarchical RTL Generation for Large Hardware Designs cites this paper.

VeriGraphi: A Multi-Agent Framework of Hierarchical RTL Generation for Large Hardware Designs Large Language Models for Software Engineering: A Systematic Literature Review

Reference 1

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T09:33:41.306803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 34050579-9297-4051-a37a-2a44baf507f0 · inbound

AI Observability for Developer Productivity Tools: Bridging Cost Awareness and Code Quality cites this paper.

AI Observability for Developer Productivity Tools: Bridging Cost Awareness and Code Quality Large Language Models for Software Engineering: A Systematic Literature Review

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-10T06:11:20.363745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation cc599e4a-241a-44c5-a4df-cfb488a53adf · inbound

A Quasi-Experimental Developer Study of Security Training in LLM-Assisted Web Application Development cites this paper.

A Quasi-Experimental Developer Study of Security Training in LLM-Assisted Web Application Development Large Language Models for Software Engineering: A Systematic Literature Review

Reference 1

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T09:28:39.213943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a04c0624-fd0e-44af-a889-afc9e10886d2 · inbound

Do Agents Dream of Root Shells? Partial-Credit Evaluation of LLM Agents in Capture the Flag Challenges cites this paper.

Do Agents Dream of Root Shells? Partial-Credit Evaluation of LLM Agents in Capture the Flag Challenges Large Language Models for Software Engineering: A Systematic Literature Review

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-05-10T02:38:17.356926Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation eff0b7c3-63a6-45f4-a25c-c796059e5077 · inbound

RepoDoc: A Knowledge Graph-Based Framework to Automatic Documentation Generation and Incremental Updates cites this paper.

RepoDoc: A Knowledge Graph-Based Framework to Automatic Documentation Generation and Incremental Updates Large Language Models for Software Engineering: A Systematic Literature Review

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-05-12T09:16:27.930859Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 384eeb16-a467-4bc9-afb9-fce0ce240207 · inbound

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation cites this paper.

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation Large Language Models for Software Engineering: A Systematic Literature Review

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-12T09:36:25.869818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 6ea9e117-ce83-47d7-ab52-cbfef8ab3290 · inbound

Correctness-Aware Repository Filtering Under Maximum Effective Context Window Constraints cites this paper.

Correctness-Aware Repository Filtering Under Maximum Effective Context Window Constraints Large Language Models for Software Engineering: A Systematic Literature Review

Reference 18

Resolution: metadata mismatch; arxiv_id, observed 2026-05-15T02:38:34.597337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 1d47b72d-fde6-4832-a7e9-0a352cb71fda · inbound

Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study cites this paper.

Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study Large Language Models for Software Engineering: A Systematic Literature Review

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-05-22T03:54:34.034891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 7a49d6c0-f6bd-4610-9823-70c1695562f0 · inbound

An Empirical Evaluation of LLM-Generated Code Security Across Prompting Methods cites this paper.

An Empirical Evaluation of LLM-Generated Code Security Across Prompting Methods Large Language Models for Software Engineering: A Systematic Literature Review

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-06-30T15:34:48.536714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ef5dc589-ff48-493d-979b-8d6731c16830 · inbound

Characterizing initial human-AI proof formalization workflows cites this paper.

Characterizing initial human-AI proof formalization workflows Large Language Models for Software Engineering: A Systematic Literature Review

Reference 64

Resolution: verified exact; arxiv_id, observed 2026-07-02T04:06:34.778577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fbe21da0-c42a-4690-80f8-b9061a8657f6 · inbound

Description-Code Inconsistency in Real-world MCP Servers: Measurement, Detection, and Security Implications cites this paper.

Description-Code Inconsistency in Real-world MCP Servers: Measurement, Detection, and Security Implications Large Language Models for Software Engineering: A Systematic Literature Review

Reference 23

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T08:36:47.836172Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f38378b4-b2ca-4635-b163-b8f86a3b2d6e · inbound

TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management cites this paper.

TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management Large Language Models for Software Engineering: A Systematic Literature Review

Reference 18

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T13:06:59.140932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 063392e4-8686-4c0b-a01d-75cefa03c333 · inbound

TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management cites this paper.

TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management Large Language Models for Software Engineering: A Systematic Literature Review

Reference 17

Resolution: unresolved; no resolver link, observed 2026-07-12T15:01:23.012119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5d7271d-4a89-4a50-aa98-ffb3fdfa1bbe · inbound

What makes a harness a harness: necessary and sufficient conditions for an agent harness cites this paper.

What makes a harness a harness: necessary and sufficient conditions for an agent harness Large Language Models for Software Engineering: A Systematic Literature Review

Reference 18

Resolution: metadata mismatch; arxiv_id, observed 2026-06-27T19:31:10.857984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation dd08e9a1-43b7-49c9-9e7f-7817c973ba2f · inbound

Qiskit Code Migration with LLMs cites this paper.

Qiskit Code Migration with LLMs Large Language Models for Software Engineering: A Systematic Literature Review

Reference 109

Resolution: verified exact; arxiv_id, observed 2026-06-26T16:29:35.795455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 2af7b620-17cb-400b-b79f-3ce92f3fb208 · inbound

Test Case Selection for Deep Neural Networks: A Replication Study on LLMs for Code cites this paper.

Test Case Selection for Deep Neural Networks: A Replication Study on LLMs for Code Large Language Models for Software Engineering: A Systematic Literature Review

Reference 32

Resolution: verified exact; arxiv_id, observed 2026-06-29T00:52:55.668122Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 41803b1f-4364-43cd-a182-8b4c4b8c3eb4 · inbound

Towards Automated Formal Verification of zkEVMs Using LLM-Guided Constraint Synthesis cites this paper.

Towards Automated Formal Verification of zkEVMs Using LLM-Guided Constraint Synthesis Large Language Models for Software Engineering: A Systematic Literature Review

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-01T11:47:34.991122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f664027a-b4da-4d11-8713-93be1639e024 · inbound

MultiFixer: A Coordinator-Proposer Based Multi-Agent Framework For Fixing Multi-Hunk Bugs cites this paper.

MultiFixer: A Coordinator-Proposer Based Multi-Agent Framework For Fixing Multi-Hunk Bugs Large Language Models for Software Engineering: A Systematic Literature Review

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-01T12:46:59.047354Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.