Paper Citation Record · LEDGER

A Survey on Large Language Models for Software Engineering

As of 22 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 43 inbound Pith citation observations for arXiv:2312.15223.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2312.15223 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 43 of 43 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 43 of 43 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T23:43:03.532981Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

20
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation ffbb15f7-061f-465c-80a3-38425854840e · inbound

Understanding the Human-LLM Dynamic: A Literature Survey of LLM Use in Programming Tasks cites this paper.

Understanding the Human-LLM Dynamic: A Literature Survey of LLM Use in Programming Tasks A Survey on Large Language Models for Software Engineering

Reference 118

Resolution: verified exact; arxiv_id, observed 2026-05-23T20:03:24.562213Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 70fc79db-910f-4c6e-8126-6da0f1b7abed · inbound

From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap cites this paper.

From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap A Survey on Large Language Models for Software Engineering

Reference 120

Resolution: verified exact; arxiv_id, observed 2026-05-23T19:08:20.825881Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 2bf00083-d83e-4912-aca8-56c16d7dbde9 · inbound

A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing cites this paper.

A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing A Survey on Large Language Models for Software Engineering

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-11T10:27:18.095127Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b82277a0-832a-4d4a-bc2d-419051c943db · inbound

An Empirical Study of OpenAI API Discussions on Stack Overflow cites this paper.

An Empirical Study of OpenAI API Discussions on Stack Overflow A Survey on Large Language Models for Software Engineering

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T23:43:03.532981Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8f3e5cd8-f27c-49e7-8132-932942846b61 · inbound

The Hitchhikers Guide to Production-ready Trustworthy Foundation Model powered Software (FMware) cites this paper.

The Hitchhikers Guide to Production-ready Trustworthy Foundation Model powered Software (FMware) A Survey on Large Language Models for Software Engineering

Reference 101

Resolution: unresolved; no resolver link, observed 2026-08-15T21:10:20.221850Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 70da6515-87b9-43a4-8b75-e567123e3668 · inbound

Augmenting the Generality and Performance of Large Language Models for Software Engineering cites this paper.

Augmenting the Generality and Performance of Large Language Models for Software Engineering A Survey on Large Language Models for Software Engineering

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T04:06:06.535514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7b743598-c7ce-4dea-8175-0ada8e673ef5 · inbound

Domain Specific Benchmarks for Evaluating Multimodal Large Language Models cites this paper.

Domain Specific Benchmarks for Evaluating Multimodal Large Language Models A Survey on Large Language Models for Software Engineering

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-07T00:39:41.708804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 223edb2d-2c6f-45f3-9dce-bb3a5841eeda · inbound

Large Language Models for Unit Testing: A Systematic Literature Review cites this paper.

Large Language Models for Unit Testing: A Systematic Literature Review A Survey on Large Language Models for Software Engineering

Reference 132

Resolution: unresolved; no resolver link, observed 2026-08-15T19:44:09.704583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e1ac520-9fb7-40dc-b8e1-122d1fe5485d · inbound

Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixing cites this paper.

Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixing A Survey on Large Language Models for Software Engineering

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T23:49:32.185848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 922fd222-78c0-4c03-9df7-a9437bc6a35a · inbound

Single Conversation Methodology: A Human-Centered Protocol for AI-Assisted Software Development cites this paper.

Single Conversation Methodology: A Human-Centered Protocol for AI-Assisted Software Development A Survey on Large Language Models for Software Engineering

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T16:44:48.588544Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1020ccb7-d440-4079-8376-c64cf6fc3fb6 · inbound

Curiosity by Design: An LLM-based Coding Assistant Asking Clarification Questions cites this paper.

Curiosity by Design: An LLM-based Coding Assistant Asking Clarification Questions A Survey on Large Language Models for Software Engineering

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-06T13:00:21.812410Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32cc27e7-3c02-46be-acf8-028e82a3843d · inbound

Foundational Design Principles and Patterns for Building Robust and Adaptive GenAI-Native Systems cites this paper.

Foundational Design Principles and Patterns for Building Robust and Adaptive GenAI-Native Systems A Survey on Large Language Models for Software Engineering

Reference 66

Resolution: verified exact; arxiv_id, observed 2026-05-18T22:11:52.616034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 2647388d-a6b5-40cf-99e2-278428cb5e66 · inbound

Robust Mottness and tunable interlayer magnetism in Nb3X8 (X = F, Cl, Br, I) bilayers cites this paper.

Robust Mottness and tunable interlayer magnetism in Nb3X8 (X = F, Cl, Br, I) bilayers A Survey on Large Language Models for Software Engineering

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-15T17:07:30.245184Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc87eaf0-14d0-4d6b-b06b-7f0fe32238f5 · inbound

CodeWiki: Evaluating AI's Ability to Generate Holistic Documentation for Large-Scale Codebases cites this paper.

CodeWiki: Evaluating AI's Ability to Generate Holistic Documentation for Large-Scale Codebases A Survey on Large Language Models for Software Engineering

Reference 55

Resolution: verified exact; arxiv_id, observed 2026-05-18T03:10:48.421794Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation d1d8c467-2b67-4f72-8a60-3867781a35f4 · inbound

REFLEX: Reference-Free Evaluation of Log Summarization via Large Language Model Judgment cites this paper.

REFLEX: Reference-Free Evaluation of Log Summarization via Large Language Model Judgment A Survey on Large Language Models for Software Engineering

Reference 22

Resolution: metadata mismatch; arxiv_id, observed 2026-05-18T00:25:32.304714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 1437cd39-7451-49c0-819e-d2ff845fe7a5 · inbound

SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios cites this paper.

SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios A Survey on Large Language Models for Software Engineering

Reference 66

Resolution: metadata mismatch; arxiv_id, observed 2026-05-16T20:28:24.502099Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f68f85b8-127d-4aee-8983-a4c2be468b9f · inbound

Compass vs Railway Tracks: Unpacking User Mental Models for Communicating Long-Horizon Work to Humans vs. AI cites this paper.

Compass vs Railway Tracks: Unpacking User Mental Models for Communicating Long-Horizon Work to Humans vs. AI A Survey on Large Language Models for Software Engineering

Reference 94

Resolution: verified exact; arxiv_id, observed 2026-05-16T14:11:01.164814Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a0ec409a-12a8-489a-8fdf-505ac8efdfdf · inbound

RubberDuckBench: A Benchmark for AI Coding Assistants cites this paper.

RubberDuckBench: A Benchmark for AI Coding Assistants A Survey on Large Language Models for Software Engineering

Reference 40

Resolution: verified exact; arxiv_id, observed 2026-05-16T12:17:51.971308Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a69ee99f-f13d-41b1-8892-d6d00eaa08db · inbound

SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair cites this paper.

SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair A Survey on Large Language Models for Software Engineering

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-02T20:17:27.079893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 026ca23e-c9ea-4337-9dff-acd4d91b31eb · inbound

Story Point Estimation Using Large Language Models cites this paper.

Story Point Estimation Using Large Language Models A Survey on Large Language Models for Software Engineering

Reference 19

Resolution: metadata mismatch; arxiv_id, observed 2026-05-15T15:30:07.562929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 1fd2bb31-d794-4491-a447-aa8bc2969935 · inbound

Do Papers Tell the Whole Story? A Benchmark and Framework for Uncovering Hidden Implementation Gaps in Bioinformatics cites this paper.

Do Papers Tell the Whole Story? A Benchmark and Framework for Uncovering Hidden Implementation Gaps in Bioinformatics A Survey on Large Language Models for Software Engineering

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-15T00:38:23.567952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 45da1c34-170c-417d-b1c6-30d208aee8a0 · inbound

Compiling Code LLMs into Lightweight Executables cites this paper.

Compiling Code LLMs into Lightweight Executables A Survey on Large Language Models for Software Engineering

Reference 78

Resolution: verified exact; arxiv_id, observed 2026-05-13T23:28:26.260158Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 71a8e295-9335-4204-80c6-e6024d8e1c66 · inbound

REAgent: Requirement-Driven LLM Agents for Software Issue Resolution cites this paper.

REAgent: Requirement-Driven LLM Agents for Software Issue Resolution A Survey on Large Language Models for Software Engineering

Reference 87

Resolution: verified exact; arxiv_id, observed 2026-05-11T05:50:58.076905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation bf7360f6-ffff-437e-9525-c5a0aed0181d · inbound

Do AI Coding Agents Log Like Humans? An Empirical Study cites this paper.

Do AI Coding Agents Log Like Humans? An Empirical Study A Survey on Large Language Models for Software Engineering

Reference 41

Resolution: verified exact; arxiv_id, observed 2026-05-11T07:55:59.727704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a4ef902d-9121-49d2-97fb-39d1144beaae · inbound

Towards Enabling An Artificial Self-Construction Software Life-cycle via Autopoietic Architectures cites this paper.

Towards Enabling An Artificial Self-Construction Software Life-cycle via Autopoietic Architectures A Survey on Large Language Models for Software Engineering

Reference 73

Resolution: verified exact; arxiv_id, observed 2026-05-11T11:41:05.448444Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f3744092-7dfc-4528-a72d-5e1d54065a7b · inbound

Bias in the Loop: Auditing LLM-as-a-Judge for Software Engineering cites this paper.

Bias in the Loop: Auditing LLM-as-a-Judge for Software Engineering A Survey on Large Language Models for Software Engineering

Reference 33

Resolution: verified exact; arxiv_id, observed 2026-05-10T07:32:00.306070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 5124e12d-4344-4af7-87fe-96f8ce582915 · inbound

Query2Diagram: Answering Developer Queries with UML Diagrams cites this paper.

Query2Diagram: Answering Developer Queries with UML Diagrams A Survey on Large Language Models for Software Engineering

Reference 46

Resolution: verified exact; arxiv_id, observed 2026-05-11T21:16:30.619127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 6ea19e9e-0411-4b04-a510-29ba0bf18736 · inbound

Evaluation of LLM-Based Software Engineering Tools: Practices, Challenges, and Future Directions cites this paper.

Evaluation of LLM-Based Software Engineering Tools: Practices, Challenges, and Future Directions A Survey on Large Language Models for Software Engineering

Reference 44

Resolution: verified exact; arxiv_id, observed 2026-05-11T22:21:52.909407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation e1a0ad46-63b5-4fa7-80a2-25d45d26a5d9 · inbound

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code cites this paper.

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code A Survey on Large Language Models for Software Engineering

Reference 149

Resolution: verified exact; arxiv_id, observed 2026-05-11T17:21:11.036793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ab5153ef-de28-4181-92ec-688f76d4ce29 · inbound

Contextualized Code Pretraining for Code Generation cites this paper.

Contextualized Code Pretraining for Code Generation A Survey on Large Language Models for Software Engineering

Reference 52

Resolution: verified exact; arxiv_id, observed 2026-05-20T09:38:10.858949Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ec7251d9-cbec-4e39-993a-98196741234f · inbound

How Helpful is LLM Assistance in Network Operations? A Case Study at a Large Demonstration Network cites this paper.

How Helpful is LLM Assistance in Network Operations? A Case Study at a Large Demonstration Network A Survey on Large Language Models for Software Engineering

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-05-20T02:33:20.379967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 8d2941f7-2477-4623-aeb5-ffcf19ef1858 · inbound

Security of LLM-generated Code: A Comparative Analysis cites this paper.

Security of LLM-generated Code: A Comparative Analysis A Survey on Large Language Models for Software Engineering

Reference 87

Resolution: verified exact; arxiv_id, observed 2026-05-25T05:16:39.203527Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 6a28a020-4e85-49b8-9ed4-6bb6738c8b4b · inbound

A Tertiary Review of Large Language Model-Based Code Generating Tasks: Trends, Challenges, and Future Directions cites this paper.

A Tertiary Review of Large Language Model-Based Code Generating Tasks: Trends, Challenges, and Future Directions A Survey on Large Language Models for Software Engineering

Reference 108

Resolution: verified exact; arxiv_id, observed 2026-06-29T20:53:58.474013Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 6ec09bf8-d539-4e28-874a-a9c3e47e0d2c · inbound

Projectional Decoding: Towards Semantic-Aware LLM Generation cites this paper.

Projectional Decoding: Towards Semantic-Aware LLM Generation A Survey on Large Language Models for Software Engineering

Reference 42

Resolution: verified exact; arxiv_id, observed 2026-06-29T06:23:09.147704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f4503bf5-42aa-4685-b731-d204a1008707 · inbound

Empirical Evaluation of Large Language Models for Migration of Code Fragments to Post-Quantum Cryptography cites this paper.

Empirical Evaluation of Large Language Models for Migration of Code Fragments to Post-Quantum Cryptography A Survey on Large Language Models for Software Engineering

Reference 49

Resolution: verified exact; arxiv_id, observed 2026-07-02T17:47:17.810720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 85203f2f-4e3c-424a-8415-38cc613c9944 · inbound

Accuracy and Satisfaction in Multi-Turn LLM Dialogues for NFR Assessment cites this paper.

Accuracy and Satisfaction in Multi-Turn LLM Dialogues for NFR Assessment A Survey on Large Language Models for Software Engineering

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-07-04T18:00:00.892534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 8e99629f-39d5-4ff6-bc8e-63e107f7ca45 · inbound

LibEvoBench: Probing Temporal Knowledge Stratification in Code Generation Models cites this paper.

LibEvoBench: Probing Temporal Knowledge Stratification in Code Generation Models A Survey on Large Language Models for Software Engineering

Reference 60

Resolution: verified exact; arxiv_id, observed 2026-06-25T21:18:24.666965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 352d19a0-72a1-45eb-8a9c-9e08924cd576 · inbound

Test Case Selection for Deep Neural Networks: A Replication Study on LLMs for Code cites this paper.

Test Case Selection for Deep Neural Networks: A Replication Study on LLMs for Code A Survey on Large Language Models for Software Engineering

Reference 74

Resolution: verified exact; arxiv_id, observed 2026-06-29T00:52:55.666815Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 4f2dbd20-c969-4139-be9e-eddea92487b0 · inbound

MOA: A Profiling-Guided LLM Framework for Memory-Optimization Automation at Codebase Scale cites this paper.

MOA: A Profiling-Guided LLM Framework for Memory-Optimization Automation at Codebase Scale A Survey on Large Language Models for Software Engineering

Reference 46

Resolution: verified exact; arxiv_id, observed 2026-07-01T11:35:43.220845Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 352f3fc0-4fd3-46bf-b7e0-be3925cc87a5 · inbound

LLM-Driven CI-CD Workflow Intelligence for Cyber Systems Engineering cites this paper.

LLM-Driven CI-CD Workflow Intelligence for Cyber Systems Engineering A Survey on Large Language Models for Software Engineering

Reference 27

Resolution: unresolved; no resolver link, observed 2026-07-11T16:58:30.448675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35f7f928-2dfa-4f77-a0d6-9b03a13aa7b9 · inbound

Multi-Agent LLM Collaboration for Unit Test Generation via Human-Testing-Inspired Workflows cites this paper.

Multi-Agent LLM Collaboration for Unit Test Generation via Human-Testing-Inspired Workflows A Survey on Large Language Models for Software Engineering

Reference 23

Resolution: unresolved; no resolver link, observed 2026-07-13T05:24:45.090529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 382d5751-5475-4de1-aadb-d619fdf2571c · inbound

TraceDev: A Traceability-Driven Multi-agent Framework for Requirement-to-Code Development cites this paper.

TraceDev: A Traceability-Driven Multi-agent Framework for Requirement-to-Code Development A Survey on Large Language Models for Software Engineering

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-01T14:04:57.781449Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61578d99-bcf4-477f-ae9d-89d25175face · inbound

Large Language Models for Software Engineering Diagrams: A Systematic Review of UML and ER modelling cites this paper.

Large Language Models for Software Engineering Diagrams: A Systematic Review of UML and ER modelling A Survey on Large Language Models for Software Engineering

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-01T02:49:55.174933Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.