Pith. sign in

Paper Citation Record · LEDGER

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems

As of 10 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 1 inbound Pith citation observation for arXiv:2508.03931.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.03931 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T01:07:40.389625Z

measured 31 of 31 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-27T00:13:28.707612Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

30 of 30 outbound references displayed

  • verified exact0
  • verified fuzzy25
  • unresolved5
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 00743ab9-597e-4aef-be7e-b012b5301004 · outbound

This paper cites Learning to represent edits.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Learning to represent edits

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.725448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:37.765614Z digest=sha256:b9534eeb2cc9a7f1d3be2038cb811802be7c40f526a51fef53ac93e177868192

Observation e8476e4a-dc6e-4108-b58b-91de64731a22 · outbound

This paper cites Recode: Benchmarking language models for code repair and generation.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Recode: Benchmarking language models for code repair and generation

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.542379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:37.826445Z digest=sha256:725e4df0163038e991dd852e2bad25722f2442a8a4b7f3c7f4385f7a1ab1862f

Observation c98b8282-5169-407c-9b30-c3933057bd1b · outbound

This paper cites B., AND POLIKARPOVA , N.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems B., AND POLIKARPOVA , N

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.371841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:37.915003Z digest=sha256:f35177e9961d68130377bc00670788860aed634a97c08260185879ef813d74ab

Observation 616a26a5-ed52-4cdd-91c2-8d054aa32b02 · outbound

This paper cites M., G EBRU , T., M CMILLAN -MAJOR , A., AND SHMITCHELL , S.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems M., G EBRU , T., M CMILLAN -MAJOR , A., AND SHMITCHELL , S

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.152146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:37.978887Z digest=sha256:abecbff578252b7e5df7690a2298ab541d686c69b407f9c2de7b408b28acfb89

Observation d2b95be4-2e0b-44f2-88b6-bbc8c272cbae · outbound

This paper cites Supersonic: Learning to generate source code optimizations in c/c++.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Supersonic: Learning to generate source code optimizations in c/c++

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.948298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.081299Z digest=sha256:442fdfc18aa48af95bea2f03409f4ef90bc867a1dc55c2481f041d32c677e0bf

Observation d12a5467-900b-46e0-bd6f-ee60f1a6da74 · outbound

This paper cites Codereval: A benchmark for evaluating code generation models, 2022.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Codereval: A benchmark for evaluating code generation models, 2022

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.761972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.157209Z digest=sha256:fcdc998a0efadee13d6ba2209a3dc88228e61176c6da695c3fc046b18496cd91

Observation ab303350-cddd-43c4-a448-b4298882c11e · outbound

This paper cites A performance study of llm-generated code on leetcode.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A performance study of llm-generated code on leetcode

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.632009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.220636Z digest=sha256:a00d487aba6b8911104b7fc173239d52c5884b3247eb77bdf3587c064211ee76

Observation 494f5109-342e-4705-9664-40374b18ebe4 · outbound

This paper cites E., AND COMBE - MALE , B.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems E., AND COMBE - MALE , B

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.486414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.305622Z digest=sha256:69f18767af7074ddc68e197fe4a8035902ed9fa76669a7ed9fd04021606cbd44

Observation 26ce8f52-4d4c-4af4-8245-6375461c1cc6 · outbound

This paper cites an unresolved cited work.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-06T01:07:44.307227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.404282Z digest=sha256:a9a16717a14842b9b4a42e1418291288215fb6ba9dd630b94ae66bc80e0148bc

Observation 742f2b8c-4c87-4f1a-ada9-bfdb1e775057 · outbound

This paper cites Evaluating large language models trained on code, 2021.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Evaluating large language models trained on code, 2021

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.134215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.485056Z digest=sha256:46220c5264b0bd963e83334724ce9bfb0c308eaa1e4d01021b6de9fdc5e3b196

Observation d7d986d6-4eb4-4f33-8bff-405f90d77f8b · outbound

This paper cites Codebert: A pre-trained model for programming and natural languages.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Codebert: A pre-trained model for programming and natural languages

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.998206Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.560465Z digest=sha256:470444e6e6bc275dd216e2cbe35cbae9fcfb794b3984164c49bc9ed96870b9e5

Observation 2819c5af-fb66-4789-bff1-5f46e84f4cb1 · outbound

This paper cites Z., C LEMENT , C.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Z., C LEMENT , C

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.827188Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.668841Z digest=sha256:5dd72d444d1e52e245bc674a2f01e1dcdefaa7f92379fe05c7a609045f6d1e10

Observation 383971be-ca75-4ec6-bc5a-520775ed125d · outbound

This paper cites T., AND MORGAN , E.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems T., AND MORGAN , E

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.671126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.769303Z digest=sha256:d3fbfd93d4c90f4589555794c8f6839e33f88f399a22bc76e0f96bfc30334c70

Observation e6a3de81-b89f-4536-befe-4c877070e263 · outbound

This paper cites Beyond code generation: An observational study of chatgpt usage in software engineering practice.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Beyond code generation: An observational study of chatgpt usage in software engineering practice

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.514703Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.857750Z digest=sha256:ffd8d2611e3942216cff78d524b85cfc439b436b00ba676276e5eedc977e41c7

Observation 8779f534-bf4b-4401-a9ac-1e37225db3d2 · outbound

This paper cites Leetcode: The world’s leading online programming learn- ing platform.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Leetcode: The world’s leading online programming learn- ing platform

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.342901Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:38.948786Z digest=sha256:81860d900f7d5ab875c169b032e8b2a0ff25511ee69de2dad17202ba657e4223

Observation 9141ac25-bcd1-4f7f-8eaa-000ec524f2e2 · outbound

This paper cites S., W ANG , Y., AND ZHANG , L.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems S., W ANG , Y., AND ZHANG , L

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.196160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.051830Z digest=sha256:39261ff7bcb4f35805caabf2cbd291e342181846c9befc7b76292b3e0b2c0f61

Observation 4be7029a-896c-4948-881c-7f5c7fc89252 · outbound

This paper cites Ai software reliability: Concepts and related domains.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Ai software reliability: Concepts and related domains

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.915820Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.124147Z digest=sha256:0f9571256a6fe5643ae798d7b00a41388118978af60346c7f0c95335e8607500

Observation f4980b23-e637-451b-a705-405212e85dca · outbound

This paper cites B., D RAIN , D., B ING , L., Z HOU , M., AND SUNDARE - SAN , N.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems B., D RAIN , D., B ING , L., Z HOU , M., AND SUNDARE - SAN , N

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.638507Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.225187Z digest=sha256:4b1a44d184b698b60b9bd6e55c85c43907a44e51421936b3290d875646d59a4b

Observation d04c6f3e-5186-492c-b39b-d0d22d0aee1e · outbound

This paper cites Artificial in- telligence versus software engineers: An evidence-based assessment focusing on non-functional requirements.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Artificial in- telligence versus software engineers: An evidence-based assessment focusing on non-functional requirements

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.391818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.329438Z digest=sha256:755f0d4105cfd939d0b2542cee49346ca57e582501aedc281d487cb95afa2c35

Observation f00245ef-d78a-4dc6-aa5d-6f4f34a12ea2 · outbound

This paper cites A Comprehensive Overview of Large Language Models.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Comprehensive Overview of Large Language Models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T01:07:39.423507Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T01:07:39.423507Z digest=sha256:4f6236dfff07340a2388bac0fc2c26eb6c626fd7f8641532979535e05f8c3168

Observation 69055221-dc5e-434a-8325-af9d7c922386 · outbound

This paper cites An empirical evaluation of github copilot’s code suggestions.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems An empirical evaluation of github copilot’s code suggestions

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.102725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.526712Z digest=sha256:f748a4564cc347986cd57f63a924d7ab35e95272b0ae42a5fffe34b808e4e5a7

Observation 97159fbe-296d-4a00-9997-248e2a1359bf · outbound

This paper cites Gpt-4 technical report, 2024.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Gpt-4 technical report, 2024

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.899097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.612826Z digest=sha256:834767fdad22200aa603fb1c117bd89712294dc07577fd35b8df5fb1a1ee9f53

Observation 5d563f0e-0f7d-4f9a-8690-f0399272f6c4 · outbound

This paper cites an unresolved cited work.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T01:07:41.722154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.691462Z digest=sha256:24d5c746225110d7b0239af3ba221b1d1f2486f9535fecd8f4be4c53aacfb9f7

Observation db60303d-a9c2-4e6e-a870-07a667680631 · outbound

This paper cites Choose your pro- gramming copilot: A comparison of the program synthesis performance of github copilot and genetic programming.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Choose your pro- gramming copilot: A comparison of the program synthesis performance of github copilot and genetic programming

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.478963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.805619Z digest=sha256:0a5b435c339ac40d234a184f2d1877003a64d5d7711bb987697e2dd710f7fc17

Observation 16a71d48-7acc-4ce0-be26-a09f69aabb41 · outbound

This paper cites Stratascratch: Real-world data science coding chal- lenges.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Stratascratch: Real-world data science coding chal- lenges

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.245765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.897855Z digest=sha256:1df3496e54f28f7cd28e9b72b1042e4859d0eb1b8784bf832893cc3a16cba599

Observation c3c88cb7-39a9-44fe-bd32-11d2e32d635b · outbound

This paper cites K., F U, S., AND SUNDARESAN , N.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems K., F U, S., AND SUNDARESAN , N

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.061451Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:39.961387Z digest=sha256:2ba26e003868454c6fca0638655f0ba41d9550d218a859585b05c37894afaf1d

Observation b8b3a4f1-732e-43e0-af5b-ed9321f7c557 · outbound

This paper cites Expectation vs.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Expectation vs

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:40.814188Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:40.094265Z digest=sha256:bba10e6a8f98775417dd1470a5bcc41ce9a9ab21ff2ceadc8d74e0b1e3559f83

Observation 563a90e9-4844-4286-b268-dba247cc0dc0 · outbound

This paper cites V., AND VAUGHAN , J.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems V., AND VAUGHAN , J

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:40.625871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T01:07:40.136653Z digest=sha256:bc5fda61f3991c77b427b38cabea78b64c78b3f37cc89339e26b2fe7f1ad66e9

Observation 6d0520ab-1ca3-40e9-96dc-2032cc54343c · outbound

This paper cites A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T01:07:40.262015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T01:07:40.262015Z digest=sha256:7dce2692e02db684f59191dd1016531af03af4bf6816c921588a307fb5a26545

Observation f52ab0a2-1e64-468d-a84c-dc4bf98f0200 · outbound

This paper cites A Systematic Evaluation of Large Language Models of Code.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Systematic Evaluation of Large Language Models of Code

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T01:07:40.389625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T01:07:40.389625Z digest=sha256:f7e4bd5b18f35fcce5144fe0f0f197823119f0974d21cfaaf984fc4d0132c58c

Pith citing papers

Observation 931d7938-ed02-4e76-8d6e-35757bb86571 · inbound

Unlocking LLM Code Correction with Iterative Feedback Loops cites this paper.

Unlocking LLM Code Correction with Iterative Feedback Loops Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-06-27T00:20:16.767351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-06-27T00:13:28.707612Z digest=sha256:7ec6b007bb16ccabc2a343112906457149680260241927220d07d3217cd49df2