Pith. sign in

Paper Citation Record · LEDGER

Coding Triangle: How Does Large Language Model Understand Code?

As of 10 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 1 inbound Pith citation observation for arXiv:2507.06138.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.06138 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T19:15:34.295265Z

measured 31 of 31 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T21:24:12.395140Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

  • verified exact0
  • verified fuzzy5
  • unresolved25
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e3e51fff-5e6c-4793-bb70-a0b4cbcb0a2d · outbound

This paper cites GPT-4 Technical Report.

Coding Triangle: How Does Large Language Model Understand Code? GPT-4 Technical Report

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:31.319491Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:31.319491Z digest=sha256:f63a6929cac649402dae7c0eedf053a3c9b24239972d99949bcd8fe3b4862156

Observation a365a6b5-88c8-4b5a-a7a1-81fd4d62132e · outbound

This paper cites Claude 3.5 sonnet.

Coding Triangle: How Does Large Language Model Understand Code? Claude 3.5 sonnet

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:31.436473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:31.436473Z digest=sha256:e2daa57a768bce4eb37c510d09af7b4a205ef67b70a81498b661525d9b590c0d

Observation 7051434b-8b71-42c3-a9e3-c0d78fdc2a30 · outbound

This paper cites Program Synthesis with Large Language Models.

Coding Triangle: How Does Large Language Model Understand Code? Program Synthesis with Large Language Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:31.621357Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:31.621357Z digest=sha256:d8f723a804cb59f295dd6a6ac40ceae59d32f827011b01c32eb2484671ba575c

Observation 200e52b0-ecfa-4123-a40b-4cc0530f59fa · outbound

This paper cites Qwen Technical Report.

Coding Triangle: How Does Large Language Model Understand Code? Qwen Technical Report

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:31.728286Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:31.728286Z digest=sha256:66b4ac47b26493c8e32377af9f02f2a22833f5407ebd8595e77f0a06794d8475

Observation 471aa647-3f9b-4994-a28c-1f586afd3284 · outbound

This paper cites Language Models are Few-Shot Learners.

Coding Triangle: How Does Large Language Model Understand Code? Language Models are Few-Shot Learners

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:31.815397Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:31.815397Z digest=sha256:3ecac8edf15b173b5256700345464e1b35eb5f321d24a01eaac8d0d889fee6e1

Observation 39ed476d-e59e-4400-a5e9-5dad069ce0c9 · outbound

This paper cites MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation.

Coding Triangle: How Does Large Language Model Understand Code? MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:31.911884Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:31.911884Z digest=sha256:10022ccb414e7fec37ab944f777ba7669aefd5024befe71fac1599898e069ca2

Observation 26de09f2-00ec-4454-9a6b-9ca100201ebe · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Coding Triangle: How Does Large Language Model Understand Code? Evaluating Large Language Models Trained on Code

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.143756Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.143756Z digest=sha256:67239138e141276e26e4fc39b6743b32fd13e4763530370cb9c3485f0fb5f1d0

Observation e7281edc-39fb-42be-b8b2-e3aa8e4a286a · outbound

This paper cites The Llama 3 Herd of Models.

Coding Triangle: How Does Large Language Model Understand Code? The Llama 3 Herd of Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.249516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.249516Z digest=sha256:341e8a6970249c0fcc1632524de67fcfd16079708b46988340a9f320e59960c1

Observation dd9e01b2-eeaf-47c1-9956-99dfd4999c7c · outbound

This paper cites Competitive Programming with Large Reasoning Models.

Coding Triangle: How Does Large Language Model Understand Code? Competitive Programming with Large Reasoning Models

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.356639Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.356639Z digest=sha256:f838d73a0eacf421a5201fe938df021109b859c19445b6f056a5abf6cb92ddd5

Observation e169ced6-7268-4a0e-b071-dbb55c63f6ad · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

Coding Triangle: How Does Large Language Model Understand Code? DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.431989Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.431989Z digest=sha256:e1a32ac1b9f215217f528158a31db0f7452d0183c59f6db91c03611ac394e40a

Observation 65491e5d-6e7b-496d-837a-10ed59f3db6d · outbound

This paper cites CodeEditorBench: Evaluating Code Editing Capability of Large Language Models.

Coding Triangle: How Does Large Language Model Understand Code? CodeEditorBench: Evaluating Code Editing Capability of Large Language Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.548428Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.548428Z digest=sha256:79aea5c696f44571f284b3413778e74aeb45a7357cf5228d86a66b48bc559ea7

Observation 14c450c0-fb89-4b51-aaff-6725c9baa936 · outbound

This paper cites Qwen2.5-Coder Technical Report.

Coding Triangle: How Does Large Language Model Understand Code? Qwen2.5-Coder Technical Report

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.631060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.631060Z digest=sha256:1c8b9b5635c60ff9f42c2a1a39025a5abb791a6373c974f70513ffc5b346783a

Observation d543bcfc-dac4-49c5-a324-20235bde79ce · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

Coding Triangle: How Does Large Language Model Understand Code? LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.745959Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.745959Z digest=sha256:577510ff42226bbb030a03db0c6646cd86dadcab8847a9cae33fccc9f3b9fc36

Observation 57a1cefe-8fd1-4eba-a512-449a6c70f477 · outbound

This paper cites Mistral 7B.

Coding Triangle: How Does Large Language Model Understand Code? Mistral 7B

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:32.843530Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:32.843530Z digest=sha256:3f71628fcbfd542639c8c4d132c384595dcdbe5b55be1d56201cc28196731fa4

Observation 14fbf7cb-c045-44bc-9529-74febc25a52d · outbound

This paper cites Competition-level code generation with alphacode.

Coding Triangle: How Does Large Language Model Understand Code? Competition-level code generation with alphacode

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:15:35.488251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T19:15:32.942773Z digest=sha256:c609b6e93c6c944ab2547fddf315c0d746284ae9131fadb99f2f0e25565953ce

Observation f5b4ceed-068e-43fb-ad23-bbc3f8c4f042 · outbound

This paper cites AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions.

Coding Triangle: How Does Large Language Model Understand Code? AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:33.042830Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:33.042830Z digest=sha256:6b8fc55a5239f05f88f1dacb66f7bb12be52586c11569ca1f5ed058451138a78

Observation 6fb03e8d-592c-4cb9-9643-a985274ae765 · outbound

This paper cites DeepSeek-V3 Technical Report.

Coding Triangle: How Does Large Language Model Understand Code? DeepSeek-V3 Technical Report

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:33.137256Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:33.137256Z digest=sha256:503239f232eb14b12720b2eb908a475c4f104d7111a4500fb23da40f29d4740a

Observation d2561591-789e-43e9-a343-f42d62990a39 · outbound

This paper cites M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluation.

Coding Triangle: How Does Large Language Model Understand Code? M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluation

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:33.200565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:33.200565Z digest=sha256:fa1875797a64b5163a6b366f864342470702313094d9d7cf0d1299d940f4f0a3

Observation 77b16742-3f2e-4cea-9372-d4b72b152eaf · outbound

This paper cites Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation.

Coding Triangle: How Does Large Language Model Understand Code? Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:33.307508Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:33.307508Z digest=sha256:05836c8d52bebedca958f7ae6f6e94d8843846ab34ecff07072cf5acedc3e3cd

Observation 99f418b3-2ec2-4216-9725-a200a3e024a6 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

Coding Triangle: How Does Large Language Model Understand Code? StarCoder 2 and The Stack v2: The Next Generation

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:33.406137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:33.406137Z digest=sha256:4ddd1b1eefd9ae263becc06172faf162ef9f4337aa29430f80d9a6cf37c6c464

Observation e738d167-4ecc-4ae2-be30-a3cc6f371df4 · outbound

This paper cites an unresolved cited work.

Coding Triangle: How Does Large Language Model Understand Code? Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T19:15:35.345101Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T19:15:33.499843Z digest=sha256:0cf2627272673b9cf6914646ab942fa1db0a0356f46a90490373a4c5d52f39ef

Observation bf3523df-e592-4226-80aa-16766cfb9a80 · outbound

This paper cites Openai o1 system card.

Coding Triangle: How Does Large Language Model Understand Code? Openai o1 system card

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:15:35.175911Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T19:15:33.601380Z digest=sha256:299ab7a35a956c6c58b08e175a9b3bc777c19dc1a3f30b7573096e240815b33d

Observation b9822e12-1061-42f4-8683-34ae7ed3c85f · outbound

This paper cites Openai o3 system card.

Coding Triangle: How Does Large Language Model Understand Code? Openai o3 system card

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:15:34.988614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T19:15:33.680374Z digest=sha256:1d95d4d574bbb9149f39c51643735cfb8a86fb5258969149512502757085b708

Observation b405da22-62ea-4c29-a8e2-1d761bf37992 · outbound

This paper cites Openai o3-mini system card.

Coding Triangle: How Does Large Language Model Understand Code? Openai o3-mini system card

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:15:34.779915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T19:15:33.741134Z digest=sha256:0b6ea9073f6a7b2386881d7c6faa7b899f1a14282804039683fe52c774c44650

Observation b39c2840-3101-40eb-8d0f-024255681f83 · outbound

This paper cites Qwen3: Think deeper, act faster.

Coding Triangle: How Does Large Language Model Understand Code? Qwen3: Think deeper, act faster

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:15:34.587917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T19:15:33.819978Z digest=sha256:f445bcf7d4218f00b7b8f5136b22ae24ba45a9bde5f23af148b762456a4d36e8

Observation e5c22150-9882-4b2f-b178-d07668600592 · outbound

This paper cites Qwq-32b: Embracing the power of reinforcement learning, March 2025.

Coding Triangle: How Does Large Language Model Understand Code? Qwq-32b: Embracing the power of reinforcement learning, March 2025

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:33.932515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:33.932515Z digest=sha256:0261531a3f72a96ceb8d9b5b683bff90152a49771fea4f6aef250d6578e27e6a

Observation c312a239-ee61-4022-b2b4-fd0568604c90 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Coding Triangle: How Does Large Language Model Understand Code? Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:34.024244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:34.024244Z digest=sha256:13f7b5db17e18c04d3c4cba93590dbb218291ab2324737bd4774fe15f74ee805

Observation a2ccf137-483a-4ee8-b322-8baa6c138f72 · outbound

This paper cites TableBench: A Comprehensive and Complex Benchmark for Table Question Answering.

Coding Triangle: How Does Large Language Model Understand Code? TableBench: A Comprehensive and Complex Benchmark for Table Question Answering

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:34.117604Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:34.117604Z digest=sha256:aca1b9adc30d23cb1d94156c7af166803ec3156752cb4ddce1cab1f2162c3109

Observation 80c0fd70-3fca-4867-ada7-7c57370a0c3e · outbound

This paper cites Qwen2 Technical Report.

Coding Triangle: How Does Large Language Model Understand Code? Qwen2 Technical Report

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:34.199084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:34.199084Z digest=sha256:6d889330f0c1876f1b49007ccbb98ddc9d10de9f82c91719244a1d634e6bcc54

Observation 0ad0f66a-511a-4f42-97ad-8d774c609edb · outbound

This paper cites Qwen2.5 Technical Report.

Coding Triangle: How Does Large Language Model Understand Code? Qwen2.5 Technical Report

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-06T19:15:34.295265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:15:34.295265Z digest=sha256:d1daa97be0f6031867e326157531184f5ebf28a3339574ec97c00d522f2ba0d1

Pith citing papers

Observation 1ada2122-0e6d-4b38-8929-c3d1728ce4e9 · inbound

The Honest Quorum Problem: Epistemic Byzantine Fault Tolerance for Agentic Infrastructure cites this paper.

The Honest Quorum Problem: Epistemic Byzantine Fault Tolerance for Agentic Infrastructure Coding Triangle: How Does Large Language Model Understand Code?

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-01T21:24:12.395140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T21:24:12.395140Z digest=sha256:2692cb9e27cc0de5fe8f4eae04d6a3f275910a174a1f65aa7b96370ea194ede7