Pith. sign in

Paper Citation Record · LEDGER

Evaluating Code Generation of LLMs in Advanced Computer Science Problems

As of 18 August 2026, this Paper Citation Record lists 17 of 17 outbound references and 0 inbound Pith citation observations for arXiv:2504.14964.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.14964 v1

Coverage vector

measured 17 of 17 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T11:39:19.442760Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

17 of 17 outbound references displayed

  • verified exact1
  • verified fuzzy12
  • unresolved3
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0248a5de-4a55-4081-af18-9353004a74e9 · outbound

This paper cites Analyzing LLM Usage in an Advanced Computing Class in India.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Analyzing LLM Usage in an Advanced Computing Class in India

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-16T11:39:19.360109Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T11:39:19.360109Z digest=sha256:ff6bf1cdbe97266158b7ccac389445129a8b7e5632a4d588d93e4ddf76c36713

Observation fca6071e-e565-4486-9cf3-f3420465b1e9 · outbound

This paper cites In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.750790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.366028Z digest=sha256:e20ef6f632334da8083459687d642955a30c51cf1109fbaa3f551854c16149cb

Observation c998b83f-7138-484c-bbbd-27a0eae0d42d · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Evaluating Large Language Models Trained on Code

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-16T11:39:19.371007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T11:39:19.371007Z digest=sha256:936ba63ca09f45ff0caa2cb0703240a2ae8852fb2d127fc5653faec76a84e7ca

Observation cf67484f-14c8-45d1-9f3a-610f47fbba6b · outbound

This paper cites Insights from the Frontline: GenAI Utilization Among Software Engineering Students.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Insights from the Frontline: GenAI Utilization Among Software Engineering Students

Reference 4

Resolution
metadata mismatch
local_arxiv, observed 2026-08-16T11:39:19.522116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.375656Z digest=sha256:8016b0c16c4108405e1d9e2c412b747e3925d6c32768284980cca9d3a2b3e25a

Observation 8657252a-7c9a-4352-a479-30bcaedbfe36 · outbound

This paper cites "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses

Reference 5

Resolution
verified exact
local_arxiv, observed 2026-08-16T11:39:19.498427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.380802Z digest=sha256:634e464af264075bcb75ae131d2747e1bc6992c289edbeba23d4014121992e4c

Observation abbc0ec9-ae8d-496a-a09e-60af9b6176dd · outbound

This paper cites In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.734915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.386484Z digest=sha256:2f650bdd5cb60ae262b7be3f7b77192d8b0c938b1976f3756d4534e787c093b7

Observation 9d45ec92-df5b-4a65-af97-edbf2d83ecf0 · outbound

This paper cites In: Proceedings of the 24th Australasian Computing Education Conference, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 24th Australasian Computing Education Conference, pp

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.717872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.391881Z digest=sha256:1790fbf1b5a09c929c28c3d96fa506422f8a664f7145ee2b127dbe1d4e34f127

Observation 881b85d0-6081-433d-8983-6706a799cde4 · outbound

This paper cites In: Proceedings of the 25th Australasian Computing Education Conference, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 25th Australasian Computing Education Conference, pp

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.701967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.396595Z digest=sha256:4d1b9e481207b6b29784ea6b1bf08cf7763453f22efba8c2f19fdb2b82e1fa69

Observation 5f8907a2-7534-42c1-ae19-f16d2fd123a8 · outbound

This paper cites Learning and individual differences103, 102274 (2023) 14 E.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Learning and individual differences103, 102274 (2023) 14 E

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.686105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.401573Z digest=sha256:2a814e107ab8f6f0f22f6a3a81ca586e5a715543f16b808d396bb6361fba2f45

Observation 9b020e71-60b3-4fa9-bfb2-5e9ecaaa550e · outbound

This paper cites In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.670962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.406413Z digest=sha256:e68906ddc295b4ee12c625fed10852a2f853c5be9d9b6b1ddfdbe2c09bbf1357

Observation 777583c8-7d8f-40f6-be34-76dd7e3f40a5 · outbound

This paper cites In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.653636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.411272Z digest=sha256:a9128d4df962b1b28ca7bd51638c58bd3ce2b2df75cbd49775d0b05723e2996e

Observation 0a1e6179-2dc0-411e-aa4d-e2ac24d25966 · outbound

This paper cites In: Proceedings of the 2024 on Innovation and Technology in Com- puter Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 2024 on Innovation and Technology in Com- puter Science Education V

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.637027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.416568Z digest=sha256:972ddfe562c7c6fa99217e0a56ea04d3de6c6504f291a56abfbd82aae1a56d6d

Observation 2d76802f-1ecf-4db4-9491-2cdb941717a9 · outbound

This paper cites In: Shaw, P.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Shaw, P

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-16T11:39:19.421636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T11:39:19.421636Z digest=sha256:bec90f0d843d21375a85adcadd6294eb5384a117c9290ca6b5618381c661be56

Observation 92d9750e-54bd-46a5-8138-b02227a056fc · outbound

This paper cites In: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.620576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.426821Z digest=sha256:7b89ca2a135932a4b63fbbe4e59e556bb7b30dfde7c331650e29c7f7713c2f65

Observation 01b777a8-231a-4c50-b1b6-11547dadcbaa · outbound

This paper cites Communications of the ACM29(9), 850–858 (1986).

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Communications of the ACM29(9), 850–858 (1986)

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.604227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.432798Z digest=sha256:17291e412eb412516d4edee09026418ac7fec5c99ebb1d5e49eef950a1d3fea4

Observation c1364698-576d-4c73-8274-91ee0237080a · outbound

This paper cites 1 (2023) A Changed solutions We made some small alterations to the LLM-generated solutions before the tests.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems 1 (2023) A Changed solutions We made some small alterations to the LLM-generated solutions before the tests

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.588075Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.437859Z digest=sha256:c1a82d9c8e961cd0ccf0be86891d81a3f6430f93f551e341cabc39c8c82b8de1

Observation ebdbd8ff-7a58-49ad-9f8f-3ea631d6b1b0 · outbound

This paper cites No changes were made to the algorithms of the solutions.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems No changes were made to the algorithms of the solutions

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.571910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.442760Z digest=sha256:d20a77fe96c50db54e4fead94a25f51227f2951e2b280ef6d6f631b88eb463f9

Pith citing papers

No inbound Pith citation observations are available.