Pith. sign in

Paper Citation Record · LEDGER

CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

As of 16 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 5 inbound Pith citation observations for arXiv:2410.01999.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2410.01999 v4

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 5 of 5 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:48:22.794752Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-15T18:51:30.579091Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation b70cf79a-33d9-4774-b9f8-b17d34044161 · inbound

A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications cites this paper.

A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T00:48:22.794752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:48:22.794752Z digest=sha256:356716122d9ff6a2e5ec85b8e359ace97248c32b861011d9a448f26872887351

Observation b5ba76ff-83e9-48af-9e76-e5f4482bc5d7 · inbound

FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluation cites this paper.

FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluation CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T00:40:25.739300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:40:25.739300Z digest=sha256:78ae18d842f72d66f426025d429ed205392b17eb0d698388adb6faf60a1172bd

Observation 7d96e3ce-65d6-42c3-b2b5-4317b13f1ae5 · inbound

Code Reasoning for Software Engineering Tasks: A Survey and A Call to Action cites this paper.

Code Reasoning for Software Engineering Tasks: A Survey and A Call to Action CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T00:29:33.032873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:29:33.032873Z digest=sha256:1bfa42ef078dd3efaad21d32140eb003aab7284826f239ecb73f71b96d4fb259

Observation 1e6d9fb7-87f9-48d2-9c21-80d8a873314f · inbound

DiagramBank: A Large-scale Dataset of Diagram Design Exemplars with Paper Metadata for Retrieval-Augmented Generation cites this paper.

DiagramBank: A Large-scale Dataset of Diagram Design Exemplars with Paper Metadata for Retrieval-Augmented Generation CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-15T18:51:30.584939Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-05-15T18:50:18.746038Z digest=sha256:25b365dc4983118b27fb086688bd86156837567b54d1dbac614ea6edef690e9b

Observation a6f3b54e-6ee5-4235-9c97-f1430fd54b33 · inbound

RepoReasoner: Evaluating Repository-Level Code Reasoning Ability of Long-Context Language Models cites this paper.

RepoReasoner: Evaluating Repository-Level Code Reasoning Ability of Long-Context Language Models CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-01T00:57:37.707760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T00:57:37.707760Z digest=sha256:01305efa5b0d7fa4f0c03e719aa7b8ecc2795b82b055bd6e48e97edb828da850