Paper Citation Record · LEDGER

Multi-lingual Evaluation of Code Generation Models

As of 23 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 33 inbound Pith citation observations for arXiv:2210.14868.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2210.14868 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 33 of 33 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T05:53:25.956850Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

28
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 92af7c64-b7d9-4e51-a2ac-3fbc1a18825c · inbound

StarCoder: may the source be with you! cites this paper.

StarCoder: may the source be with you! Multi-lingual Evaluation of Code Generation Models

Reference 183

Resolution: verified exact; arxiv_id, observed 2026-05-10T23:33:00.359835Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 1420d9b2-81a0-433c-be42-3a062685c8a6 · inbound

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code cites this paper.

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code Multi-lingual Evaluation of Code Generation Models

Reference 242

Resolution: verified exact; arxiv_id, observed 2026-05-10T17:34:42.863830Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 0196dbba-4ba1-401f-ab37-e2d1050ea114 · inbound

A Survey on Large Language Models for Code Generation cites this paper.

A Survey on Large Language Models for Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-05-13T20:18:06.667539Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 127d747b-b722-4093-a323-5fdfad651925 · inbound

ProSec: Fortifying Code LLMs with Proactive Security Alignment cites this paper.

ProSec: Fortifying Code LLMs with Proactive Security Alignment Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-12T17:10:55.406265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf8a3c85-3d47-400c-b678-b1483b7fc7b7 · inbound

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks cites this paper.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-12T14:18:33.026719Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 910dc0c6-c405-4c96-ac07-85fd4e810a6b · inbound

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model cites this paper.

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model Multi-lingual Evaluation of Code Generation Models

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-11T19:03:47.980691Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 033749d6-46d4-4338-83ba-565e6f3dc325 · inbound

HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation cites this paper.

HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-10T23:21:37.683347Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 14e8420b-741f-4028-b57b-70af239ee457 · inbound

A Study of LLMs' Preferences for Libraries and Programming Languages cites this paper.

A Study of LLMs' Preferences for Libraries and Programming Languages Multi-lingual Evaluation of Code Generation Models

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-05-22T22:55:12.191333Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 1a3a6e20-84a9-4fa8-8932-036bd34b9600 · inbound

Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving cites this paper.

Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving Multi-lingual Evaluation of Code Generation Models

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-16T06:48:50.496587Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation e96b423d-d89a-46a9-a65c-b0025a2d457e · inbound

OpenClassGen: A Large-Scale Corpus of Real-World Python Classes for LLM Research cites this paper.

OpenClassGen: A Large-Scale Corpus of Real-World Python Classes for LLM Research Multi-lingual Evaluation of Code Generation Models

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-05-09T06:35:19.883923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 1fc24f99-0845-40e4-91ff-529b89c40048 · inbound

ResearchCodeAgent: An LLM Multi-Agent System for Automated Codification of Research Methodologies cites this paper.

ResearchCodeAgent: An LLM Multi-Agent System for Automated Codification of Research Methodologies Multi-lingual Evaluation of Code Generation Models

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-16T05:53:25.956850Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b7d697aa-76ea-4ea8-b57e-b7dbe5ee8fff · inbound

OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution cites this paper.

OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution Multi-lingual Evaluation of Code Generation Models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T23:27:58.276972Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2d3ac28-05d7-4368-b368-5a434d8bbbcc · inbound

QiMeng-TensorOp: Automatically Generating High-Performance Tensor Operators with Hardware Primitives cites this paper.

QiMeng-TensorOp: Automatically Generating High-Performance Tensor Operators with Hardware Primitives Multi-lingual Evaluation of Code Generation Models

Reference 2013

Resolution: unresolved; no resolver link, observed 2026-08-15T23:21:44.521745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8bbdaf7d-2b61-4f8b-a052-81f5602257b0 · inbound

MigrationBench: Repository-Level Code Migration Benchmark from Java 8 cites this paper.

MigrationBench: Repository-Level Code Migration Benchmark from Java 8 Multi-lingual Evaluation of Code Generation Models

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T21:32:07.671800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3bde5860-92bd-4aa0-a342-d77b95197d2e · inbound

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences cites this paper.

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences Multi-lingual Evaluation of Code Generation Models

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-07T12:10:29.962269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25c7c523-b62a-400f-96bd-04ed7f28a192 · inbound

Mutation-Guided Unit Test Generation with a Large Language Model cites this paper.

Mutation-Guided Unit Test Generation with a Large Language Model Multi-lingual Evaluation of Code Generation Models

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-19T11:07:15.188725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 94857e75-89c2-405e-b321-1c7072033fd0 · inbound

In-Context Learning as an Effective Estimator of Functional Correctness of LLM-Generated Code cites this paper.

In-Context Learning as an Effective Estimator of Functional Correctness of LLM-Generated Code Multi-lingual Evaluation of Code Generation Models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T19:34:34.587748Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb257d84-d21b-4eaa-ae39-01df4ebd3ef2 · inbound

SimdBench: Benchmarking Large Language Models for SIMD-Intrinsic Code Generation cites this paper.

SimdBench: Benchmarking Large Language Models for SIMD-Intrinsic Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T15:43:35.892082Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6276f757-6ee0-49cb-b9f8-bfd14b2591fd · inbound

Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inference cites this paper.

Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inference Multi-lingual Evaluation of Code Generation Models

Reference 30

Resolution: verified exact; arxiv_id, observed 2026-05-15T16:17:50.325921Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 7d567052-2cde-46b6-82b1-7b690d8db3da · inbound

A Taxonomy of Programming Languages for Code Generation cites this paper.

A Taxonomy of Programming Languages for Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-05-11T22:56:14.178719Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 07e6d07e-56a6-4c4a-ac5c-3cb24345ea5c · inbound

LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review cites this paper.

LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review Multi-lingual Evaluation of Code Generation Models

Reference 30

Resolution: verified exact; arxiv_id, observed 2026-05-15T19:56:33.893735Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 22c6f3ed-bb50-4015-8f0d-926367a311e8 · inbound

Assessing the Impact of Requirement Ambiguity on LLM-based Function-Level Code Generation cites this paper.

Assessing the Impact of Requirement Ambiguity on LLM-based Function-Level Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-11T14:41:23.479400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 9a93e213-ca79-45b0-bd6c-6345c1df53dc · inbound

RealBench: A Repo-Level Code Generation Benchmark Aligned with Real-World Software Development Practices cites this paper.

RealBench: A Repo-Level Code Generation Benchmark Aligned with Real-World Software Development Practices Multi-lingual Evaluation of Code Generation Models

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-05-11T19:36:15.364569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation bcf03380-7c0c-4a78-b7c9-382997f99e5f · inbound

Learning from Execution: Self-Evolving Memory for Private-Library Code Generation cites this paper.

Learning from Execution: Self-Evolving Memory for Private-Library Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 40

Resolution: verified exact; arxiv_id, observed 2026-05-11T21:56:38.575910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation c1974c29-71d2-451c-9384-04b3c0e37381 · inbound

Learning from Execution: Self-Evolving Memory for Private-Library Code Generation cites this paper.

Learning from Execution: Self-Evolving Memory for Private-Library Code Generation Multi-lingual Evaluation of Code Generation Models

Reference 38

Resolution: unresolved; no resolver link, observed 2026-07-12T18:16:50.322933Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f82767ea-48ab-4be6-9bb1-77e1ef813282 · inbound

Evaluating LLM-Generated Code: A Benchmark and Developer Study cites this paper.

Evaluating LLM-Generated Code: A Benchmark and Developer Study Multi-lingual Evaluation of Code Generation Models

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-05-12T07:37:02.619902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 3c81cd13-b026-4d1d-85f3-527c77d0b89d · inbound

Evaluating LLM-Generated Code: A Benchmark and Developer Study cites this paper.

Evaluating LLM-Generated Code: A Benchmark and Developer Study Multi-lingual Evaluation of Code Generation Models

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-07-01T13:35:46.801549Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation c7bbb054-735f-449d-a92e-78d6b9d90019 · inbound

CodegenBench: Can LLMs Write Efficient Code Across Architectures? cites this paper.

CodegenBench: Can LLMs Write Efficient Code Across Architectures? Multi-lingual Evaluation of Code Generation Models

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-07-02T00:06:23.764000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 5dcc1e99-c490-4ea4-9d2f-5a3e4f3a3954 · inbound

SWE-InfraBench: Evaluating Language Models on Cloud Infrastructure Code cites this paper.

SWE-InfraBench: Evaluating Language Models on Cloud Infrastructure Code Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T09:56:51.758679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 415bb5b3-f6e9-4076-acad-8b24e9d09b86 · inbound

Beyond Pass Rate: A Multilingual, Execution-Grounded Evaluation of Open Code LLMs cites this paper.

Beyond Pass Rate: A Multilingual, Execution-Grounded Evaluation of Open Code LLMs Multi-lingual Evaluation of Code Generation Models

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-07-02T23:17:29.743533Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation be4ed27b-54d6-4ab4-9587-436f81870666 · inbound

Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages cites this paper.

Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages Multi-lingual Evaluation of Code Generation Models

Reference 29

Resolution: metadata mismatch; arxiv_id, observed 2026-07-04T03:49:30.014285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 0095572b-c0f4-4ae0-9f99-a69a76488c7f · inbound

The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languages cites this paper.

The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languages Multi-lingual Evaluation of Code Generation Models

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-01T04:41:31.803525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d604f600-da62-41c1-b6ab-1a998ce71052 · inbound

Efficient Grammar-Constrained Decoding via Parser Stack Classification cites this paper.

Efficient Grammar-Constrained Decoding via Parser Stack Classification Multi-lingual Evaluation of Code Generation Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T15:06:44.611094Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.