Paper Citation Record · LEDGER

ExecRepoBench: Multi-level Executable Code Completion Evaluation

As of 17 August 2026, this Paper Citation Record lists 59 of 59 outbound references and 10 inbound Pith citation observations for arXiv:2412.11990.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.11990 v1

Coverage vector

measured 59 of 59 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T14:27:05.730112Z

measured 69 of 69 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 10 of 10 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T22:57:33.095357Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-13T17:38:02.644825Z

Reference resolution

59 of 59 outbound references displayed

verified exact1
verified fuzzy1
unresolved57
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation fdd7d709-a760-4dd7-9690-da44e0ca6df9 · outbound

This paper cites SantaCoder: don't reach for the stars!.

ExecRepoBench: Multi-level Executable Code Completion Evaluation SantaCoder: don't reach for the stars!

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.559370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f80d66e2-4e2b-446f-8bd6-9ff6fe8a57db · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.162281Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 18afcf29-1e30-4f09-aab9-f73e8548a16e · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.155560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 901b40f2-26b1-4e4b-b6af-9a2fbff969dc · outbound

This paper cites Program Synthesis with Large Language Models.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Program Synthesis with Large Language Models

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.569996Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f8e61fd4-f441-41c3-898f-68b073194b63 · outbound

This paper cites Qwen Technical Report.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Qwen Technical Report

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.573814Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dca4128c-0903-4450-b002-ccaca46aab60 · outbound

This paper cites Efficient Training of Language Models to Fill in the Middle.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Efficient Training of Language Models to Fill in the Middle

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.577602Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c100ba08-ae16-4868-b8b9-0dfea33accf4 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.581066Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4129c901-5ef3-49d0-a0ba-8ebffe526edd · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.583250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 87bf7eb3-c939-4675-9265-8c28a25b1f26 · outbound

This paper cites McEval: Massively Multilingual Code Evaluation.

ExecRepoBench: Multi-level Executable Code Completion Evaluation McEval: Massively Multilingual Code Evaluation

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.585300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2161c789-25a7-48dc-a168-8281eaeaa54e · outbound

This paper cites Evaluating Large Language Models Trained on Code.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Evaluating Large Language Models Trained on Code

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.588491Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e24175bf-c829-4467-a932-40402ddaf885 · outbound

This paper cites A Static Evaluation of Code Completion by Large Language Models.

ExecRepoBench: Multi-level Executable Code Completion Evaluation A Static Evaluation of Code Completion by Large Language Models

Reference 11

Resolution: verified exact; local_arxiv, observed 2026-08-11T14:27:06.015928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation d6847202-242c-4fdd-a0f5-e192e7ebc19f · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.141816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 9fb2e739-debb-41dd-9519-92b122b8c096 · outbound

This paper cites CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context.

ExecRepoBench: Multi-level Executable Code Completion Evaluation CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.596752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0fdcc3b0-17ba-4737-a23c-d7b21e17245d · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.599742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6244cc60-ce56-4996-bd25-1a56a45043ea · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.602844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0beee9b7-5238-4d60-96da-d09848b22a0e · outbound

This paper cites InCoder: A Generative Model for Code Infilling and Synthesis.

ExecRepoBench: Multi-level Executable Code Completion Evaluation InCoder: A Generative Model for Code Infilling and Synthesis

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.605455Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation edfb4589-447a-48b2-a203-74ea007947a8 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.135429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 69742014-4cac-4f85-8aa9-02fa7f933e51 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

ExecRepoBench: Multi-level Executable Code Completion Evaluation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.610651Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1469ec6-7c0f-4b7c-b1c0-7e8ed76053cb · outbound

This paper cites CodeEditorBench: Evaluating Code Editing Capability of Large Language Models.

ExecRepoBench: Multi-level Executable Code Completion Evaluation CodeEditorBench: Evaluating Code Editing Capability of Large Language Models

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.613305Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 79a92985-5ca0-4f58-b917-2b04675cbd79 · outbound

This paper cites OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models.

ExecRepoBench: Multi-level Executable Code Completion Evaluation OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.615908Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation acf2c9e9-4fce-472a-868b-4509dfd581fa · outbound

This paper cites Qwen2.5-Coder Technical Report.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Qwen2.5-Coder Technical Report

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.618522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a838915-04bc-478c-9989-3803e081fd44 · outbound

This paper cites aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Processing.

ExecRepoBench: Multi-level Executable Code Completion Evaluation aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Processing

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.621496Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 487bd2ed-a5fb-4fe8-a810-21434016ecfe · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

ExecRepoBench: Multi-level Executable Code Completion Evaluation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.624549Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66aa2249-e878-46f1-8024-e0919e7d6a43 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

ExecRepoBench: Multi-level Executable Code Completion Evaluation xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.627136Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 360b7b97-4946-4380-a8dc-d3eb6911b950 · outbound

This paper cites Adam: A Method for Stochastic Optimization.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Adam: A Method for Stochastic Optimization

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.630601Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 68f32fde-361a-4262-bf9a-3480bc75d3c7 · outbound

This paper cites Wang, and Tao Yu.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Wang, and Tao Yu

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T14:27:06.127347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 3a6b66c0-87f4-4cfb-9b06-937b2e70e575 · outbound

This paper cites StarCoder: may the source be with you!.

ExecRepoBench: Multi-level Executable Code Completion Evaluation StarCoder: may the source be with you!

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.636837Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82a00c96-c8da-4a60-a53f-4c0d222dda52 · outbound

This paper cites Competition-Level Code Generation with AlphaCode.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Competition-Level Code Generation with AlphaCode

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.639982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ce2703fa-9f44-4d57-88a5-5026cc789082 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.643795Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d898da2e-a25f-4a75-ae66-5c9731a6802b · outbound

This paper cites Learning Code Preference via Synthetic Evolution.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Learning Code Preference via Synthetic Evolution

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.647464Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8089aeac-cd8f-4762-bc41-d086fbdce08d · outbound

This paper cites Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.650690Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52d35d1c-e55d-4e6f-8609-63c0f5ff6e31 · outbound

This paper cites MdEval: Massively Multilingual Code Debugging.

ExecRepoBench: Multi-level Executable Code Completion Evaluation MdEval: Massively Multilingual Code Debugging

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.653507Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 91dc54a7-2761-4458-be49-bf4c913b6e6c · outbound

This paper cites FullStack Bench: Evaluating LLMs as Full Stack Coders.

ExecRepoBench: Multi-level Executable Code Completion Evaluation FullStack Bench: Evaluating LLMs as Full Stack Coders

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.655691Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e288ec25-02f3-48c5-b4c5-eb9b9df074b1 · outbound

This paper cites RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems.

ExecRepoBench: Multi-level Executable Code Completion Evaluation RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.658242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 258b1a66-1505-42fd-bce6-c812f822cfc6 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

ExecRepoBench: Multi-level Executable Code Completion Evaluation StarCoder 2 and The Stack v2: The Next Generation

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.660672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation feb4a473-fe8b-43cf-887f-45ba55f691e3 · outbound

This paper cites Granite Code Models: A Family of Open Foundation Models for Code Intelligence.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.663227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2708c681-c130-44d4-8134-bcedfd2f8938 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 37

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.113325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 3ab73163-7dab-4ddb-8152-8835c7643968 · outbound

This paper cites CodeGen2: Lessons for Training LLMs on Programming and Natural Languages.

ExecRepoBench: Multi-level Executable Code Completion Evaluation CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.668195Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 743a13e5-00a9-486e-9a84-93d1b16413d3 · outbound

This paper cites GPT-4 Technical Report.

ExecRepoBench: Multi-level Executable Code Completion Evaluation GPT-4 Technical Report

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.670991Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 68a73851-7571-4260-a6bb-192ad9bbdff1 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 40

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.105978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 4b637466-3a71-40fe-9e6d-5b8af22d3c05 · outbound

This paper cites HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization.

ExecRepoBench: Multi-level Executable Code Completion Evaluation HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.677014Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation efa8aa04-738b-4859-bf93-d85837bf66a3 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Code Llama: Open Foundation Models for Code

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.680987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 09515c92-fc7b-41a2-9752-96b93523d83b · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

ExecRepoBench: Multi-level Executable Code Completion Evaluation BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.684264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82d5108e-b75e-4cb8-bbfa-dbc7f41d691f · outbound

This paper cites DebugBench: Evaluating Debugging Capability of Large Language Models.

ExecRepoBench: Multi-level Executable Code Completion Evaluation DebugBench: Evaluating Debugging Capability of Large Language Models

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.687591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5396a3b6-fcb1-48d1-8d29-b61f37335431 · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

ExecRepoBench: Multi-level Executable Code Completion Evaluation CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.690338Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 54d26e56-292d-480c-970b-5358c1c4e8ef · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 46

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.098228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 31cba488-2723-4b23-82b2-e8c1c6527568 · outbound

This paper cites Magicoder: Empowering Code Generation with OSS-Instruct.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Magicoder: Empowering Code Generation with OSS-Instruct

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.697411Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6a421f1-add4-44f5-8ee1-9c8d5ba338b2 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 48

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.090306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 0d124e86-3813-468f-9106-f7b6d55f1d36 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.702854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52c47c8a-67fa-4a48-8d2f-8b92fdeda40c · outbound

This paper cites Evaluating and Aligning CodeLLMs on Human Preference.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Evaluating and Aligning CodeLLMs on Human Preference

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.705788Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4117c4b1-33e0-415b-aaee-f25f27b601e2 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.708464Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e096fc07-4b9c-4d2f-b548-8088788e9bb3 · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.710538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9e024070-c8ad-4b5e-b5fc-64da89c9c24d · outbound

This paper cites an unresolved cited work.

ExecRepoBench: Multi-level Executable Code Completion Evaluation Unresolved cited work

Reference 53

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:27:06.071210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 209ed083-97ae-4108-95b7-3458a5b3bac5 · outbound

This paper cites CodeGemma: Open Code Models Based on Gemma.

ExecRepoBench: Multi-level Executable Code Completion Evaluation CodeGemma: Open Code Models Based on Gemma

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.715152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66f6abbb-d834-4c8a-9637-79d0e91a358f · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

ExecRepoBench: Multi-level Executable Code Completion Evaluation CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.717548Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41919295-6132-4a84-a296-908c19c6eb30 · outbound

This paper cites OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement.

ExecRepoBench: Multi-level Executable Code Completion Evaluation OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.720692Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f261fcf-8e60-4803-8ab0-b11d9cf1e0bb · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

ExecRepoBench: Multi-level Executable Code Completion Evaluation BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.724200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cf831f7e-b24f-42d1-810c-55356e9f7eaf · outbound

This paper cites URL: " 'urlintro :=.

ExecRepoBench: Multi-level Executable Code Completion Evaluation URL: " 'urlintro :=

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.726888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8639580c-913e-4887-b46e-d18109d9deb6 · outbound

This paper cites write newline.

ExecRepoBench: Multi-level Executable Code Completion Evaluation write newline

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-11T14:27:05.730112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 71a9ad32-3d87-4d9a-842e-4cbf5cbacd42 · inbound

Exploring the Implicit Semantic Ability of Multimodal Large Language Models: A Pilot Study on Entity Set Expansion cites this paper.

Exploring the Implicit Semantic Ability of Multimodal Large Language Models: A Pilot Study on Entity Set Expansion ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-10T22:57:33.095357Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9ec7dce5-21be-4214-aa33-4ef23070faf9 · inbound

Multi-Agent Collaboration for Multilingual Code Instruction Tuning cites this paper.

Multi-Agent Collaboration for Multilingual Code Instruction Tuning ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-08T12:37:25.814836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 960cbbf1-4249-42ad-9395-5aa68bf361aa · inbound

P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmark cites this paper.

P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmark ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-07T15:23:24.940985Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 267cdb0a-3c8e-4631-ba20-2523a31c0a6d · inbound

SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner cites this paper.

SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-07T05:01:08.695802Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe74c563-d4dd-4dc5-b662-b1f0fea7843e · inbound

MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios cites this paper.

MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-07T00:42:09.581175Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e54abf73-81f2-47cc-b3a8-94c9aa9e5ad3 · inbound

Turning the Tide: Repository-based Code Reflection cites this paper.

Turning the Tide: Repository-based Code Reflection ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-06T17:51:15.725245Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 18a01adb-f980-47a1-a3df-0f7ef79e680a · inbound

RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models cites this paper.

RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-05T10:28:38.784054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 59674089-d60a-4469-a18c-e680e1796d72 · inbound

Toward Executable Repository-Level Code Generation via Environment Alignment cites this paper.

Toward Executable Repository-Level Code Generation via Environment Alignment ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 36

Resolution: verified exact; arxiv_id, observed 2026-05-13T17:38:02.646709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation d7dd988b-c33b-409d-b33f-8b09ea71548e · inbound

Beyond "What to Retrieve": Uncertainty in Retrieval-Augmented Code Generation cites this paper.

Beyond "What to Retrieve": Uncertainty in Retrieval-Augmented Code Generation ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 76

Resolution: unresolved; no resolver link, observed 2026-07-31T20:20:20.572237Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25ed26f4-d361-4ec6-b9a0-cb166648960d · inbound

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models cites this paper.

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models ExecRepoBench: Multi-level Executable Code Completion Evaluation

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-03T00:28:59.376189Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.