Pith. sign in

Paper Citation Record · LEDGER

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

As of 23 August 2026, this Paper Citation Record lists 31 of 31 outbound references and 2 inbound Pith citation observations for arXiv:2508.02998.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.02998 v1

Coverage vector

measured 31 of 31 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T04:49:39.133642Z

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T00:28:55.662335Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T08:13:15.109194Z

Reference resolution

31 of 31 outbound references displayed

  • verified exact1
  • verified fuzzy2
  • unresolved28
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b2b4e99e-1bc4-4c35-ae24-38032997a2bb · outbound

This paper cites Program Synthesis with Large Language Models.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Program Synthesis with Large Language Models

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.283004Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.283004Z digest=sha256:9a223185b666caf47a3a87a689bcd1471573e1a5c7645c526799864dcc71f754

Observation 1a72060b-e25a-4fbd-9017-191e7d094253 · outbound

This paper cites Teaching Large Language Models to Self-Debug.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Teaching Large Language Models to Self-Debug

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.369265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.369265Z digest=sha256:085e229c61c546bf4995fa82e2a552e1c5ab2aec636d96a02ad3ce25a97eeb7d

Observation 648065fb-e020-4a26-9dd6-0be4e1e20bdc · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.466359Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.466359Z digest=sha256:beb2d871ba11731a5a0e34345ef53e599f24ed854d0d999b24c2475e359ea571

Observation 55069e9f-4002-48ec-bd27-7fcf9b37a33f · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:41.022049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:36.547668Z digest=sha256:ffe501f874e1beb50efa157b0f56ff7c5a070fa846ba01a155994c9934340c84

Observation b6b9f691-0118-4d08-9965-05468455e425 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:40.708589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:36.646022Z digest=sha256:4f65504550fe1e221e809e44b83c5e347e9b3a4cfe13de44db8c24ed3b13d1b8

Observation 5079ab60-d42e-44f8-9686-e43f8765400e · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.799180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.799180Z digest=sha256:c5b1f81f3b6a9ae4adc6fbe37ba578cec9aa24d139858a7a1a53e47cfc74ba0f

Observation 70d9781f-9b5f-4ae5-9df8-5f79ffc40dbb · outbound

This paper cites ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.903664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.903664Z digest=sha256:2048c683d6cd4b64a9f96a0c365704a17f00d646f45f8f4784337db34be2861a

Observation b63a5f23-dcf4-463d-b0fe-b0b5caa26454 · outbound

This paper cites InCoder: A Generative Model for Code Infilling and Synthesis.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation InCoder: A Generative Model for Code Infilling and Synthesis

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.961061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.961061Z digest=sha256:518d89fd4f5b1c0301f16e58ca06b9d283f7dd3a583cba5ec30bff46b49b484d

Observation 61acb26e-8826-4a4c-8fbe-bd1818749853 · outbound

This paper cites 2024.Copilot.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation 2024.Copilot

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T04:49:40.413743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:37.047387Z digest=sha256:866f04778cb28268592e5d1a535af687e934181c910b7f78e74d435b3b3588fb

Observation fc31b72f-57dc-4c97-a707-afc6474ff3d8 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Code Llama: Open Foundation Models for Code

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.129307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.129307Z digest=sha256:6b4c75a9b9f3e4e48939aaf8eebcd52bd34520cd054ab01ac769cb62b59f1179

Observation 34c2ee62-0646-4824-b99f-5dd0228504f6 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.221809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.221809Z digest=sha256:5e49cd8a96f3c7f8947819fae9bca6d1088e0b9e087565ff3b58f4e6433064f7

Observation 950d70f9-c645-4584-b6d2-97d9523de174 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Measuring Coding Challenge Competence With APPS

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.331434Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.331434Z digest=sha256:b9cae5bbfc977e897e85bdd7aac293bf2e372120d5294c6e19cb447000e8f703

Observation d2c2cf9c-3318-4bda-9c5c-bf9ee34f3c55 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.420182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.420182Z digest=sha256:577a2b2840a6eca1c9cdf58b64e96b94e58a61a49ce1506ed019b8c2d5fdeb97

Observation 93c84ece-dc59-4842-9f96-dfc0876bb2f4 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.500595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.500595Z digest=sha256:db48c5f7077c89d58c0c141ab2189c2ba2b4a2360d8f04a90a09e4aeeaa7c9bf

Observation 263fcd90-a056-4e3c-bf5c-229343660ffa · outbound

This paper cites Gonzalez, Hao Zhang, and Ion Stoica.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Gonzalez, Hao Zhang, and Ion Stoica

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.621792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.621792Z digest=sha256:962a9b9b9b2f6b89c8a96337fa5365330f0f6b11324c23f4c76079c1590a326f

Observation 3d9385a2-9a13-4627-a475-3fa2e2e8c027 · outbound

This paper cites NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.690098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.690098Z digest=sha256:018281522c8ae234b08be9e1e5a4bc6cd85e02a37a9443d0bcff0455f6deb707

Observation 810cb445-4df8-4cb3-a01d-0ddf0d83f6e5 · outbound

This paper cites EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.791676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.791676Z digest=sha256:9589e88f11806f0da472f40fde9ae679a104a6fa405a3a0256aaa70b6112ad58

Observation 9d896e3d-90cc-48ff-a8f1-7573cef202dd · outbound

This paper cites RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.883738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.883738Z digest=sha256:6bc8d55106ac6ce47f014635273dd2b7408c230a72b186b26c4c178f3b0d629f

Observation c9141019-337a-43b9-adae-03a44719535b · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation StarCoder 2 and The Stack v2: The Next Generation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.990575Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.990575Z digest=sha256:44c9014ff22816ea5d5279ad7aa6b9935d858bf29aa7c052fe30493c34ac0a47

Observation 6cd3db49-b3c7-4f92-b535-9dee159efb59 · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.092818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.092818Z digest=sha256:264f0e7cb9aac68a0d3db908e504e2115c9871bd138e1e47d56d782a0b79aac0

Observation d4081a67-03eb-45b1-99f8-db8f22b028f4 · outbound

This paper cites CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.225763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.225763Z digest=sha256:8c45ea0de0be709f5dc3aab8346f9a83bb1ed58419d8a5ac1943fbe3c327a8c5

Observation 8d1258d9-f5d1-45fb-ac22-0b664ef806f4 · outbound

This paper cites 2024.ChatGPT.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation 2024.ChatGPT

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T04:49:40.186330Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:38.342693Z digest=sha256:17738446130bd7cb66a5af1c791a044bd94d7636e43a7c909f0d5d3fd07dca7c

Observation 143da275-38b3-4704-bbb1-423d356617ac · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:39.952384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:38.439138Z digest=sha256:89bb1d70b7cefcf3452bdd3acff0dadab8ed2eba5171f5263070b51dc703421b

Observation 498c2882-7b5b-4b85-9d06-f64a957a8361 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.536580Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.536580Z digest=sha256:c4eedec0ab49500bc452477f86289f1e8aef2b7936882ca9a3f96a0c86ecd363

Observation 95ec5545-72e3-4110-8292-f2acb7164a0d · outbound

This paper cites Qwen2.5 Technical Report.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Qwen2.5 Technical Report

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.645841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.645841Z digest=sha256:13fc8d8dd86f8f56faff43b639c2277c11486675e830e13c3107f22d2376ec46

Observation c95dda23-f2e1-4d10-845f-a62bf70a034f · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:39.709343Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:38.763125Z digest=sha256:5d7b109f72190b9e979e7ab2cf1c81620504ae4c6b4eaa2fa245083e2af31146

Observation 90b9c117-0062-40c9-8a2a-a15032f8c561 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.889520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.889520Z digest=sha256:5bcee285ced4809f736b329ece0d4b7027f611bc3906018be59850e00edc617c

Observation 2ed9e81d-7cd5-41e0-894a-67fdb1228f0c · outbound

This paper cites CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios

Reference 28

Resolution
verified exact
local_arxiv, observed 2026-08-06T04:49:39.355832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-06T04:49:38.962093Z digest=sha256:5e9c59eed164cafd9bd07c1d014c715111e7e5ad64119e81251325017ead1440

Observation aa3a215e-c8cc-4a62-b216-909b860b1046 · outbound

This paper cites RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:39.054238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:39.054238Z digest=sha256:fda18d90118767304d332e1383dff92ae1cc9d3e9bccd47ad954a375a53e6fc3

Observation d4630529-c4f3-46ef-a114-b656493de31c · outbound

This paper cites CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:39.133642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:39.133642Z digest=sha256:de0d700ca180e3e6f42c4181b9e4a03c7b9920e77f73864ad0d2cb930a68824f

Observation ee8c051c-8109-4f83-98c9-fec9bf09297a · outbound

This paper cites CodeScore: Evaluating Code Generation by Learning Code Execution.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeScore: Evaluating Code Generation by Learning Code Execution

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.719611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.719611Z digest=sha256:edab98b83c927cfedff4bafa503292a3cbef431c56e0b036c5f24ec0e3635efa

Pith citing papers

Observation 9ee78008-d9ef-4a9a-b898-ab8232ccb492 · inbound

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark cites this paper.

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-06-29T08:13:15.110631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-29T08:09:41.068000Z digest=sha256:fd7392234ae7dfe83cc0fc81c782f7a9b49e4d6975b56b85584ac3363260aea9

Observation 3eb34cc0-151b-4808-b63b-b28f2b5ba748 · inbound

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models cites this paper.

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-03T00:28:55.662335Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T00:28:55.662335Z digest=sha256:5ff3aad97c0d1c0cc69caf1e647533c94a3de9764614986b348844bb9b96c7e7