Pith. sign in

Paper Citation Record · LEDGER

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

As of 8 August 2026, this Paper Citation Record lists 31 of 31 outbound references and 2 inbound Pith citation observations for arXiv:2508.02998.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.02998 v1

Coverage vector

measured 31 of 31 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T04:49:39.133642Z

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T00:28:55.662335Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T08:13:15.109194Z

Reference resolution

31 of 31 outbound references displayed

  • verified exact1
  • verified fuzzy2
  • unresolved28
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b2b4e99e-1bc4-4c35-ae24-38032997a2bb · outbound

This paper cites Program Synthesis with Large Language Models.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Program Synthesis with Large Language Models

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.283004Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.283004Z digest=sha256:3f52983c52564c6c9826a57d411be283d9ce34f487776e3fd21ea44af83eb756

Observation 1a72060b-e25a-4fbd-9017-191e7d094253 · outbound

This paper cites Teaching Large Language Models to Self-Debug.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Teaching Large Language Models to Self-Debug

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.369265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.369265Z digest=sha256:47056b2ab9a81606328e561226761e32e234e33ab52901a16c7ef58965c5d6d1

Observation 648065fb-e020-4a26-9dd6-0be4e1e20bdc · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.466359Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.466359Z digest=sha256:b95a57959a0ccc05952b5eca47c23361401049c6e69e0d62cd486c9ebaee43b8

Observation 55069e9f-4002-48ec-bd27-7fcf9b37a33f · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:41.022049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:36.547668Z digest=sha256:18a171eacc6371df8c4134ab18de0fb60e261f4455c3d2c5d634c19bd77f925c

Observation b6b9f691-0118-4d08-9965-05468455e425 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:40.708589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:36.646022Z digest=sha256:a9c5197e732c1ca47d82c0d69d2fb1c3ebd557fac77bae4c0d9748661a95fcc9

Observation 5079ab60-d42e-44f8-9686-e43f8765400e · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.799180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.799180Z digest=sha256:c5892d930e70944dbeafa543317518bb226bb260014bd4ab99ed65eea0e829ac

Observation 70d9781f-9b5f-4ae5-9df8-5f79ffc40dbb · outbound

This paper cites ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.903664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.903664Z digest=sha256:d0b36ca80e96980f816007cdab477fd00b521bd3284c8806c0f0ce0b6eba1589

Observation b63a5f23-dcf4-463d-b0fe-b0b5caa26454 · outbound

This paper cites InCoder: A Generative Model for Code Infilling and Synthesis.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation InCoder: A Generative Model for Code Infilling and Synthesis

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.961061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.961061Z digest=sha256:0c329e9899517177a8e06bb13a97551435b32badbf4c56200bc7ae146a6200c4

Observation 61acb26e-8826-4a4c-8fbe-bd1818749853 · outbound

This paper cites 2024.Copilot.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation 2024.Copilot

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T04:49:40.413743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:37.047387Z digest=sha256:e969d4859006830e687ac1f37e52bfed364500fa8fc9328d15082ebd77cc02c3

Observation fc31b72f-57dc-4c97-a707-afc6474ff3d8 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Code Llama: Open Foundation Models for Code

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.129307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.129307Z digest=sha256:8680e358d5bb2041e83834d8d60fd3faff881aafac7621599125917ac310411f

Observation 34c2ee62-0646-4824-b99f-5dd0228504f6 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.221809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.221809Z digest=sha256:6f2e503dd5a47f8768e03aad8ae85e293433773dfac677aa6115f3a8100dc4e3

Observation 950d70f9-c645-4584-b6d2-97d9523de174 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Measuring Coding Challenge Competence With APPS

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.331434Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.331434Z digest=sha256:2245b801d556047d1e293d61e1fb5c9d1a7906c856cac47603336bd64f0a13ed

Observation d2c2cf9c-3318-4bda-9c5c-bf9ee34f3c55 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.420182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.420182Z digest=sha256:99a218b5896753ad3f9293eeb4eac09c7e15e82801466d0d8871a6a919859774

Observation 93c84ece-dc59-4842-9f96-dfc0876bb2f4 · outbound

This paper cites xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.500595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.500595Z digest=sha256:d175fdde94acc165aac29bc62106b13cb8650b1aaea0554d461e0298d48e1726

Observation 263fcd90-a056-4e3c-bf5c-229343660ffa · outbound

This paper cites Gonzalez, Hao Zhang, and Ion Stoica.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Gonzalez, Hao Zhang, and Ion Stoica

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.621792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.621792Z digest=sha256:a723a5962f9c2dae16b735727745feb26e6951cb3b4731ccab855a3f01f33a91

Observation 3d9385a2-9a13-4627-a475-3fa2e2e8c027 · outbound

This paper cites NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.690098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.690098Z digest=sha256:951a9134cf14e78be12279aa7940cd56bc627c566cd446c2351d3d7f1acae690

Observation 810cb445-4df8-4cb3-a01d-0ddf0d83f6e5 · outbound

This paper cites EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.791676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.791676Z digest=sha256:c12167b32b8f5bce0ab3642659a0ed7a70fca45c4b7f5aedc7128c07f07e28cb

Observation 9d896e3d-90cc-48ff-a8f1-7573cef202dd · outbound

This paper cites RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.883738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.883738Z digest=sha256:05ff37a28438b5308d479f71a552056f65fdf7ac20ed68d429aebbf53c056ffd

Observation c9141019-337a-43b9-adae-03a44719535b · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation StarCoder 2 and The Stack v2: The Next Generation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:37.990575Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:37.990575Z digest=sha256:103c7c6018bfefe01f0198da618c7ad2d5ed6c881f8023ec1cdfb7dfda692845

Observation 6cd3db49-b3c7-4f92-b535-9dee159efb59 · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.092818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.092818Z digest=sha256:1018fd8bd432988cb7482ce8a5d2450890d3d7dd414925ff03a2522ce0316ff9

Observation d4081a67-03eb-45b1-99f8-db8f22b028f4 · outbound

This paper cites CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.225763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.225763Z digest=sha256:ede4e373a5490d9f4947742fba9f89af84e66fdb5a0acb32149a91229eeeca85

Observation 8d1258d9-f5d1-45fb-ac22-0b664ef806f4 · outbound

This paper cites 2024.ChatGPT.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation 2024.ChatGPT

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T04:49:40.186330Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:38.342693Z digest=sha256:c9d5702b617f201b53d96b3e7b27a07f7dde6f1ed89ba0057915124f3fcd9981

Observation 143da275-38b3-4704-bbb1-423d356617ac · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:39.952384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:38.439138Z digest=sha256:65858dcc23c9a7a4c653555617dbf5bef70ae41cf76fba1ea57c71bcaa1f3b75

Observation 498c2882-7b5b-4b85-9d06-f64a957a8361 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.536580Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.536580Z digest=sha256:69ba509db35bf24dd51068f1d27e2c35cbef126fe8ecde13bf70ebe2e51d5860

Observation 95ec5545-72e3-4110-8292-f2acb7164a0d · outbound

This paper cites Qwen2.5 Technical Report.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Qwen2.5 Technical Report

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.645841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.645841Z digest=sha256:2f1766310ddf211d6d3a10e3af2ca8f2cdcdb3807a49dc5559b200028a08c791

Observation c95dda23-f2e1-4d10-845f-a62bf70a034f · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T04:49:39.709343Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:38.763125Z digest=sha256:a9106d54f9f15d85a9e496838167a32558d563701c7fd66a1f692140d7608a60

Observation 90b9c117-0062-40c9-8a2a-a15032f8c561 · outbound

This paper cites an unresolved cited work.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:38.889520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:38.889520Z digest=sha256:cc697941faa4f911dcbcea318b7d930ef55bf7a3cd6ed6a74c7f8a505289818b

Observation 2ed9e81d-7cd5-41e0-894a-67fdb1228f0c · outbound

This paper cites CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios

Reference 28

Resolution
verified exact
local_arxiv, observed 2026-08-06T04:49:39.355832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T04:49:38.962093Z digest=sha256:1fbeef68926eb9f6c510cf569c0a4269169d23a5eac0023b1552fc0aea4dd9f9

Observation aa3a215e-c8cc-4a62-b216-909b860b1046 · outbound

This paper cites RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:39.054238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:39.054238Z digest=sha256:55943001d825b779c783a8be23fb1a569fe606e420b39a4f866a6f01a1bf51e0

Observation d4630529-c4f3-46ef-a114-b656493de31c · outbound

This paper cites CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:39.133642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:39.133642Z digest=sha256:943208ef5c7f480bdb23bddb5fb9f0b6eb5c3fbfc6210988e7c9d3aefa3d53f4

Observation ee8c051c-8109-4f83-98c9-fec9bf09297a · outbound

This paper cites CodeScore: Evaluating Code Generation by Learning Code Execution.

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation CodeScore: Evaluating Code Generation by Learning Code Execution

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-06T04:49:36.719611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T04:49:36.719611Z digest=sha256:bf946257b1998935773c0cd03adee6ae3ed6109fb9978fc5f3a686b593954d7e

Pith citing papers

Observation 9ee78008-d9ef-4a9a-b898-ab8232ccb492 · inbound

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark cites this paper.

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-06-29T08:13:15.110631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-29T08:09:41.068000Z digest=sha256:b4459bd7d6c02c170c6bc62aa3afe508ad8c1e89f05bbcad1ecc8b4f9d633f0d

Observation 3eb34cc0-151b-4808-b63b-b28f2b5ba748 · inbound

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models cites this paper.

Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-03T00:28:55.662335Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T00:28:55.662335Z digest=sha256:3bdbca1a1f9e10165e8ad4745f7ae97fe99acca273bc941a81d694ec13058175