Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-15T18:30:16.433328Z
Paper Citation Record · LEDGER
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
As of 20 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 12 inbound Pith citation observations for arXiv:2506.19724.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-14T13:35:09.909631Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Reference resolution
13 of 13 outbound references displayed
- verified exact0
- verified fuzzy7
- unresolved6
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z
Outbound references
Observation 62fc6180-dc98-4ed7-bcf1-b37418855af9 · outbound
This paper cites an unresolved cited work.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Unresolved cited work
Reference 1
- Resolution
- unresolved
- raw_fallback, observed 2026-08-15T18:30:16.696357Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation fead136f-c550-4c7b-a1a8-9398407be46b · outbound
This paper cites an unresolved cited work.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Unresolved cited work
Reference 2
- Resolution
- unresolved
- raw_fallback, observed 2026-08-15T18:30:16.677670Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 09489a45-f098-4ae4-ac09-131396aebff6 · outbound
This paper cites We investigate these across different approaches tomanaging the history of interactions, including 13.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking We investigate these across different approaches tomanaging the history of interactions, including 13
Reference 3
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.663233Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 365f299c-a96f-4160-b643-6ad718556312 · outbound
This paper cites an unresolved cited work.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Unresolved cited work
Reference 4
- Resolution
- unresolved
- raw_fallback, observed 2026-08-15T18:30:16.647400Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation cc0f51ed-b5d8-44ae-9b17-0d8651eac339 · outbound
This paper cites an unresolved cited work.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Unresolved cited work
Reference 5
- Resolution
- unresolved
- raw_fallback, observed 2026-08-15T18:30:16.630893Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 6205e7a8-c42a-41b0-925f-c3e4bc766098 · outbound
This paper cites agentless.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking agentless
Reference 6
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.615957Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation a97eb6ed-b470-45d6-b304-71725ba1cae5 · outbound
This paper cites We use OpenAI’s text-embedding-3-small model to compute embeddings.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking We use OpenAI’s text-embedding-3-small model to compute embeddings
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.599742Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation b367df62-6075-4dd0-a87e-48cf8a07fef0 · outbound
This paper cites Then, we embed each code snippet and use function header and docstring as query to retrieve top-k relevant code snippets.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Then, we embed each code snippet and use function header and docstring as query to retrieve top-k relevant code snippets
Reference 8
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.573657Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 65067150-adf6-4412-b85b-23d601f60dc3 · outbound
This paper cites We reproduce the approach from Muennighoff et al.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking We reproduce the approach from Muennighoff et al
Reference 9
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.550729Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 9e4b0bff-576d-41be-918c-f659e08949d1 · outbound
This paper cites type": "function.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking type": "function
Reference 10
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.535278Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 45ed59ba-c50b-4cb5-ad72-b95c8ee390d3 · outbound
This paper cites an unresolved cited work.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Unresolved cited work
Reference 11
- Resolution
- unresolved
- raw_fallback, observed 2026-08-15T18:30:16.516025Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 51f28fc4-3d60-4abf-a9c9-3940402944bd · outbound
This paper cites an unresolved cited work.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking Unresolved cited work
Reference 12
- Resolution
- unresolved
- raw_fallback, observed 2026-08-15T18:30:16.496929Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 20423c34-3793-486b-8f53-f322bf920c42 · outbound
This paper cites final_answer.
From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking final_answer
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-15T18:30:16.479485Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Pith citing papers
Observation bd1e7e9b-cb78-45e3-8883-9370c28ff389 · inbound
ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review cites this paper.
ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 32
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-09T01:14:32.434365Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 08e6f8e8-4af8-40bb-8597-57a8f9af6bec · inbound
ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review cites this paper.
ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 33
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-05-19T17:17:42.689492Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 7abb23c9-6f8d-459b-af6f-d46a2b84bb19 · inbound
ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery cites this paper.
ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 12
- Resolution
- verified exact
- arxiv_id, observed 2026-05-19T20:32:45.546062Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation e82c83ef-f3d1-4e58-b3e5-5ec03a308fa8 · inbound
From paper to benchmark: agentic, framework-based reproduction of under-specified methods in machine health intelligence cites this paper.
From paper to benchmark: agentic, framework-based reproduction of under-specified methods in machine health intelligence From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 16
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-06-29T12:23:24.654799Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 6e748dcc-8463-413f-90fa-9d6f20127695 · inbound
NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? cites this paper.
NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 42
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-04T16:49:57.780478Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation 49439bd8-4bf4-4bb9-94f9-b1b094d104de · inbound
NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? cites this paper.
NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 42
- Resolution
- unresolved
- no resolver link, observed 2026-07-12T12:32:39.706055Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 52150493-72da-4417-bcf6-f9e34274b8e3 · inbound
Coding-agents can replicate scientific machine learning papers cites this paper.
Coding-agents can replicate scientific machine learning papers From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 48
- Resolution
- metadata mismatch
- arxiv_id, observed 2026-07-03T13:08:07.704343Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.
Observation f5df9e57-e3ec-4c26-b660-f825d9c1a0b8 · inbound
Coding-agents can replicate scientific machine learning papers cites this paper.
Coding-agents can replicate scientific machine learning papers From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 48
- Resolution
- unresolved
- no resolver link, observed 2026-07-13T07:13:13.354959Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5703e4ff-3ff1-48df-92af-1e340eacbfaf · inbound
Towards Autonomous and Auditable Medical Imaging Model Development cites this paper.
Towards Autonomous and Auditable Medical Imaging Model Development From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 27
- Resolution
- unresolved
- no resolver link, observed 2026-07-14T11:05:51.130839Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 48bc0bb5-d29c-4d85-a062-afcc28c15fdc · inbound
Towards Autonomous and Auditable Medical Imaging Model Development cites this paper.
Towards Autonomous and Auditable Medical Imaging Model Development From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 28
- Resolution
- unresolved
- no resolver link, observed 2026-07-14T11:05:51.130839Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8953575c-46b8-4456-8809-84e860077fdb · inbound
One Run Is Not an Idea: The Implementation Lottery in Automated Research cites this paper.
One Run Is Not an Idea: The Implementation Lottery in Automated Research From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 23
- Resolution
- unresolved
- no resolver link, observed 2026-08-01T12:50:06.296626Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation efcc6f84-2e2c-4437-a80f-d5de7863304e · inbound
Training AI Scientists to Replicate Research cites this paper.
Training AI Scientists to Replicate Research From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
Reference 95
- Resolution
- unresolved
- no resolver link, observed 2026-08-14T13:35:09.909631Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.