Paper Citation Record · LEDGER

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

As of 19 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 6 inbound Pith citation observations for arXiv:2504.18565.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.18565 v2

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T11:39:05.891159Z

measured 22 of 22 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 6 of 6 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T11:11:40.348373Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-21T01:43:56.971386Z

Reference resolution

16 of 16 outbound references displayed

verified exact0
verified fuzzy4
unresolved12
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 3b3bcf62-8be0-4edd-890e-7d60530b4a9f · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:06.063069Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 786d1325-9141-4436-8772-8a4d247ce192 · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-16T11:39:05.835106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 79a0daf4-d199-4639-8685-6a90fb08eb91 · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:06.038684Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 41d88582-92b8-489f-a944-8fe389e71dac · outbound

This paper cites DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-16T11:39:05.843538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0dee1437-3a61-4dd9-b2b0-39985c3dd6e4 · outbound

This paper cites Frontier AI systems have surpassed the self-replicating red line.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Frontier AI systems have surpassed the self-replicating red line

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-16T11:39:05.851538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10a4323b-0f4c-47d5-8400-e75c766a3c6d · outbound

This paper cites CYBERSECEVAL 3: Advancing the Evaluation of Cybersecurity Risks and Capabilities in Large Language Models.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents CYBERSECEVAL 3: Advancing the Evaluation of Cybersecurity Risks and Capabilities in Large Language Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-16T11:39:05.855707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e550fcf3-8a9b-474e-889a-092e6f0bc35b · outbound

This paper cites code": "sf login.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents code": "sf login

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:39:06.074847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 51438e66-9efe-4133-ba4e-d3f62eb29f97 · outbound

This paper cites We can do this by listing and capturing the file's exact size in bytes.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents We can do this by listing and capturing the file's exact size in bytes

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:39:06.051643Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b810d2b1-b732-47b5-a3c6-c135bda83907 · outbound

This paper cites answer":.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents answer":

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:39:06.025696Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 15fa266c-bfa2-4b14-978f-356aea19c366 · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:06.013309Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 6267ff5c-5976-4e80-8d7f-3c63d9460c64 · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:06.001417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b53b4283-60b0-4932-90b8-d05b5e79ca06 · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:05.990034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2e02dfce-789f-4dcc-9921-aa1666af9d85 · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:05.979077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 09790895-3e1a-445d-aa34-e1004c166f77 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Evaluating Large Language Models Trained on Code

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-16T11:39:05.839443Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d3af73f-0d79-472b-a3c9-721740e20f2f · outbound

This paper cites an unresolved cited work.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Unresolved cited work

Reference 2023

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:39:06.087194Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 7b20b0db-2c63-4c19-bc8c-bda2a4517338 · outbound

This paper cites Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, James Aung, Dane Sherburn, Evan Mays, Giulio Starace, Kevin Liu, Leon Maksin, Tejal Patwardhan, Lilian Weng, and Aleksander M ˛ adry.

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, James Aung, Dane Sherburn, Evan Mays, Giulio Starace, Kevin Liu, Leon Maksin, Tejal Patwardhan, Lilian Weng, and Aleksander M ˛ adry

Reference 2024

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:39:06.098315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Pith citing papers

Observation fa19d45b-42b9-4813-a6bc-984737b7cbcb · inbound

Adversarial Attacks on Robotic Vision Language Action Models cites this paper.

Adversarial Attacks on Robotic Vision Language Action Models RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-07T11:11:40.348373Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5daba2b2-56c1-428a-9a14-c27588fa87d8 · inbound

Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Framework cites this paper.

Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Framework RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T16:39:33.918076Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1caa89ce-d703-4800-bc51-1c1fc2ae7ed8 · inbound

Frontier AI Risk Management Framework in Practice: A Risk Analysis Technical Report cites this paper.

Frontier AI Risk Management Framework in Practice: A Risk Analysis Technical Report RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T15:14:21.791055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9ccabc5e-e7f6-4027-916a-ad7104dc2836 · inbound

Ensemble Monitoring for AI Control: Diverse Signals Outweigh More Compute cites this paper.

Ensemble Monitoring for AI Control: Diverse Signals Outweigh More Compute RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Reference 42

Resolution: verified exact; arxiv_id, observed 2026-05-20T20:13:43.355158Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 6457398a-7e11-4d66-841d-cf2780bdb754 · inbound

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents cites this paper.

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-05-21T01:43:56.973932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation fe5c5c71-a3a5-4da5-82cd-0910ce99f5d6 · inbound

Risky Business: Measuring The Faithfulness-Safety Tension cites this paper.

Risky Business: Measuring The Faithfulness-Safety Tension RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-05T13:40:54.013590Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.