Pith. sign in

Paper Citation Record · LEDGER

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks

As of 15 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 1 inbound Pith citation observation for arXiv:2604.05100.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.05100 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-10T19:16:33.635516Z

measured 25 of 25 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T01:30:15.314516Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

  • verified exact11
  • verified fuzzy2
  • unresolved9
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 35be2ab8-5324-4e72-8f75-87054ce1ec4c · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.811048Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:91f8564421fc003a72934b8f9b84f5f42279fbde45d7faa6c2d77455d3ab2603

Observation 2ea0b961-fe20-4e6e-a773-1312125dd4c8 · outbound

This paper cites In2025 IEEE/ACM 22nd International Conference on Mining Software Repositories (MSR).

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks In2025 IEEE/ACM 22nd International Conference on Mining Software Repositories (MSR)

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T07:02:29.806826Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:93fc5308355f58a6d1f247297b081afc68b607dec95792ed8d9d1571fb0cd1e5

Observation e7847934-416e-4b31-ac5d-914fd7eca9a5 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.808830Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:f066a2991c05056b6e6a49be5c03a2b14eb01ee67d048e0051b0ae66ff4e34d7

Observation 0061e5a0-8657-4136-9935-52d0364e35f4 · outbound

This paper cites Code Benchmarks Should Prioritize Rigor, Reliability, and Reproducibility.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Code Benchmarks Should Prioritize Rigor, Reliability, and Reproducibility

Reference 4

Resolution
metadata mismatch
arxiv_id, observed 2026-07-07T03:18:46.014814Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:6dccfc986206759c2e90b045a7d82abcd8c44e14e7e790fac9c079c95d759d12

Observation 6c429b83-854f-471f-a7c0-87a361184ce3 · outbound

This paper cites Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions

Reference 5

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:15:48.216119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:825fe51cad470541d22a9ced1f83a6fa327c35963c0effdfbf7e1c0ec611e412

Observation 08ada4f0-b026-4806-a4ad-e031b0d3f71e · outbound

This paper cites Copilot Arena: A Platform for Code LLM Evaluation in the Wild.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Copilot Arena: A Platform for Code LLM Evaluation in the Wild

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:15:48.220455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:888937ef4e3c1bbd68699f0ff0c83e837271c39b3388cccf5703b79c0c7c3374

Observation 0e597f82-fc1f-48fa-a27e-99106e34d3c3 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:15:48.185595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:1a596ecce284e2a81bcbbd61e490a9a31d3d81b161946bfa16d554d942f69eec

Observation e1a67330-32e3-4d64-b2a5-b123613e4340 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.801983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:b899d92c59a7953aaadc95770751469b2ba11137bd230188facb9f70f3def0a6

Observation e42ae4a9-9a18-4ddc-b647-2e0dca5849d8 · outbound

This paper cites UniXcoder: Unified cross-modal pre-training for code representation.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks UniXcoder: Unified cross-modal pre-training for code representation

Reference 9

Resolution
verified exact
doi, observed 2026-05-10T19:20:45.219571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:008177279f6ff827e31cc248977f81284fbad6658eabe242738f8de54d62a6e3

Observation 23cd0e09-e3e4-4836-bd00-3d132e8abd50 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.788783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:6f81a80b05daeab7e5aa73be9bfffd2ae8886eb7a1a865f82930c34ce2d4d8d2

Observation 1f3be54a-a096-4882-b71d-05cd85afa244 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.793267Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:9da416cee4713855a335eae0e5467823a3f57955d471d5be5df9c8616a156c02

Observation cd8e4d6f-5faf-441a-8dba-80b1c219653a · outbound

This paper cites The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-15T17:38:55.449085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:d3deabd7fc952967eb78b4e6c21dc09eab3ffdf4fadc0966664559803ad1ab9f

Observation 082a4335-27bb-467c-883f-4a4d5ba156be · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.795390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:2718a204341bbb153cccc982168cb215b3a2f9aee114641cbdf051ed40221dfd

Observation ad2fbeff-0933-49f1-9ae7-203f2f4dde69 · outbound

This paper cites Journal of Software: Evolution and Process , year =.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Journal of Software: Evolution and Process , year =

Reference 14

Resolution
verified exact
doi, observed 2026-05-10T19:20:45.213512Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:1fe75c39a42c3d0e995660f336606a44f0c8375b8fea87cdf28d6e6ad29c946b

Observation 42f5e8d4-226a-4d48-9b16-d513b6bb2c5f · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks StarCoder 2 and The Stack v2: The Next Generation

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-12T17:28:23.399599Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:b7f0bc9984225b1826b3b2bd19a19e0c9a75605b7ad2f07293e6ddcb3851f29a

Observation ab2a4e4f-f610-4d3e-b095-181406da45b8 · outbound

This paper cites Prompting llms for code editing: Struggles and remedies.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Prompting llms for code editing: Struggles and remedies

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:15:48.190802Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:cb2deb5ddcbb2bf62817fa17ad4c01aa8d496f001577434b40b875b1c08fd887

Observation 41288450-37d6-4b46-a157-43156f103ff7 · outbound

This paper cites Oliva, Gopi Krishnan Rajbahadur, Aaditya Bhatia, Haoxiang Zhang, Yihao Chen, Zhilong Chen, Arthur Leung, Dayi Lin, Boyuan Chen, and Ahmed E.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Oliva, Gopi Krishnan Rajbahadur, Aaditya Bhatia, Haoxiang Zhang, Yihao Chen, Zhilong Chen, Arthur Leung, Dayi Lin, Boyuan Chen, and Ahmed E

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T07:02:29.791028Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:f5e3b0fda2e6a35ab300ceb2a00ff41324ab3d621700da6393b505bf64fddef2

Observation 21587c6e-a8e6-43f5-ac63-3212d10a083f · outbound

This paper cites Chembakottu, H.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Chembakottu, H

Reference 18

Resolution
malformed identifier
doi_truncated, observed 2026-05-10T19:20:45.217667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:e7aa0bb529e3f569c3146a50cb8183500cd064e11c81f9d27dcbceebcffbd891

Observation 842d1d7c-f6cb-4342-8b76-5efbd01bb87d · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.797561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:3d23802c8452d9304fe6da532f18fb08f637cdcbffb5aed0428ffa9ba451745d

Observation d85e27dc-6bf0-4306-899f-842e47550fe7 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.804262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:7dfcccb27ed82ef1ee854f483f45ebaf9b5e7eb290e08799a9cce10032adb893

Observation 806a9de0-6d39-4fbd-8ec2-6041cc6e41d9 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-05-16T07:02:29.799784Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:4339e8455c942e161311d3cec61c1153f5d8658216379475cc34e330d97d2f36

Observation acb0359c-0c33-4699-b37c-adf1b16092c5 · outbound

This paper cites From code foundation models to agents and applications: A comprehensive survey and practical guide to code intelligence.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks From code foundation models to agents and applications: A comprehensive survey and practical guide to code intelligence

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:15:48.211300Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:5b1ffd83fcdda58bcfd103f4634db6b52c3108a45d922815270902f9b7eaefe3

Observation 06eb7595-2936-4a33-8bdf-60571d96eda4 · outbound

This paper cites an unresolved cited work.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks Unresolved cited work

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-10T19:20:45.215902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:3d6a4a7c6e6559b27a5afb5a4741e9759120d2e63b827efe37d950a4231c1b80

Observation 5e44ab03-3ee9-43fd-9f0a-00ff0b39d468 · outbound

This paper cites feat” = adding new functionality that did not exist before. - “fix.

Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks feat” = adding new functionality that did not exist before. - “fix

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:15:48.198139Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T19:16:33.635516Z digest=sha256:aa5c985592df90a1df2b98183246cb63223d55a19025463ac668c38c4e3183e0

Pith citing papers

Observation 482aa6d0-22e9-4d69-838d-b7bb2d8217de · inbound

To Add Is Machine, To Delete Is Human: Measuring and Mitigating Deletion Avoidance in LLM Code Editing cites this paper.

To Add Is Machine, To Delete Is Human: Measuring and Mitigating Deletion Avoidance in LLM Code Editing Edit, But Verify: An Empirical Audit of Instructed Code-Editing Benchmarks

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-03T01:30:15.314516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-03T01:30:15.314516Z digest=sha256:59d80f448bf130b6ae04e983ff664867af68176f391fe39b3ace23b7fca74e95