Paper Citation Record · LEDGER

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition

As of 17 August 2026, this Paper Citation Record lists 40 of 40 outbound references and 0 inbound Pith citation observations for arXiv:2606.03657.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.03657 v1

Coverage vector

measured 40 of 40 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-28T09:44:28.026904Z

measured 40 of 40 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

40 of 40 outbound references displayed

verified exact4
verified fuzzy0
unresolved36
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e7955a95-c823-4fb1-bfe4-d951f49a7fca · outbound

This paper cites CodeUpdateArena: Benchmarking Knowledge Editing on.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition CodeUpdateArena: Benchmarking Knowledge Editing on

Reference 1

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation adacd601-b33c-475d-a44a-80c66bda4e1a · outbound

This paper cites 2025 , url=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , url=

Reference 2

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6eb24062-fb32-4951-8d11-da6ea2dcc34a · outbound

This paper cites L ib E volution E val: A Benchmark and Study for Version-Specific Code Generation.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition L ib E volution E val: A Benchmark and Study for Version-Specific Code Generation

Reference 3

Resolution: verified exact; doi, observed 2026-06-28T09:51:51.016579Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e524a271-da3d-4997-b557-92fdd0ee02fd · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 4

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0397b38e-bc41-47c7-b00a-59d33262fe4b · outbound

This paper cites RustEvo^2: An Evolving Benchmark for API Evolution in LLM-based Rust Code Generation.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition RustEvo^2: An Evolving Benchmark for API Evolution in LLM-based Rust Code Generation

Reference 5

Resolution: verified exact; arxiv_id, observed 2026-07-02T03:46:32.453747Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 9c247155-2802-4b1d-834f-4a3357917ad1 · outbound

This paper cites The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=

Reference 6

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation deecd15e-1726-4ef9-8f69-a067f2dbb2cb · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 7

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 85a44002-9ffc-47a5-8e5f-b436a2d8ff94 · outbound

This paper cites 2023 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2023 , eprint=

Reference 8

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d62c6b7d-f855-4382-869a-1e4599daf2d2 · outbound

This paper cites 2024 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2024 , eprint=

Reference 9

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 48ba2073-e115-4440-bc83-56da00c56b7a · outbound

This paper cites 2024 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2024 , eprint=

Reference 10

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5a910da-6b13-4a6a-95dc-9f411509ad67 · outbound

This paper cites 2024 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2024 , eprint=

Reference 11

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5dae01cb-e0f7-4187-a93a-641857bb9af2 · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 12

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 679a0598-d0da-4856-a9f1-e19046dea0e8 · outbound

This paper cites The Thirteenth International Conference on Learning Representations , year=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition The Thirteenth International Conference on Learning Representations , year=

Reference 13

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be0491e9-eb51-497f-a202-a44a524dadb4 · outbound

This paper cites Aging with.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition Aging with

Reference 14

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 834ae697-739c-4c28-9b1b-b7458fbcfc5e · outbound

This paper cites The Eleventh International Conference on Learning Representations , year=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition The Eleventh International Conference on Learning Representations , year=

Reference 15

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9407a7b4-362e-40ad-b9ba-25990e1b538a · outbound

This paper cites Locating and Editing Factual Associations in.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition Locating and Editing Factual Associations in

Reference 16

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e0b11e7-c42d-41e9-9990-015476618eb8 · outbound

This paper cites A Comparative Analysis of.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition A Comparative Analysis of

Reference 17

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4cfce44-da79-458e-8e4e-81914a93e10a · outbound

This paper cites Efficient Knowledge Injection in.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition Efficient Knowledge Injection in

Reference 18

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eb496769-3f74-4e92-a04c-db77ad56db46 · outbound

This paper cites Forty-second International Conference on Machine Learning , year=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition Forty-second International Conference on Machine Learning , year=

Reference 19

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 15d8f8bf-e1b7-4b90-a77f-9741b6404267 · outbound

This paper cites The use of mmr, diversity-based reranking for reordering documents and producing summaries.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition The use of mmr, diversity-based reranking for reordering documents and producing summaries

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-06-28T09:51:51.014753Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e3687fcc-0e94-4d8d-90c1-74e385c44d82 · outbound

This paper cites 2026 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2026 , eprint=

Reference 21

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 603b3fd2-7d38-482d-ae42-17f1bd85487b · outbound

This paper cites 2023 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2023 , eprint=

Reference 22

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5a5021e-ff86-427b-b062-ca13d5b20d70 · outbound

This paper cites 2023 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2023 , eprint=

Reference 23

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66573219-cdce-4260-8c2a-2b40899885e2 · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 24

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation afa0da87-0afa-4b5f-8298-12041cc8226e · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 25

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b2b861d1-83af-4880-93f8-2d170ddd1396 · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 26

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c77a100a-7ea1-4c27-b8c1-20df6ace32b3 · outbound

This paper cites 2021 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2021 , eprint=

Reference 27

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ebe705ff-d361-4707-a9dc-af5a6d143cf5 · outbound

This paper cites 2024 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2024 , eprint=

Reference 28

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 001b22eb-3c91-42a9-bca6-da4ae5b7d99c · outbound

This paper cites 2021 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2021 , eprint=

Reference 29

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f6df33c-c9d2-4462-bc5f-97ff5dc5e4ae · outbound

This paper cites 2024 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2024 , eprint=

Reference 30

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a5d7772-203f-4178-8385-a9194dc6767e · outbound

This paper cites 2026 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2026 , eprint=

Reference 31

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e73944d-d38e-47d0-a6fe-2f1da66e52ae · outbound

This paper cites 2026 , url=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2026 , url=

Reference 32

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 58264692-7bef-48d9-afa0-34d73eaf6dc2 · outbound

This paper cites 2024 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2024 , eprint=

Reference 33

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 751eff6c-46f7-45e4-b321-76b2dee6791b · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 34

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 409213ee-78e0-4463-bedd-2aa6bbae907e · outbound

This paper cites 2022 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2022 , eprint=

Reference 35

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ce9df547-834d-4e57-898b-b979c876143f · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 36

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 926d1054-99ed-4be9-a396-3721bf48e717 · outbound

This paper cites 2025 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2025 , eprint=

Reference 37

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e745ba0-8bd5-412c-a085-88e9bab000d3 · outbound

This paper cites doi: 10.1038/s41586-025-09422-z.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition doi: 10.1038/s41586-025-09422-z

Reference 38

Resolution: verified exact; doi, observed 2026-06-28T09:51:51.012252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 61f48963-e39c-46f4-a0fd-9ee8f35b7b34 · outbound

This paper cites 2021 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2021 , eprint=

Reference 39

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a566521-491e-422b-8e2f-6260c1ee5db2 · outbound

This paper cites 2021 , eprint=.

Diagnosing Knowledge Gaps in LLM Tool Use: An Agentic Benchmark for Novel API Acquisition 2021 , eprint=

Reference 40

Resolution: unresolved; no resolver link, observed 2026-06-28T09:44:28.026904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.