Pith. sign in

Paper Citation Record · LEDGER

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

As of 20 August 2026, this Paper Citation Record lists 15 of 15 outbound references and 8 inbound Pith citation observations for arXiv:2509.07315.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2509.07315 v1

Coverage vector

measured 15 of 15 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-04T22:30:34.253827Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T05:54:53.426020Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T22:17:26.189855Z

Reference resolution

15 of 15 outbound references displayed

  • verified exact0
  • verified fuzzy8
  • unresolved7
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2050139c-1a41-4dc2-8342-07398f929c80 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.638129Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.163604Z digest=sha256:4dc87d0726eb1683379f41e253f7aab6b3d4cc9ed29bcdde8ec77fa3e520f477

Observation 75380eee-d842-40d7-a7ba-246666bae247 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.617520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.171460Z digest=sha256:e6c9ed7597d7b5285acd9894f35c601a5f5dba05a28f2d5ffc91d4abbdfd2de0

Observation c67cf03c-def7-41f4-8a9b-f17e657514bd · outbound

This paper cites List of APPs: {app_list} Table 6: Prompts to generate the commonly used func- tions in each APP.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs List of APPs: {app_list} Table 6: Prompts to generate the commonly used func- tions in each APP

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.592795Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.178652Z digest=sha256:c48bd0e74fdfac7bee6b9591a4d571d2ae26291ff438119bdca4cf97cb5f69ce

Observation a44b9421-5187-4cb8-a250-c531f5d25167 · outbound

This paper cites Risk Categories:.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Risk Categories:

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.439571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.228087Z digest=sha256:24bcdfef9efce48778503d24763448c56b708a2a4390acf0dc7c70c9f19e5736

Observation 8eb0e722-b5c9-413d-89f7-ea14220ae1cd · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.570784Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.185097Z digest=sha256:fba4b8e4d2393e716b0a5dd5ad1e2639747d7321a03d0e3607ba28c2d2dda9af

Observation ff37ea1c-1f92-4da2-80ca-7460304dd5a5 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.547763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.191744Z digest=sha256:438a7f57032baa90f4a2bfd4c03bc242ac45d3faaeaae75029a8587e1f575b2f

Observation 80007074-a3b9-4c4e-bb3a-d5d770d94db9 · outbound

This paper cites app_name.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs app_name

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.528537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.199960Z digest=sha256:8b6eef6107eca68e33d710374ced10b8724901bd1772a5bae5246c9e0b9be814

Observation 514a2bb1-c8a3-4152-b131-b79b9c823947 · outbound

This paper cites Please ensure the instructions are natural and realis- tic as if a user were speaking or typing them to trigger the API calls.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Please ensure the instructions are natural and realis- tic as if a user were speaking or typing them to trigger the API calls

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.505886Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.207921Z digest=sha256:f432aea8d1f5c3750f0825abf1502b0adf82fb71e4038d33c65fab771243ee84

Observation 6d97bd0d-e762-405d-9ae5-10d0fafcf43a · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.484173Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.213967Z digest=sha256:69e94af83f980384ae828da988ca6b576d2c1f6e74fa1adb0d4b5f5af2ecd45b

Observation fceeccb2-8993-4591-a673-67297cdae663 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.463400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.220591Z digest=sha256:d61a86046bbf6b802ea9fed5ed208166c12a1f57972660324cfadabfe3f99b43

Observation 73f460c4-952c-440a-8dea-024bc4e0cea3 · outbound

This paper cites Privacy breaches may include but are not limited to, unintended exposure of the user’s identity information, financial data, medical records, communication contents, etc.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Privacy breaches may include but are not limited to, unintended exposure of the user’s identity information, financial data, medical records, communication contents, etc

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.415804Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.234033Z digest=sha256:67dfd0fc1b01a4f502807289a7f83c36af1220e701ccdce5320234b964d9a480

Observation 5220a71f-559e-42fb-bd91-b1d216e6a7ba · outbound

This paper cites For example, the model may inadvertently trigger or directly execute large bank transfers, payment requests, or recurring transactions.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs For example, the model may inadvertently trigger or directly execute large bank transfers, payment requests, or recurring transactions

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.392092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.240298Z digest=sha256:9947cd7640addff26487731c9e9e8dcb4f758ad907db0402acb755213dbcca20

Observation 7c69ebd2-991b-4860-8e33-b457d6f75ab8 · outbound

This paper cites If these operations are not properly safety-checked or fail to foresee potential issues, they may trigger unsafe behaviors that result in physical injury.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs If these operations are not properly safety-checked or fail to foresee potential issues, they may trigger unsafe behaviors that result in physical injury

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.369570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.247759Z digest=sha256:e5c9b94ced14e7a5577489013685a3701eaf6d25e3bf2ded4afb1b31ca9e3d54

Observation 3a5153c2-e867-4061-b00b-c2e400db9149 · outbound

This paper cites in- struction.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs in- struction

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.340435Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-04T22:30:34.253827Z digest=sha256:9541ecf548878c20fce17879a95677eaba8fe137a757b4be99f37fea25d8af96

Observation 64717eeb-59d7-4c39-9848-cadf5261bfce · outbound

This paper cites Safety Assessment of Chinese Large Language Models.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Safety Assessment of Chinese Large Language Models

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-04T22:30:34.155084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T22:30:34.155084Z digest=sha256:4845ed306aa4248b2a5b635b93e0ace0a943e6327ee98430d03536262aa719f4

Pith citing papers

Observation 26540f43-af16-4e7e-bb42-cb33189006f4 · inbound

FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use cites this paper.

FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-04T05:54:53.426020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T05:54:53.426020Z digest=sha256:5408c9a6af719a34c2a6c8370b65794d6a03225088a7186db2bcc1e2e4166dd7

Observation 95508fda-bf94-430c-a71d-f7a90d1ee718 · inbound

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis cites this paper.

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-05-13T21:18:17.102437Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-05-13T21:17:15.523370Z digest=sha256:0c12a3f34f0b4435073e84766ee363962a55283bb32b0a694bfdef6927d8f3ac

Observation db1b3e41-99d2-49b5-9100-739846f540a9 · inbound

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis cites this paper.

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-05-14T22:03:02.643434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-05-14T22:02:00.638549Z digest=sha256:93498faf2cc5f34d93610e7a73d750130c45692fa791acd44f7db36857eb0ec2

Observation d483be65-f2a2-4b3f-bcac-69127812b014 · inbound

Measuring the Permission Gate: A Stress-Test Evaluation of Claude Code's Auto Mode cites this paper.

Measuring the Permission Gate: A Stress-Test Evaluation of Claude Code's Auto Mode SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 1

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T17:13:01.171575Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-13T17:10:59.118032Z digest=sha256:a0bacd08df23e0ebec010b7e5cc106bd4d00a65120ab3650d53a273c8075dc6a

Observation e1ef2c08-0e70-4678-b327-3718a55b296e · inbound

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents cites this paper.

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 55

Resolution
verified exact
arxiv_id, observed 2026-05-21T01:43:56.686578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-05-21T01:42:55.693115Z digest=sha256:8b8fc50349c85e19adfd0dda5c2b069044f39ebe6f33dde6eb777bb91ec22c02

Observation b843ab4b-6485-49c4-b757-1c8d8e28238a · inbound

Memory-Induced Tool-Drift in LLM Agents cites this paper.

Memory-Induced Tool-Drift in LLM Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 38

Resolution
verified exact
arxiv_id, observed 2026-06-30T00:24:04.405169Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-06-30T00:14:36.908022Z digest=sha256:7ede6e7eac04fa93798c7ec1bbd7e3f3bbd82f86f774d3f4fff0c81dfc75c3bf

Observation a6f2d081-73ad-43dd-949e-bab350067458 · inbound

ForesightSafety-SAGE:A Fully Automated Scenario Generation and Safety Evaluation Framework for LLM Agents cites this paper.

ForesightSafety-SAGE:A Fully Automated Scenario Generation and Safety Evaluation Framework for LLM Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 27

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T22:17:26.191427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-06-27T19:02:36.999393Z digest=sha256:360ee69563ebc336f814ba0fd001e0d6a841d35f8e07ae1cdae51c8b46d4f6c8

Observation 1672d1f7-f840-4c5a-88d9-0909195994ad · inbound

Guardrails as Scapegoats: Auditing Unfaithful Safety Refusals in Tool-Augmented LLM Agents cites this paper.

Guardrails as Scapegoats: Auditing Unfaithful Safety Refusals in Tool-Augmented LLM Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T13:32:29.176874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T13:32:29.176874Z digest=sha256:8acd69798d06be0fabc331c005c9ac5739c0e510ef3267a5889f827b942bef64