Pith. sign in

Paper Citation Record · LEDGER

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

As of 9 August 2026, this Paper Citation Record lists 15 of 15 outbound references and 8 inbound Pith citation observations for arXiv:2509.07315.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2509.07315 v1

Coverage vector

measured 15 of 15 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-04T22:30:34.253827Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T05:54:53.426020Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T22:17:26.189855Z

Reference resolution

15 of 15 outbound references displayed

  • verified exact0
  • verified fuzzy8
  • unresolved7
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2050139c-1a41-4dc2-8342-07398f929c80 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.638129Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.163604Z digest=sha256:5a30bb2351547980b92888dbb55f797f4e59180c9b99a6328d36de5333e42282

Observation 75380eee-d842-40d7-a7ba-246666bae247 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.617520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.171460Z digest=sha256:168e3ff663207635e58f37c63b7f5e6b712a24b952b06c26666f27d6b7103466

Observation c67cf03c-def7-41f4-8a9b-f17e657514bd · outbound

This paper cites List of APPs: {app_list} Table 6: Prompts to generate the commonly used func- tions in each APP.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs List of APPs: {app_list} Table 6: Prompts to generate the commonly used func- tions in each APP

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.592795Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.178652Z digest=sha256:43407d04bc523ebe88820085443a52181485021db19a4681c43d110cdedb69ba

Observation a44b9421-5187-4cb8-a250-c531f5d25167 · outbound

This paper cites Risk Categories:.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Risk Categories:

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.439571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.228087Z digest=sha256:881b623796a484d500ee522262be8c0ee77180752470a1423a4f224c8066a7d4

Observation 8eb0e722-b5c9-413d-89f7-ea14220ae1cd · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.570784Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.185097Z digest=sha256:792aefda0a5d3fee26d117c1d32c7902387bcdafb613d8ab6c2b4b8ef8ece54c

Observation ff37ea1c-1f92-4da2-80ca-7460304dd5a5 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.547763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.191744Z digest=sha256:c883803da16274b6719c5c82cbc1fd6f559bfc018a039f2070a943e136aaecb4

Observation 80007074-a3b9-4c4e-bb3a-d5d770d94db9 · outbound

This paper cites app_name.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs app_name

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.528537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.199960Z digest=sha256:ff6e80259244e0120da0feb7625126dbc6fe6082efb860a40fdba15c07663c2e

Observation 514a2bb1-c8a3-4152-b131-b79b9c823947 · outbound

This paper cites Please ensure the instructions are natural and realis- tic as if a user were speaking or typing them to trigger the API calls.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Please ensure the instructions are natural and realis- tic as if a user were speaking or typing them to trigger the API calls

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.505886Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.207921Z digest=sha256:d31bbc22e774f8f67acdf8e9b68a0e7d1c44694d9402796d88ea256bb02d105b

Observation 6d97bd0d-e762-405d-9ae5-10d0fafcf43a · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.484173Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.213967Z digest=sha256:44cb0be322bb580bc715c687cb4e7c975375a78226a38ca2972eb64110f75749

Observation fceeccb2-8993-4591-a673-67297cdae663 · outbound

This paper cites an unresolved cited work.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-04T22:30:34.463400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.220591Z digest=sha256:a1dad38c33b4ce5cc7870dcb59cbfa091f28bb19d04fcfcda9de52173614a4d9

Observation 73f460c4-952c-440a-8dea-024bc4e0cea3 · outbound

This paper cites Privacy breaches may include but are not limited to, unintended exposure of the user’s identity information, financial data, medical records, communication contents, etc.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Privacy breaches may include but are not limited to, unintended exposure of the user’s identity information, financial data, medical records, communication contents, etc

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.415804Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.234033Z digest=sha256:3891709bb012eac93bae511e7b5524d02297b2c67ba0400a385713fb882fc4b1

Observation 5220a71f-559e-42fb-bd91-b1d216e6a7ba · outbound

This paper cites For example, the model may inadvertently trigger or directly execute large bank transfers, payment requests, or recurring transactions.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs For example, the model may inadvertently trigger or directly execute large bank transfers, payment requests, or recurring transactions

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.392092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.240298Z digest=sha256:023a7f152cacda99ce4ffc59dbfd78fbc419b2c71397a7f256d63379e7e0181c

Observation 7c69ebd2-991b-4860-8e33-b457d6f75ab8 · outbound

This paper cites If these operations are not properly safety-checked or fail to foresee potential issues, they may trigger unsafe behaviors that result in physical injury.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs If these operations are not properly safety-checked or fail to foresee potential issues, they may trigger unsafe behaviors that result in physical injury

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.369570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.247759Z digest=sha256:2483c08382fb59f6b3aeedae4d0d23e140d5e3ae263aef5f9c17877020642aed

Observation 3a5153c2-e867-4061-b00b-c2e400db9149 · outbound

This paper cites in- struction.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs in- struction

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-04T22:30:34.340435Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-04T22:30:34.253827Z digest=sha256:0c13be2d434b3c5287d18bf5dc7f233f62f4abaa42245296a378c97087a604dd

Observation 64717eeb-59d7-4c39-9848-cadf5261bfce · outbound

This paper cites Safety Assessment of Chinese Large Language Models.

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs Safety Assessment of Chinese Large Language Models

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-04T22:30:34.155084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T22:30:34.155084Z digest=sha256:5a81f81976b39a7a9c0017fc2a2b764a719994da4c3d3a766456d7c921e9b58d

Pith citing papers

Observation 26540f43-af16-4e7e-bb42-cb33189006f4 · inbound

FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use cites this paper.

FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-04T05:54:53.426020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T05:54:53.426020Z digest=sha256:4f2a151ccd78805c1139481e0fee21855524116116e952e2ea0f1c942354cfdc

Observation 95508fda-bf94-430c-a71d-f7a90d1ee718 · inbound

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis cites this paper.

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-05-13T21:18:17.102437Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-13T21:17:15.523370Z digest=sha256:0c76c0b889fadf8bc5dbc247975cd1d0f05380216496f3939f5b616af08020b8

Observation db1b3e41-99d2-49b5-9100-739846f540a9 · inbound

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis cites this paper.

ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-05-14T22:03:02.643434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-14T22:02:00.638549Z digest=sha256:71cd7fb372fd28a967d15a86025d71ed9e8374e0c8ee5b26021d7bb080054219

Observation d483be65-f2a2-4b3f-bcac-69127812b014 · inbound

Measuring the Permission Gate: A Stress-Test Evaluation of Claude Code's Auto Mode cites this paper.

Measuring the Permission Gate: A Stress-Test Evaluation of Claude Code's Auto Mode SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 1

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T17:13:01.171575Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-13T17:10:59.118032Z digest=sha256:6033f1d63a78e049e324408c3c925fd5cef405c0f4479491bb649f651bdb35e0

Observation e1ef2c08-0e70-4678-b327-3718a55b296e · inbound

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents cites this paper.

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 55

Resolution
verified exact
arxiv_id, observed 2026-05-21T01:43:56.686578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-21T01:42:55.693115Z digest=sha256:47a5334d7705b5a511a60fff57bd8a6550891eaa656f0a34358cf9954988184e

Observation b843ab4b-6485-49c4-b757-1c8d8e28238a · inbound

Memory-Induced Tool-Drift in LLM Agents cites this paper.

Memory-Induced Tool-Drift in LLM Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 38

Resolution
verified exact
arxiv_id, observed 2026-06-30T00:24:04.405169Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-30T00:14:36.908022Z digest=sha256:4e72a4b8020748a270fcb638a35287789e2fff18f17bd071a8f0c0f773ef3d55

Observation a6f2d081-73ad-43dd-949e-bab350067458 · inbound

VESTA: A Fully Automated Scenario Generation and Safety Evaluation Framework for LLM Agents cites this paper.

VESTA: A Fully Automated Scenario Generation and Safety Evaluation Framework for LLM Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 27

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T22:17:26.191427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-27T19:02:36.999393Z digest=sha256:990f7118957f52f648f7744952cfe8592426427dfdd3388cac56399eb1b49151

Observation 1672d1f7-f840-4c5a-88d9-0909195994ad · inbound

Guardrails as Scapegoats: Auditing Unfaithful Safety Refusals in Tool-Augmented LLM Agents cites this paper.

Guardrails as Scapegoats: Auditing Unfaithful Safety Refusals in Tool-Augmented LLM Agents SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T13:32:29.176874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T13:32:29.176874Z digest=sha256:2d217ac223f38796f5db29bd1289c4f7135143ae39c03b8fb2a5b8612d5ea4b2