Pith. sign in

Paper Citation Record · LEDGER

Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 12 inbound Pith citation observations for arXiv:2401.17167.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2401.17167 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 12 of 12 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 12 of 12 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-09T15:31:48.236009Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:39:16.733366Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 3c5edbc2-1d83-46d5-b20e-e23dd50f19ca · inbound

Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant cites this paper.

Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-09T15:31:48.236009Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T15:31:48.236009Z digest=sha256:488b102f36cc0e135d601efb6b03d564afd97d8f064cfceb713f6203998de3ef

Observation a7f450c4-f13d-42b0-a42c-eb92c8f52191 · inbound

Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions cites this paper.

Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-13T09:02:40.402803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-13T09:02:40.294491Z digest=sha256:1459b7b7c3f08576eefec510684151de0dfda00050276b80e40c1f577d35f516

Observation 5c5bf0e2-efbc-417e-9aa0-c76a55063d69 · inbound

TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments cites this paper.

TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:15.252193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T14:46:15.252193Z digest=sha256:b576b07376f54dd08eb5f505b3e648ee23d10a26098bf52ae9310d8b30949e87

Observation 4e7bea7b-2027-42a1-9dce-628002c669d4 · inbound

Invisible Tokens, Visible Bills: The Urgent Need to Audit Hidden Operations in Opaque LLM Services cites this paper.

Invisible Tokens, Visible Bills: The Urgent Need to Audit Hidden Operations in Opaque LLM Services Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T14:34:34.802691Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:34:34.802691Z digest=sha256:2cc629b2ac891877c1fcc21b5f77d694eaf6f1c92826b6865acd23c890d4ca8d

Observation 4fc4bbf7-5c21-47fb-b7ea-9cf6057d8c3f · inbound

Teaching a Language Model to Speak the Language of Tools cites this paper.

Teaching a Language Model to Speak the Language of Tools Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T21:48:47.386705Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:48:47.386705Z digest=sha256:6e34cc78a8c921b07b997af8bdefdb53a022562a69ace050952be4add8c97b93

Observation c646e42c-ffb6-48e4-a6c5-ed2d97f295fe · inbound

MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Models cites this paper.

MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Models Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T21:22:43.715829Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:22:43.715829Z digest=sha256:e629485c3630070e207abf556b3c937af8df4f08901f39652777e0fc98080cd4

Observation 018f0567-62db-4bf4-82f9-7e0ac2f1ae47 · inbound

Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems cites this paper.

Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T15:39:56.955694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T15:39:56.955694Z digest=sha256:f0f47fcb1b1b0ff6033d0d45d03dab85089ec9b5c68fbcaae95fb4f5899e7c79

Observation ddc8bbc5-b8cd-498b-95d8-46c6594ca00e · inbound

AIAP: A No-Code Workflow Builder for Non-Experts with Natural Language and Multi-Agent Collaboration cites this paper.

AIAP: A No-Code Workflow Builder for Non-Experts with Natural Language and Multi-Agent Collaboration Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T05:00:31.896011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:00:31.896011Z digest=sha256:60eea9e0a873d64c93e9dc5ab03e2b7c3bfdb0f7c107217af104c6def1097289

Observation 8c0c40d3-4d15-4847-90b3-085dce7d6ee9 · inbound

Failure Makes the Agent Stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions cites this paper.

Failure Makes the Agent Stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-18T15:01:31.407428Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-18T15:00:51.162221Z digest=sha256:550fa13717794d5abbd273c7d6b96d69b9bbdb57eafeb0b518e5bcccfa1210ca

Observation b67d2647-2420-438b-a309-59be4c6c8a27 · inbound

Characterizing Web Search in The Age of Generative AI cites this paper.

Characterizing Web Search in The Age of Generative AI Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-04T10:08:56.601594Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T10:08:56.601594Z digest=sha256:12541727798a05646cf470a1ae2da458484f506fdbc43f62af17b6820dbcc026

Observation ce6a98af-01ee-4af3-a5b5-50a5ca6356c1 · inbound

Toward Efficient Agents: Memory, Tool learning, and Planning cites this paper.

Toward Efficient Agents: Memory, Tool learning, and Planning Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-03T09:21:36.199978Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T09:21:36.199978Z digest=sha256:f3d5c50cb62d1596ccb10cebbe5034dc6bac7cbd30ecd37ff4f3fa1d28fa259d

Observation c79c263f-4de7-4840-bd50-7150438098fe · inbound

PEC-Home: Interpretation of Progressively Elliptical Commands in Smart Homes cites this paper.

PEC-Home: Interpretation of Progressively Elliptical Commands in Smart Homes Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios

Reference 26

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T00:39:16.735009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-06-26T21:06:36.528009Z digest=sha256:a1b672c5dab9711fc3df1ec971c2b8996b62b25df03aa42885f7cec3100eeb25