Pith. sign in

REVIEW 6 cited by

APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.18518 v1 pith:DJQ47AEO submitted 2024-06-26 cs.CL cs.AIcs.LGcs.SE

Zuxin Liu , Thai Hoang , Jianguo Zhang , Ming Zhu , Tian Lan , Shirley Kokane , Juntao Tan , Weiran Yao
show 9 more authors
Zhiwei Liu Yihao Feng Rithesh Murthy Liangwei Yang Silvio Savarese Juan Carlos Niebles Huan Wang Shelby Heinecke Caiming Xiong
This is my paper · ORCID
classification cs.CLcs.AIcs.LGcs.SE
keywords datasetsfunction-callingapigendatasetdiversehigh-qualitymodelsagent
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The advancement of function-calling agent models requires diverse, reliable, and high-quality datasets. This paper presents APIGen, an automated data generation pipeline designed to synthesize verifiable high-quality datasets for function-calling applications. We leverage APIGen and collect 3,673 executable APIs across 21 different categories to generate diverse function-calling datasets in a scalable and structured manner. Each data in our dataset is verified through three hierarchical stages: format checking, actual function executions, and semantic verification, ensuring its reliability and correctness. We demonstrate that models trained with our curated datasets, even with only 7B parameters, can achieve state-of-the-art performance on the Berkeley Function-Calling Benchmark, outperforming multiple GPT-4 models. Moreover, our 1B model achieves exceptional performance, surpassing GPT-3.5-Turbo and Claude-3 Haiku. We release a dataset containing 60,000 high-quality entries, aiming to advance the field of function-calling agent domains. The dataset is available on Huggingface: https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k and the project homepage: https://apigen-pipeline.github.io/

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ISE: An Execution-Grounded Recipe for Multi-Turn OS-Agent Trajectories

    cs.CL 2026-06 conditional novelty 7.0 of 10

    ISE creates 23,132 execution-grounded multi-turn OS agent trajectories via intent simulation and live execution, improving agent performance on ClawEval from 19.3 to 37.7 pass@1 with Qwen3-8B.

  2. Gecko: A Simulation Environment with Stateful Feedback for Refining Agent Tool Calls

    cs.SE 2026-02 conditional novelty 6.0 of 10

    A simulated tool environment with argument validation, response synthesis, and task-state feedback improves LLM tool-call accuracy at test time.

  3. SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agents

    cs.AI 2025-09 conditional novelty 6.0 of 10

    A 20B autonomously reasoning deep-research agent trained with synthetic-data RL reaches 28.7% on Humanity's Last Exam, exceeding several larger and proprietary baselines.

  4. MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Models

    cs.IR 2025-07 conditional novelty 6.0 of 10

    A multi-task retriever that combines tool-usage detection with query-centered graph and search-based modules improves tool retrieval accuracy over prior baselines.

  5. The "I Don't Know" Filter: Enhancing Agentic Reliability in Function Calling

    cs.SE 2026-07 conditional novelty 5.5 of 10

    A multi-sample uncertainty classifier filter improves agent reliability (IDKS) by abstaining on uncertain function calls across open SLMs and BFCL-style benchmarks.

  6. RAG Strategies for Natural Language-Based SQL Query and REST API Call Generation

    cs.SE 2026-02 conditional novelty 5.0 of 10

    In a 631-case enterprise benchmark, iterative retrieval (CoRAG) achieved 10.29% exact match vs 7.45% for standard RAG on combined SQL/API generation with hybrid documentation, while no-RAG gives 0% exact match.

Pith tools