Pith. sign in

Paper Citation Record · LEDGER

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

As of 23 August 2026, this Paper Citation Record lists 100 of 142 outbound references and 5 inbound Pith citation observations for arXiv:2505.18223.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.18223 v2

Coverage vector

measured 100 of 142 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:46:56.334492Z

measured 105 of 105 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T04:39:03.476630Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

100 of 142 outbound references displayed

  • verified exact0
  • verified fuzzy15
  • unresolved84
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation ecc08bef-6e53-407b-90a6-bd6714fc6d3b · outbound

This paper cites https://openai.com/chatgpt/overview/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://openai.com/chatgpt/overview/

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.375570Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.375570Z digest=sha256:9128a20d6147be79eed80843befacff599e4f9797a3a27dad57eb510621a0910

Observation a41767eb-7ca6-4088-954c-269d6eab8387 · outbound

This paper cites https://kdigo.org/guidelines/ ckd-evaluation-and-management/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://kdigo.org/guidelines/ ckd-evaluation-and-management/

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.422036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.422036Z digest=sha256:7186b24cfa4671129ae2087460694146a1775956acf08f78985a0951100f1afb

Observation 0ec5e043-740e-41ab-8cc8-d2b9a2160b9a · outbound

This paper cites https://claude.ai/login?returnTo=%2F%3F.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://claude.ai/login?returnTo=%2F%3F

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.538518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.538518Z digest=sha256:261405e7de7a9b006da6a4130dfbe04d7ca1d9824dd67cfdaa25b9deced8492d

Observation ed4e1285-fefe-4e8d-b6e1-3edd4299a2fd · outbound

This paper cites https://www.deepseek.com/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.deepseek.com/

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.644511Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.644511Z digest=sha256:61a15fa7087c930738480df099f5ab2499fe2adb7699e9914692cede3a04e847

Observation 17dcf292-639c-4df1-92b5-313b86dbeed5 · outbound

This paper cites https:// playwright.dev/python/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https:// playwright.dev/python/

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.751152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.751152Z digest=sha256:f008f7a6a4e890ace061e3f295df5d5da9f7d93c0a7efe880fc8de4e8e403565

Observation 12090ef0-2de9-4b51-96f1-f07cf0f1200c · outbound

This paper cites https://gemini.google.com/app.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://gemini.google.com/app

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.835901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.835901Z digest=sha256:7e18fc68e070844aa55acdd3810f8c527597cd8c4f87b34ed94557c3178355e5

Observation 77e27f61-5a20-4d86-9a52-6596c68fba6f · outbound

This paper cites https://grok.com/?ref=findaitools.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://grok.com/?ref=findaitools

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.906553Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.906553Z digest=sha256:c88722a51f2472d877faaa29668efd863a92a71f3a547a3579625f1f18f581f3

Observation fd3e7bcf-80ca-424c-b9ed-081d2689aa73 · outbound

This paper cites https://openai.com/index/ improvements-to-data-analysis-in-chatgpt/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://openai.com/index/ improvements-to-data-analysis-in-chatgpt/

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.019029Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.019029Z digest=sha256:0665a95dcc1514ba12f6eb588cca1ee3b74656b3ffb08c9f641fd17100adfaf3

Observation fcae7a13-e180-435e-b35e-8df02835c009 · outbound

This paper cites https://www.anthropic.com/news/ analysis-tool.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.anthropic.com/news/ analysis-tool

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.103552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.103552Z digest=sha256:ee137745e780255f96441732f13330189c94467fa316614708abd0a2beda984b

Observation 8e32d172-f5d9-4b65-9f9e-b1af06aa87a9 · outbound

This paper cites https://github.com/ jupyterlab/jupyter-ai.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://github.com/ jupyterlab/jupyter-ai

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.197118Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.197118Z digest=sha256:6da50f4cf1a05873545b275b84b58688defc9cd633a92df64616be86acb78a41

Observation 17cef869-52e8-44ac-818f-818f24ec8b60 · outbound

This paper cites https://www.kaggle.com/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.kaggle.com/

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.280980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.280980Z digest=sha256:b96aa2c9adea400edd1b9375b64f3c31a98218ccb80d70709034376a0f9d804a

Observation 220e6105-e3d3-44f4-a087-ef6266520e49 · outbound

This paper cites https://docs.litellm.ai/docs/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://docs.litellm.ai/docs/

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.354070Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.354070Z digest=sha256:4c21efe18eedd7675a5b419bacdce5c646f7f28b4f2b7bd0c75f1800e2234635

Observation b327b415-f453-4565-a74a-c816d7cf279e · outbound

This paper cites https://www.llama.com/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.llama.com/

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.461121Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.461121Z digest=sha256:7a97feb2d63d9b647f3e0e75a8540de54252fd454813a72d38e8b1e0bf87e914

Observation e1af57cb-18b0-401e-bcf5-60318fa7072a · outbound

This paper cites https://corporatefinanceinstitute.com/ resources/financial-modeling/modeloff-guide/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://corporatefinanceinstitute.com/ resources/financial-modeling/modeloff-guide/

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.539289Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.539289Z digest=sha256:0fff0d0464974271a1503ef44dd45ee1b6eb93b36f3ca2ae300907c12ddb01ac

Observation f29a29f3-9504-43be-b4fe-f2acdad40c95 · outbound

This paper cites https://openai.com/index/ o3-o4-mini-system-card/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://openai.com/index/ o3-o4-mini-system-card/

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.624374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.624374Z digest=sha256:a8c66c30e124653303fe2fa689c463dcc09bb87522787a4d7817746f4c97dc01

Observation 55ecbb75-05d9-4bc2-a787-3e58880c994e · outbound

This paper cites https://kaggle.com/code/alexisbcook/titanic-tutorial.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://kaggle.com/code/alexisbcook/titanic-tutorial

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.716807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.716807Z digest=sha256:1050448d5f090dcf23307f2f9b7b940cb3441bef325a416c4f23092fdf3f26d7

Observation 4687eb9c-b3e6-4030-8e45-1afd5713a692 · outbound

This paper cites https://www.vectara.com/blog/ deepseek-r1-hallucinates-more-than-deepseek-v3 , January 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.vectara.com/blog/ deepseek-r1-hallucinates-more-than-deepseek-v3 , January 2025

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.823526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.823526Z digest=sha256:76f85907b47da463d6496f8a45f860d80fe8fab8dbf53df7ab8b6d0519f07e7d

Observation a698d4cf-d334-407d-af67-bf19a9a02aef · outbound

This paper cites Open Interpreter, May 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Open Interpreter, May 2025

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.901910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.901910Z digest=sha256:2d61448195f2a5344874c4f9a602bce34e917aa48c827a8ff8eb191fe8c6d8d0

Observation 07a9dd83-13f9-4c37-9576-b59a4c52162f · outbound

This paper cites Wang, Ruoxi Sun, Pengcheng Yin, Caiming Xiong, Ansong Ni, Qian Liu, et al.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Wang, Ruoxi Sun, Pengcheng Yin, Caiming Xiong, Ansong Ni, Qian Liu, et al

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.002506Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.002506Z digest=sha256:0b87329c2feee432e4bb9a6863843c94f1f7b23b35c4ae446251df95f3c926a3

Observation 8ad22ae2-09e4-42c1-aab4-d0d2f5cb6386 · outbound

This paper cites Beyond Prompts: Dynamic Conversational Benchmarking of Large Language Models.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Beyond Prompts: Dynamic Conversational Benchmarking of Large Language Models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.146885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.146885Z digest=sha256:51fca2f8f6a5f0933e40fa184fc13e9f5d455e701344e5821b34251edc54e8f2

Observation 2e918e4a-0b65-44f3-9b62-c41910c0a583 · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.237419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.237419Z digest=sha256:9b08dbcb32244e5118e28ca799cbeb2465bd3fe6937f113dfc8e721b1280200c

Observation df06d733-c902-43df-9227-a54d2731aed1 · outbound

This paper cites Early Childhood Behavioral Inhibition and Social and School Adjustment in Chinese Children: A 5-Year Longitudinal Study.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Early Childhood Behavioral Inhibition and Social and School Adjustment in Chinese Children: A 5-Year Longitudinal Study

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.345478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.345478Z digest=sha256:f9cef92c4d10d9dade9e529d3932c2d166b74335392375bdb2eec0efd392386e

Observation eca5cf31-f3d9-4976-a35d-880601388019 · outbound

This paper cites Behavioral Inhibition in Early Childhood and Adjustment in Late Adolescence in China.Child Development, 92(3):994–1010, 2021.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Behavioral Inhibition in Early Childhood and Adjustment in Late Adolescence in China.Child Development, 92(3):994–1010, 2021

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.442113Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.442113Z digest=sha256:8df4de0d6b6aaee94be79987b7a706091b711e87e5a65b3c60cc700b58365a91

Observation 5c903be9-bd00-43ea-b1e0-4fbf847208b4 · outbound

This paper cites Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.506686Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.506686Z digest=sha256:148c1b4b1207750c9299e99f04cc49c2f191a17f98598c71c1790aeab8d9cef1

Observation 87564adc-cdd4-4ac4-bdad-8f60b51a973e · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.644779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.644779Z digest=sha256:60317c846a39363542d752a0190c77d098573000619c5127d10f37ddec957928

Observation 1e3b15ee-293c-4733-b6e3-4af49fde5232 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.774028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.774028Z digest=sha256:b566e74b0a3ef5a581f0945898f049fa763b93d156ea517494475efb92340113

Observation 9ead89f3-e925-4acf-8c66-4ffe2717f0da · outbound

This paper cites MIND2WEB: Towards a generalist agent for the web.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis MIND2WEB: Towards a generalist agent for the web

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.890873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.890873Z digest=sha256:17b056352e080b7320d58ced9ea2b7c645fcfa9f0adb36ae0d15883deb6696f3

Observation 2fe20fad-f943-4737-bda9-c6edd4795ac7 · outbound

This paper cites Zhang, Lanyi Zhu, Mike A Merrill, Jeffrey Heer, and Tim Althoff.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Zhang, Lanyi Zhu, Mike A Merrill, Jeffrey Heer, and Tim Althoff

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.005144Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.005144Z digest=sha256:65604571b52a3ef8fbbf80a29aeff1fc27a2fc2382ee14910409a4760914489e

Observation 067149e5-a82c-4071-bb41-2f4c2f1f42f7 · outbound

This paper cites ConvCodeWorld: Bench- marking Conversational Code Generation in Reproducible Feedback Environments.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis ConvCodeWorld: Bench- marking Conversational Code Generation in Reproducible Feedback Environments

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.104495Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.104495Z digest=sha256:b7f0d175c9c206e3b01a59a55957b0db35176bbbcaefc3cc10152903d5d8999a

Observation 60934f52-c90c-4d92-92cc-cf81c547b73b · outbound

This paper cites InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.185494Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.185494Z digest=sha256:428094c59827396123da9634ff539aae3bc18df992d717df7936da63d48bd586

Observation d5ed60d4-38f9-460b-b43b-87f2e4bb42fa · outbound

This paper cites MLAgentBench: Evaluating language agents on machine learning experimentation.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis MLAgentBench: Evaluating language agents on machine learning experimentation

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.278411Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.278411Z digest=sha256:8d3fa1e1dbbd94fd2cc4c2ba5f44dabf31391506d13fee3b053a99ebfeb5ba80

Observation 00c6d552-a65e-4b11-b0d8-dd904dcedb00 · outbound

This paper cites SimulBench: Evaluating Language Models with Creative Simulation Tasks.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis SimulBench: Evaluating Language Models with Creative Simulation Tasks

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.397300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.397300Z digest=sha256:64c645171bc7135104d16be283b58f064cf52fa1fd399a629e2aaa14a47385ec

Observation 73a77602-0ddb-4a60-8045-dc76370cd9e9 · outbound

This paper cites Taylor, and Dan Roth.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Taylor, and Dan Roth

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.501633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.501633Z digest=sha256:bbc06f7fad27b014b4655c4425be72b74ae79bbab84f0ce540223d545a102381

Observation df4daca1-9a70-4436-ba7a-c4b4b2c4e9f8 · outbound

This paper cites AIDE: AI-Driven Exploration in the Space of Code, February 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis AIDE: AI-Driven Exploration in the Space of Code, February 2025

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.600200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.600200Z digest=sha256:0c4c9e40a7a44c9277d0bfe1afe4eb6f742f08a78c07669b1dcde18800b20fcc

Observation 55507d96-4c19-4e77-9c5e-00ed4191bdb0 · outbound

This paper cites Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.674757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.674757Z digest=sha256:83149e667bec75e223dc0815a0b3ed95cf07d104c4fa65c6b01fd7425b51514a

Observation 85873741-2204-46ab-8cf8-1ba307bdc009 · outbound

This paper cites DSBench: How Far Are Data Science Agents from Becoming Data Science Experts? In The Thirteenth International Conference on Learning Representations, October 2024.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis DSBench: How Far Are Data Science Agents from Becoming Data Science Experts? In The Thirteenth International Conference on Learning Representations, October 2024

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.748889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.748889Z digest=sha256:9b213dcec50d80816f9a141900797d7f2734cd1846ae7f2b490faab61b89ec67

Observation 9b0cbea0-f729-4ed9-b56d-f03645362316 · outbound

This paper cites LLMs Get Lost In Multi-Turn Conversation, May 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis LLMs Get Lost In Multi-Turn Conversation, May 2025

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.824763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.824763Z digest=sha256:5ed7d60082a5addcbdb14cf52378cee05698d4a3098257b71870acab8624e430

Observation a1199356-618e-42fd-bdfc-e50642333817 · outbound

This paper cites DS-1000: A natural and reliable benchmark for data science code generation.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis DS-1000: A natural and reliable benchmark for data science code generation

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.906565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.906565Z digest=sha256:6ad4b177af93d75a6e829afa2ec50133f5625e76c319565cdd296fc321f4a110

Observation 5f43f6a3-b435-41d4-8e79-db623e2813f6 · outbound

This paper cites Leonard, Nathan Kuppermann, Cody Olsen, Lynn Babcock-Cimpello, Kathleen Brown, Prashant Mahajan, Kathleen M.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Leonard, Nathan Kuppermann, Cody Olsen, Lynn Babcock-Cimpello, Kathleen Brown, Prashant Mahajan, Kathleen M

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.006372Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.006372Z digest=sha256:f895171f35e911de03480685cc1137d2a7332aee0fd53f27bbf222fceb0a3db6

Observation ed27d3d4-fbaa-41c4-be84-3ad53b669655 · outbound

This paper cites Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agents, March 2024.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agents, March 2024

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.093050Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.093050Z digest=sha256:ddc91228675a111cf8aa027b9c1f1ac65f6f16d8394c5054f7f1524b53e8cd44

Observation 2c76353b-32fe-49dc-a1f9-af89600519a1 · outbound

This paper cites ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.229090Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.229090Z digest=sha256:38d9164281acf258744a7db3bc046a8a5c5b18541e5db9048285d44e08666848

Observation 1c0c93ff-7d7d-4af5-9ab0-2ac602e76c00 · outbound

This paper cites Nigrovic, Alexander J.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Nigrovic, Alexander J

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.348204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.348204Z digest=sha256:1256d800e13248f10fd5a85c03ae53e47692f96196b4bf0d94e75162df9aef36

Observation 4b1a4f80-c4f0-4818-84fc-50219cf352ac · outbound

This paper cites Missing Women and the Price of Tea in China: The Effect of Sex-Specific Earnings on Sex Imbalance.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Missing Women and the Price of Tea in China: The Effect of Sex-Specific Earnings on Sex Imbalance

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.447780Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.447780Z digest=sha256:c911e7ce8df8c77b23648ad5c89342cc0e031be7adbc05034f399cf8b52f8d5c

Observation bcdc709e-79db-4d47-9f3f-95d223eb86eb · outbound

This paper cites Bishop, Wei Li, Folawiyo Campbell-Ajala, Daniel Kenji Toyama, Robert James Berry, Divya Tyamagundlu, Timothy P.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Bishop, Wei Li, Folawiyo Campbell-Ajala, Daniel Kenji Toyama, Robert James Berry, Divya Tyamagundlu, Timothy P

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.529329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.529329Z digest=sha256:8594535118e4a010bff661cb6ae919c1d083e923094902e3f3e63c8975d36b5f

Observation 73ec0527-2e98-4d3a-97f3-eaa7ef0d0496 · outbound

This paper cites AutoGPT, May 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis AutoGPT, May 2025

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.643489Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.643489Z digest=sha256:60cac5d43d468e9559db61922427bb32b82d8e2902aaae6d609082730367b53a

Observation ef18b500-757c-4525-931c-0ac560ad1db1 · outbound

This paper cites Increasing Trans- parency Through a Multiverse Analysis.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Increasing Trans- parency Through a Multiverse Analysis

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.738296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.738296Z digest=sha256:615d3f193a6a274bfa6f0c5ca2a4400025a015b3d34202b5b1f8b574d78d8e17

Observation 198f234e-32b0-4d2d-ab5b-39686a365605 · outbound

This paper cites Sullivan, Wanze Xie, Stefania Conte, John E.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Sullivan, Wanze Xie, Stefania Conte, John E

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.858250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.858250Z digest=sha256:bc486f0489782fc39bbd21bcfd9838731db8a7826b0f89772f67e144a33845d5

Observation 3e7f517e-40f4-49a4-ae03-559ae0e85d12 · outbound

This paper cites A macroscope in the redwoods.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis A macroscope in the redwoods

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.942137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.942137Z digest=sha256:7ef7eb97402e4d1a05ecd6e5d9222f6863f26e525a8c3de120ef1f58d742c022

Observation b0f11a23-7418-481d-91f1-20ccdb91cd60 · outbound

This paper cites Meeseeks: An Iterative Benchmark Evaluating LLMs Multi-Turn Instruction- Following Ability, April 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Meeseeks: An Iterative Benchmark Evaluating LLMs Multi-Turn Instruction- Following Ability, April 2025

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.023348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.023348Z digest=sha256:603ea1dcb6d1e5045231e0a2b00b4fbc29cee9923970771b03c933066f14ce08

Observation 30c605ce-766a-424f-80b7-25f95ad3fa4b · outbound

This paper cites CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation, April 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation, April 2025

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.114734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.114734Z digest=sha256:4af34d821a9686ded9f77540cfe0f5c29dac99bf37ec2ceb12c4733d61fc2d86

Observation 8a4f9766-4b2d-4c38-b962-8fed31bcdae1 · outbound

This paper cites White, Doug Burger, and Chi Wang.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis White, Doug Burger, and Chi Wang

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.198472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.198472Z digest=sha256:b960e631b0ae28213a0d4aab59b763085b29c0c910876b1fdcecec18c251bbf8

Observation 5987d22d-b5c8-4ae0-ad9c-57b282e34dbf · outbound

This paper cites OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.286596Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.286596Z digest=sha256:94c8928d3508fd67dc4bdde4d6b8b5d0fe3ab4409a489d462d1e3b5918e704bd

Observation 294be3d0-06e5-4202-8929-1cbdf00938eb · outbound

This paper cites InterCode: Standardizing and benchmarking interactive coding with execution feedback.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis InterCode: Standardizing and benchmarking interactive coding with execution feedback

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.403469Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.403469Z digest=sha256:20e418ad7d64df18cbe44bc8e8a3b6fb6705384e3c6b522c780ea20a487e8365

Observation 19e12766-6598-4602-8ab0-9bc7d65ded46 · outbound

This paper cites Narasimhan.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Narasimhan

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.503874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.503874Z digest=sha256:d38e51a2658a71163d327f2e66c817a17b273726ef357394e9458afc640c4b3a

Observation 8148cacd-91a5-4586-aa76-da92dcbe8311 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.612890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.612890Z digest=sha256:5e7b6e97b9a9e627d8e6ff78539c0cf5d716c27acfe80d8bc3e17d3ecacd8310

Observation 6a4904fb-7fca-4e45-9db5-b539db6374c3 · outbound

This paper cites Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving, April 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving, April 2025

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.694797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.694797Z digest=sha256:78bc2ca69948f1ddf9b3d1121815fe973ba74996b0dbed4ab6487c6d8367df41

Observation 4b4f32a7-31a7-4744-bce7-7c995da0c51b · outbound

This paper cites Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.802633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.802633Z digest=sha256:bcc7623d2b3c0125d04a045812eabdf41f17d542b88bd0e6f539f087344d2648

Observation 5e4f68f8-7906-4b43-8340-c8a768d3462f · outbound

This paper cites Benchmarking Data Science Agents.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Benchmarking Data Science Agents

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.895292Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.895292Z digest=sha256:9a1bbff2989d5467729419dce31e620d545c70134b92155267d3b984d17bb6fc

Observation d62c35ab-2a66-4820-a555-1998df3afb02 · outbound

This paper cites Decision Company.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Decision Company

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.012811Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.012811Z digest=sha256:edcec05a9cff2f7cbbc54a87e2e9f297f7f69aa20b1990e586e3efca97a6a110

Observation 356f18bc-fadf-4c13-bec4-a7172f015410 · outbound

This paper cites - Before taking consequential actions that update the dataset, list the action details and obtain explicit user confirmation (yes) to proceed.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Before taking consequential actions that update the dataset, list the action details and obtain explicit user confirmation (yes) to proceed

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.058249Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.058249Z digest=sha256:a845a5652643557a6536dfaf9c564d6011a49358f45b1b1219bf06ce63ef51e5

Observation 6819f32e-4dc1-4839-9183-084ef4b1f2e6 · outbound

This paper cites - Output: Use print() exclusively -- no but no other methods (e.g., plt.show(), returns).

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Output: Use print() exclusively -- no but no other methods (e.g., plt.show(), returns)

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.129886Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.129886Z digest=sha256:26a29980b28042e5428fd91ac4d313d1db9f8fa30c89aa00832c42b14ec2fa77

Observation 4911b584-05ff-4b84-ae10-f91610a2d0e4 · outbound

This paper cites - Adding analysis beyond the requested task.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Adding analysis beyond the requested task

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.208871Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.208871Z digest=sha256:7e1a835a8d5458aa942056cd528cb3e4fbc8d43b6c82ff055e8e559aa75e0edc

Observation eefe7998-fe8e-4f12-b1ca-ba53432410a1 · outbound

This paper cites The user has given you full permission to execute any code necessary to complete the task.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis The user has given you full permission to execute any code necessary to complete the task

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:15.354088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.289214Z digest=sha256:6e99a778fdc666a3a254d9137b29a0be54bf7185e16d6e9af333fe4ba788cdf9

Observation c95f9d02-1841-4e00-ba1b-1acacb25a166 · outbound

This paper cites guardian.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis guardian

Reference 64

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:15.197973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.350669Z digest=sha256:62d86027da775ce590db55e4e6d40d112f6a1e268d6a224e72357ddf4cfc051b

Observation b3942cd9-059d-4da6-88ae-4049c85a5310 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 65

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:15.055000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.432085Z digest=sha256:dadbdb8554a001398d6af678357fe37fd3b9623c602be57094b8288bbefda09f

Observation 0b1cde42-b2f0-4c08-9dbf-e4f9a4c1614c · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 66

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.884560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.507249Z digest=sha256:94a4786c65aede96a5b05e795d913f85040e13a8f7247e1d42f8087229cd410a

Observation 9f9fd221-fe99-4e1b-ba9d-f6a10dd73f03 · outbound

This paper cites thought": <the reasoning process of the gatekeeper>.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis thought": <the reasoning process of the gatekeeper>

Reference 67

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:14.662236Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.617722Z digest=sha256:c9657b1ef0781f4b1e8d6fb0c75e45c6c20960e1b3f30bfc0de316d175a88382

Observation 5b0bf50f-dd18-45ff-a0b3-ecbadae7a6ed · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 68

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.510799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.700268Z digest=sha256:efa307cbdb4235dbd951154b3bfb9def8d693966e24e33360a0141290ea6c86a

Observation 9ecef980-519c-420c-8b61-72bc50a6aab4 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 69

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.332655Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.779862Z digest=sha256:d2bd622f27272764e030414d1443971126f8c2a734baec12829d13af43a49678

Observation d2cbaf3f-d01f-4685-8765-34bd666e477b · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 70

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.170602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.867111Z digest=sha256:f3ff6e84d1f820485e71877dbd77fcb9fe9820c0a7f020c8247db03299d977f8

Observation f798acac-d199-4eaf-8436-5a45dfc08f4b · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 71

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.013419Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:53.958532Z digest=sha256:5cd13e309b690f4180de794d3e95b2e0ade45bf21308551a82014316e8ace4e5

Observation 5b4abff3-8beb-49f7-a7c1-3d50a7690256 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 72

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.796341Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.036650Z digest=sha256:46768d5e7a9527b0bcebcbf9ca762afa57343f0ac5e73c92ad23ba91b1926d1c

Observation abc896a7-b9fd-408f-bd0a-846072760919 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 73

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.576523Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.108835Z digest=sha256:c3e64cd79feaa7eaa1268b5e26585b9e2d7714f7747b2acaf2522358c68bded7

Observation ced03377-9381-4161-b85c-b220bf757368 · outbound

This paper cites (omitted).

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis (omitted)

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:13.388357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.172031Z digest=sha256:410bb2dd855fd68f9cd4792bccf8612b6886c15eb07d52aa4f0c27776865ac2f

Observation f573cfbc-36ef-446e-9573-f9839bb84492 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 75

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.205552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.243031Z digest=sha256:35c6290a8bbb989aeda550465cd3991afae4d385e9b3387d0bda5a12999ef4d9

Observation 39e1111c-a514-4bee-852a-aaaffe5bf422 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 76

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.032118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.329557Z digest=sha256:eb4544e96384fcf788356a28ab4cb2a1c9bfeac232b85906d6da209a0f1dc272

Observation 0586bd0d-8a26-4cba-a80f-608b5376abc3 · outbound

This paper cites System prompt of the shard user.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis System prompt of the shard user

Reference 77

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:12.801042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.387429Z digest=sha256:94c893d2b7c6eb7177dedbce4941f56d4c8e7c09bc0c5ba307a617dcb1de5beb

Observation fe421636-1cda-4752-a4c7-0e1811b0524d · outbound

This paper cites You should select shards that are most “basic” and currently **the most relevant**.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis You should select shards that are most “basic” and currently **the most relevant**

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:12.612789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.438122Z digest=sha256:32d9f2f225d1598a4c38930f236b6986b0f0ac58a8bd167d9f40690ebb171676

Observation 61eec6c3-82a6-45fd-8c99-afb6f1dbf4b4 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 79

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:12.444651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.498573Z digest=sha256:0381f8203248f9711423c1c33aea4d88b91451e57d847d1ef1b9cfb1b6481d32

Observation 01998609-5024-4963-9a26-b7ac132e56a3 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 80

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:12.215315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.563626Z digest=sha256:5bf03fb84e78b957887d33c687f05fa6fe41813c8d5d1b9345aabe4332d8252b

Observation a00a1721-ac01-4169-a434-4132f4fa254e · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 81

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:12.010602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.632882Z digest=sha256:369f0ecf107319e708e17053027d3992d790fb58e23d9bc4fcf0a5232b1e5018

Observation 68fd14cb-7d3b-49db-a844-7b2ec6880530 · outbound

This paper cites Consider these alternative directions:.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Consider these alternative directions:

Reference 82

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:11.782448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.697431Z digest=sha256:072fa878ae130a581a9cd053dd551ae33434d79f58067b0886c6c8dbe90f550b

Observation c0640aac-3e59-48a3-8f5f-f7751b82b3d3 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 83

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:11.515593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.750391Z digest=sha256:005c5abe7a5c94256779574d7a0b1d588af8bdb664d7cad65ee512f5835b4959

Observation e03f52fd-6f48-4e9e-a905-5be12ffb984c · outbound

This paper cites thought":.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis thought":

Reference 84

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:11.322347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.817573Z digest=sha256:112a66dc7d603f6a10c7d7cdba99a27bb97ecb6700a7e925532e64604ef8fd12

Observation 08b44ea8-7e94-43b7-ae2c-59c7fe631b6d · outbound

This paper cites These metrics typically possess a theoretical upper bound (e.g., 1.0 for accuracy).

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis These metrics typically possess a theoretical upper bound (e.g., 1.0 for accuracy)

Reference 85

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:11.133038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.876902Z digest=sha256:4efe301b86123678c016da41d33664c987cffc6a5681aa4f15ed063b2627a88d

Observation 3867b804-24e2-44c1-a911-bfdd99025404 · outbound

This paper cites Avg Score.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Avg Score

Reference 86

Resolution
malformed identifier
raw_fallback, observed 2026-08-07T14:47:10.993255Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:54.963256Z digest=sha256:17e5de34ae23c98d79ad86998aba462b82a6ad12edce425ce7aef7aacaad0b8f

Observation 5ece733e-534c-4558-a899-a6602b0b4ade · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 87

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.812818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.111812Z digest=sha256:aa8122e14a96bb41e0228002306c23079ce7c522a16e37f93c7dd338fbbba8ef

Observation 452d1b4f-bbd5-4d27-87f7-d38268ccd254 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 88

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.593754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.260964Z digest=sha256:f08782fed7770d6f970a3296fb03a557ddb3755d8823fc2231d7f1bdc5653531

Observation 5f2437a7-1f80-4206-8c1e-61437968fecf · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 89

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.372803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.352626Z digest=sha256:22706499f71c839cbca0adf7a174c38a62935dcaeab65f6fa8e3576cb123a46b

Observation 3e3b5a8e-27f3-4c71-80d0-ea858804a528 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 90

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.202351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.451451Z digest=sha256:cb6b4aa8c04c93194899838c6b1b758bb2165856e4ead62c59d409f99d4d3dcb

Observation ab1d6e91-d1a7-4be2-9b8c-69ccf5b7bffc · outbound

This paper cites metric_name.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis metric_name

Reference 91

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:10.045925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.590513Z digest=sha256:90c919ce7979f30dc5a7ed450ca8aad1688dcca51a4f59ad7a68d43033c69b49

Observation 7ad91a31-f9e9-4e82-8625-b0d07e08bea2 · outbound

This paper cites yes" -> 1 and.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis yes" -> 1 and

Reference 92

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:09.885569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.662945Z digest=sha256:a7f30dd66062d9bacc0e2a057f012c5e89aa3e5ccc49ee62726537dda5800c4c

Observation 8d0d2a8d-68b6-4efa-b0dc-f8fab30074b6 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 93

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.699479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.725076Z digest=sha256:cc7b579d81c171e37264d8311790a383ff4565d1ec6e221479928c801b9667ff

Observation 2071ba24-4855-49a0-bb2e-cbf4492b39ba · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 94

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.470809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.783517Z digest=sha256:ec3140cf68aff34f2327a49faee1e8373c5b9c715ceaa544d4bdcaa3b784c10d

Observation fb5b5414-d716-406e-bd25-f1b24032addf · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 95

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.259524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.853949Z digest=sha256:449a35c12a2022856842aaab206f299a6768b06e0d9ccffeb821016c35643ce1

Observation 1fa1beae-08ab-4a36-98b7-65eaefcfe2d3 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 96

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.047479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:55.932041Z digest=sha256:6e6c7c0ca940fca64021481e040e8e03425307a9e77d20c3f09456cd0a7a8336

Observation 05224c24-238a-41a0-a667-85a3968efa4e · outbound

This paper cites <markdown>.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis <markdown>

Reference 97

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.852908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:56.019587Z digest=sha256:3749b29d94ba84bf60c5513fcf84972cd17f41e98913883a886e10a187d6cfa6

Observation 770a40a6-c077-4eb1-9a81-4041e4ac5ce7 · outbound

This paper cites !pip install.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis !pip install

Reference 98

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.668817Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:56.091977Z digest=sha256:e4fe895097d0eccab39270ddf9c96917ded4aa2c3df6b1fdfd2a634aff58891c

Observation b231fb36-f85a-4075-98aa-a770e510818f · outbound

This paper cites - Load the test feature set from the given directory, using <original_name>_test_features.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Load the test feature set from the given directory, using <original_name>_test_features

Reference 99

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.478825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:56.212625Z digest=sha256:1638591ed0f374eaa4115c7dc9166fac10f27c1a8d36dd397a819e595b338d07

Observation 144be1e0-9337-44e8-a6e4-a05306a4f790 · outbound

This paper cites - Apply the identical transformations to the test feature set.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Apply the identical transformations to the test feature set

Reference 100

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.224725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T14:46:56.334492Z digest=sha256:40066e623091dcc923a94a04a52b98949909596dc64e053c5a1d7edd0a8b9def

Pith citing papers

Observation 9a5ed600-2958-4aec-8a75-ad0184b222c7 · inbound

Agentic-imodels: Evolving agentic interpretability tools via autoresearch cites this paper.

Agentic-imodels: Evolving agentic interpretability tools via autoresearch IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-11T23:36:36.195393Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-07T16:37:43.371592Z digest=sha256:2c4b7305eafe4f668a76ad1ae0569bb532af23aac99c5400a4303305b47f368c

Observation bac24401-0195-4260-9e1c-0f3adccc3009 · inbound

Business Utility of Large Language Models as Exploratory Data Analysis Agents cites this paper.

Business Utility of Large Language Models as Exploratory Data Analysis Agents IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 20

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T23:35:06.971550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-30T23:25:17.416071Z digest=sha256:a611335367475655537ae869d2154c16bf2d9e74950c8823e6b05c8d3334b60f

Observation df93a095-2e57-43a7-984e-0232a0767299 · inbound

GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science cites this paper.

GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-07-03T17:48:46.135475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-27T03:42:40.528376Z digest=sha256:985e3944e7033bf3cf4f01bb8b2098c206b3771cca8ced2749a7bd4bc82c033f

Observation 9a5bb880-d645-4644-bb41-fec033f6c5fa · inbound

CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs cites this paper.

CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-04T02:02:25.908482Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T02:02:25.908482Z digest=sha256:2a7a7f86d7d7b9d8f7189082de7cee8aaeb293c08733d319349595da1ed1c35d

Observation 8837324d-564e-4c35-8c3a-42f6175dc1af · inbound

Fisher-R1: Training LLM Agents for Reliable Hypothesis Testing cites this paper.

Fisher-R1: Training LLM Agents for Reliable Hypothesis Testing IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-10T04:39:03.476630Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T04:39:03.476630Z digest=sha256:4b61c3a049a75969258e1335a44dd19d90880c50fa902226893aa13c70d618c4