Pith. sign in

Paper Citation Record · LEDGER

AI Scientists Fail Without Strong Implementation Capability

As of 10 August 2026, this Paper Citation Record lists 65 of 65 outbound references and 3 inbound Pith citation observations for arXiv:2506.01372.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.01372 v2

Coverage vector

measured 65 of 65 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T11:49:08.589917Z

measured 68 of 68 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T12:50:06.841591Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-20T20:03:44.060778Z

Reference resolution

65 of 65 outbound references displayed

  • verified exact1
  • verified fuzzy5
  • unresolved59
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 585cbaa4-8e54-47fb-9164-e43527107246 · outbound

This paper cites The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer.

AI Scientists Fail Without Strong Implementation Capability The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:00.983368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:00.983368Z digest=sha256:b5857b2136e61f95a26fd0772d9659806f77a2c7eeb1c8b9ea4eed15c0082b4c

Observation 455fb266-b19a-4eb2-9f40-29ccbf107ead · outbound

This paper cites Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?.

AI Scientists Fail Without Strong Implementation Capability Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.121192Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.121192Z digest=sha256:345bdfbbc532bdf7387497e15d1abf2b5a2c6c88c79a97eb114468704d6f0fc2

Observation 6207316a-2237-4f4b-a5fe-c563dc2dee76 · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

AI Scientists Fail Without Strong Implementation Capability Why Do Multi-Agent LLM Systems Fail?

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.392416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.392416Z digest=sha256:709c2c6823d5a8d10610b69fe07ca4e6e27f07ce259609873598ceaadea5d3e1

Observation 089f937e-d284-4d45-9032-4f160e40483b · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

AI Scientists Fail Without Strong Implementation Capability MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.526190Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.526190Z digest=sha256:f43104b655294718cb2aeb6bccd2ad94c702828859f012ab15cddbb2bb5f0969

Observation 876f5b07-7c47-418d-aa72-f9fd5c158357 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

AI Scientists Fail Without Strong Implementation Capability Evaluating Large Language Models Trained on Code

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.642722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.642722Z digest=sha256:9b9d86955b2ad721b87465ec297d756bd88ff4cb82fb4f9567ac776d11a7dd5e

Observation eacc1515-4c04-404b-8f86-dd730f5c796a · outbound

This paper cites Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment.

AI Scientists Fail Without Strong Implementation Capability Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.756223Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.756223Z digest=sha256:f9e7dc6555c30f92497b8a0327c76b443810ec7bc6784815bad3c5120c04ad4f

Observation c24984a8-a972-4069-9cd9-29a63c0180ac · outbound

This paper cites IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery.

AI Scientists Fail Without Strong Implementation Capability IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.877094Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.877094Z digest=sha256:420fe5e60a5e220992fab080854b3c80ab0c758c7444286a017128807585c377

Observation 241d67cb-b175-4b1e-a3be-e5dc6f1f587a · outbound

This paper cites SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning.

AI Scientists Fail Without Strong Implementation Capability SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.009902Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.009902Z digest=sha256:c48b7dd981207e8b95b4897f59b2acaa3ac275f15660ffb4f8d9a45e2bb0a4fc

Observation e2855918-989d-414d-9544-9df08d6fe3ee · outbound

This paper cites Towards an AI co-scientist.

AI Scientists Fail Without Strong Implementation Capability Towards an AI co-scientist

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.170925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.170925Z digest=sha256:3951566a8c36b32c3894f852d79c4bbbe0a36efead882bcfd5d2a5e40614099c

Observation 60bd406f-dec0-4d74-b55c-44969e5dc4f0 · outbound

This paper cites LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research.

AI Scientists Fail Without Strong Implementation Capability LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.277328Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.277328Z digest=sha256:acbd7d1d326f1eca6d7e56658b90e8da93109ac81d775ef618df8988d628e47e

Observation 11fd7b30-7776-474d-914b-ffb838c06046 · outbound

This paper cites Large Language Model based Multi-Agents: A Survey of Progress and Challenges.

AI Scientists Fail Without Strong Implementation Capability Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.382812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.382812Z digest=sha256:3abb75c68844a43f374c4f26a0d233b60384b8922f491a5e183f5259fabe0629

Observation cc8fcd72-2d9b-4c9e-9ac9-88fbd7848eca · outbound

This paper cites PaSa: An LLM Agent for Comprehensive Academic Paper Search.

AI Scientists Fail Without Strong Implementation Capability PaSa: An LLM Agent for Comprehensive Academic Paper Search

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.520844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.520844Z digest=sha256:f4abefa1f4b13353e5465ddc4f67f86913aca15c40a4270506480d4a10bc6d8d

Observation 9c3c27de-bd74-4666-b467-a0261a7fe174 · outbound

This paper cites Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions.

AI Scientists Fail Without Strong Implementation Capability Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.632210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.632210Z digest=sha256:97bf1782430e74e28901cff53f82b4fb0b9e09b19d4f022b5eac8c470d811d82

Observation 6ac99bae-9e1e-44f1-a113-6689bd9d5262 · outbound

This paper cites Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas.

AI Scientists Fail Without Strong Implementation Capability Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.748535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.748535Z digest=sha256:6d0fd3a7aa7f02412cde27e06bfccf36632c24527f84568e5c50adfc323e3c89

Observation f6d4187c-14cb-48e7-9afa-2a8043bb77aa · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

AI Scientists Fail Without Strong Implementation Capability LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.892900Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.892900Z digest=sha256:bf6b10f4eb53843eaf71466d0deaf5f09d6269f122112a435872e8aa009deb1e

Observation a76b139d-8395-4ad3-bb58-e36029c73cb7 · outbound

This paper cites CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation.

AI Scientists Fail Without Strong Implementation Capability CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.018962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.018962Z digest=sha256:f4dbccd8f94cda02a933b9bbd0ad936c20e51470d71e07f79eca80502ffa1689

Observation c02ca024-d610-4280-b654-bec0e03fb7f3 · outbound

This paper cites AIDE: AI-Driven Exploration in the Space of Code.

AI Scientists Fail Without Strong Implementation Capability AIDE: AI-Driven Exploration in the Space of Code

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.119196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.119196Z digest=sha256:d25d2a2d0d2872725a607eaf97eb39ba09792949224f3a2c677efb677cc84bf5

Observation 204eeaaa-4a33-449e-8507-3885c6d0c685 · outbound

This paper cites LLMs Get Lost In Multi-Turn Conversation.

AI Scientists Fail Without Strong Implementation Capability LLMs Get Lost In Multi-Turn Conversation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.467915Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.467915Z digest=sha256:cb14fcd2866875519d5c934647773a3eef0d4096b530e8b97b8c8b31b67d9608

Observation a2d5485d-3adc-4870-9c40-39e4f57dea87 · outbound

This paper cites DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration.

AI Scientists Fail Without Strong Implementation Capability DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.711750Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.711750Z digest=sha256:74d83a9289eafc5d36e2bb82099552fe759718bebda70bbefb0bdf2197430b84

Observation 6a05857c-d6ba-441d-967d-6954f3293163 · outbound

This paper cites AIGS: Generating Science from AI-Powered Automated Falsification.

AI Scientists Fail Without Strong Implementation Capability AIGS: Generating Science from AI-Powered Automated Falsification

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.834636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.834636Z digest=sha256:6665acda9b52e376dc279d77aa07136be1974d8bccd9499b461884fbb896554e

Observation 235aaf50-4cd0-46de-b0e1-be7201172ac7 · outbound

This paper cites The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery.

AI Scientists Fail Without Strong Implementation Capability The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.993632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.993632Z digest=sha256:0014692694ec508d833f3b2d04b3ff51d4a58b358e0379a0a4ba299075873c1e

Observation aded90f8-1b0e-468e-93ab-0942d7935376 · outbound

This paper cites Sparks of Science: Hypothesis Generation Using Structured Paper Data.

AI Scientists Fail Without Strong Implementation Capability Sparks of Science: Hypothesis Generation Using Structured Paper Data

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.355306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.355306Z digest=sha256:cc407622367898e5603cdf00000f38b0e8adb7dce5c4a9a24694b8fed52b8d27

Observation 0beef106-8e32-460f-ac4f-fb8be80c23bf · outbound

This paper cites ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows.

AI Scientists Fail Without Strong Implementation Capability ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.506588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.506588Z digest=sha256:c7101b4080a83a715b562a2bb7b7b320d7d2d431d5baa142596bee526d080c15

Observation 2361c1dc-27d8-4b59-8ae5-bf3f0db8e94a · outbound

This paper cites Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback.

AI Scientists Fail Without Strong Implementation Capability Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.638623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.638623Z digest=sha256:65b2fac9cf6e24bd7ec471cf91747feaf243db770f9bc2e1bdbb0426fb103127

Observation 6c18ebcd-7e77-4f2e-aa9a-5068916d1ea1 · outbound

This paper cites Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees.

AI Scientists Fail Without Strong Implementation Capability Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.767680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.767680Z digest=sha256:ebbc1e2915404b31871e463a45988c42c837697506282e72e189116d6a795a15

Observation e6c7066e-a501-4827-89d2-c129711fd55f · outbound

This paper cites Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation.

AI Scientists Fail Without Strong Implementation Capability Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.917967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.917967Z digest=sha256:9e0a7ed45afab5178973dcb2bcd6bb4d033fff84805f2d1554b218a631d72841

Observation 39e3ba0f-4d41-4365-b62e-6c2cc684661d · outbound

This paper cites AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data.

AI Scientists Fail Without Strong Implementation Capability AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data

Reference 34

Resolution
verified exact
local_arxiv, observed 2026-08-07T11:49:09.076092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:05.074678Z digest=sha256:f1f5ea9e35a1eeeb0796c545901b017db952940d4f0e1539d8ddc491caba2171

Observation 7d38d89a-c551-41ae-b75d-4196d32e43b5 · outbound

This paper cites Spark: A System for Scientifically Creative Idea Generation.

AI Scientists Fail Without Strong Implementation Capability Spark: A System for Scientifically Creative Idea Generation

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.153250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.153250Z digest=sha256:032ef74a1617ea06dc9beee72a3915a45b49e14e543c042629f7567388ea5f29

Observation cc5ffc26-7b64-4ee9-a7e9-e83c1cd9c747 · outbound

This paper cites Agent Laboratory: Using LLM Agents as Research Assistants.

AI Scientists Fail Without Strong Implementation Capability Agent Laboratory: Using LLM Agents as Research Assistants

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.207479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.207479Z digest=sha256:f83d9583e834c42095766af0e1ae8e2ebe641753584920ad52afc76d69582637

Observation 30edacd1-f051-4d43-991f-dc5313864317 · outbound

This paper cites Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,.

AI Scientists Fail Without Strong Implementation Capability Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.244211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.244211Z digest=sha256:814d2864ef4638a15b92dfa1068d9ae9e25add7e2e0a4ea950b6dc16ec99267c

Observation 73dccdd8-c7f9-4942-a0aa-e64bb379a31b · outbound

This paper cites ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents.

AI Scientists Fail Without Strong Implementation Capability ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.401684Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.401684Z digest=sha256:06ac8c4eab165905af8ffab856e53960e9b1b36fa9a1cd2b91c3181dab18caf5

Observation 45f7760b-c717-4a88-9d42-87d77cc67b1e · outbound

This paper cites Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers.

AI Scientists Fail Without Strong Implementation Capability Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.287112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:05.535880Z digest=sha256:723f31021fb9167dc30b8e2dcd0606a0987832010af84bd4ef823b7dceff0285

Observation 02fe6701-6a4d-4a7d-9d10-30c697994b52 · outbound

This paper cites CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark.

AI Scientists Fail Without Strong Implementation Capability CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.670557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.670557Z digest=sha256:4f73c876dae3e4a1a328e8612747494f3c1f4954ebc01cef2376faf8c49df6ce

Observation 697ba589-c9bd-428e-9c24-33fdf2a7200f · outbound

This paper cites PaperBench: Evaluating AI's Ability to Replicate AI Research.

AI Scientists Fail Without Strong Implementation Capability PaperBench: Evaluating AI's Ability to Replicate AI Research

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.813810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.813810Z digest=sha256:aa0272ebc9b9adb631a06505e1181c59a60c51439032edea411daa00239f2f19

Observation de0a2467-344b-4148-9fc7-a3d9826f11f3 · outbound

This paper cites ZeroSearch: Incentivize the Search Capability of LLMs without Searching.

AI Scientists Fail Without Strong Implementation Capability ZeroSearch: Incentivize the Search Capability of LLMs without Searching

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.037989Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.037989Z digest=sha256:aa85c0e54a960b6b5cf5eeb3824b7c3adffed67127c6bb02691a5fbbbb328c7c

Observation 84be6792-5dfa-49f8-92da-dcfd78801cc6 · outbound

This paper cites SciPIP: An LLM-based Scientific Paper Idea Proposer.

AI Scientists Fail Without Strong Implementation Capability SciPIP: An LLM-based Scientific Paper Idea Proposer

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.160799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.160799Z digest=sha256:308515fba33dd7e5a68e437d4b43591065e84c130e60ce713d9049181e54ddd1

Observation 43e630c0-337e-430f-94d1-27ccad2cdf6e · outbound

This paper cites Large language models are better reasoners with self-verification.

AI Scientists Fail Without Strong Implementation Capability Large language models are better reasoners with self-verification

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.281808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.281808Z digest=sha256:2a7cb202bb1aef7ad7150c9fb1377527286471398adfcacddff192cd51670610

Observation b3a60b3c-a999-42e4-8cf4-12660257330c · outbound

This paper cites Shifting Long-Context LLMs Research from Input to Output.

AI Scientists Fail Without Strong Implementation Capability Shifting Long-Context LLMs Research from Input to Output

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.406833Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.406833Z digest=sha256:ec8ae1dd452490c74d52309437e5ac72674f480fbe749c373d6397084888b3f5

Observation 8fdc8173-864d-447b-9033-9030ba33c6ee · outbound

This paper cites Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models.

AI Scientists Fail Without Strong Implementation Capability Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.537534Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.537534Z digest=sha256:e05abdbe539576bc52e97a6a65b250d3d249e0a658e2514fca1d07b52106f2bf

Observation 3749524d-2ac7-4278-af41-25adaf01aefa · outbound

This paper cites The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search.

AI Scientists Fail Without Strong Implementation Capability The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.629089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.629089Z digest=sha256:3eef6e14e991e9cbbcd449c237f6480edd62a7734752e1acab4deba6c8189cb2

Observation 2e2b4c57-17d5-4d04-b0f0-534c632e87cc · outbound

This paper cites Qwen3 Technical Report.

AI Scientists Fail Without Strong Implementation Capability Qwen3 Technical Report

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.712106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.712106Z digest=sha256:59f8b817d8dcc61b38cce4d07779742ffd96bdd0d8b93d0ee771901a0477b174

Observation ac39e507-a84f-499d-85d7-57c8fcc4520f · outbound

This paper cites ResearchTown: Simulator of Human Research Community.

AI Scientists Fail Without Strong Implementation Capability ResearchTown: Simulator of Human Research Community

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.773231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.773231Z digest=sha256:b44d234aa2a068d25c922ace91f3fdee2bdf1a67cfa81f1524e35014ad540529

Observation bd66b695-43eb-4d03-a77a-27df4917229c · outbound

This paper cites Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback.

AI Scientists Fail Without Strong Implementation Capability Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.874611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.874611Z digest=sha256:e5435084f483d468008642dd87811bfe8d5575d0c070a809c2afed03ea7cd7f0

Observation c0e1b13b-fb6f-4693-bfb9-df451bed8998 · outbound

This paper cites A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?.

AI Scientists Fail Without Strong Implementation Capability A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.967707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.967707Z digest=sha256:bca534c96c172638d4a7df3232d582579960f409e440096e4da2f1833bf2867f

Observation ac38bdae-467d-4f26-842e-a8c00a2581cc · outbound

This paper cites OpenResearcher: Unleashing AI for Accelerated Scientific Research.

AI Scientists Fail Without Strong Implementation Capability OpenResearcher: Unleashing AI for Accelerated Scientific Research

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:07.021150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:07.021150Z digest=sha256:639f393f43a946c6c353f68bb78731281d314743b5e621b0925ff4b944bed3eb

Observation 65160443-072e-4bf0-b947-7d4a503fc407 · outbound

This paper cites DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process.

AI Scientists Fail Without Strong Implementation Capability DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:07.108809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:07.108809Z digest=sha256:e79d9d9ad5015fa7c99927d03404e27af3b0d953356e0fbed107416ce6c3d69b

Observation 22ce0db0-4cfd-4eba-9b78-1bf14c45e807 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:12.017902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.196636Z digest=sha256:829acc800bbe2a86dd04508f6b97a0c1ed580f349a0384f7237de09d0e49fa3d

Observation 9f75f9e0-8ad2-49d0-9c37-ae48a51465cb · outbound

This paper cites 20 AI Scientists Fail Without Strong Implementation Capability.

AI Scientists Fail Without Strong Implementation Capability 20 AI Scientists Fail Without Strong Implementation Capability

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:11.816501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.292111Z digest=sha256:b05b799f5cb97353580f4d4bc5f298bfe2c4d5441d09514d3b9296873aa39597

Observation da08517b-7ead-4848-8887-6e2a8692ecee · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.589600Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.393120Z digest=sha256:69b699908f8598b738bb9f80abf3916a94eb25ad5bee38ce55be6523168f045e

Observation 915f0bc9-9492-486b-b8a0-8002cdd1da20 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 58

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.299542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.495776Z digest=sha256:febcaafbc619e252c06ef94cc7da63ff3ab11d420534a0c78cb90a2dc2596663

Observation de53a12d-9fb8-474d-accd-d93fc7eb84f1 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.107790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.630519Z digest=sha256:fab88a5c3a44cc4bccaee8308e0769c6ab8c9281d84e2820c66de08d25cc9523

Observation fcf12ab1-8867-44de-bf73-2ff2ea178a2e · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.828847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.747320Z digest=sha256:fc93ae5c29e10ba8a9452354cda47d8263162aa5bdeb9044c87612e6b684ea17

Observation e9a5207f-ab4c-4ab9-bb35-e21f6bb3a22d · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 61

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.568651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:07.952347Z digest=sha256:f64bd6e86d9679ec554a43b06d19f7389d0fd2970e9ef7461d0d16a1287d6098

Observation 7891ea88-2462-4c41-9c95-90195d0ccbbb · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.280713Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:08.144957Z digest=sha256:865dbc45067e1cb122cca0503582bfd35989671d1a09aabaefa9699d4b0fe0fe

Observation d31021fc-58fb-40a7-bf35-a0eb1c798360 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.030667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:08.278926Z digest=sha256:4a29e76c1ab9a406fa97bd48e1fdc04e5bcc93f0ac1136be8167291a16465e24

Observation a58418a2-43df-4c82-8413-ba25425592fb · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:09.735966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:08.400971Z digest=sha256:b258ea5ced3f081f3c327de79621d8de0be5418705ce8c37fed0bb59b8697782

Observation 25f635d1-381d-415d-9193-43ec5624fd91 · outbound

This paper cites Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field.

AI Scientists Fail Without Strong Implementation Capability Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:09.569047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:08.589917Z digest=sha256:bf7568a5e902fac87d8066f5e7b4e971e669fa21bea71ff029fab1cb9f69c773

Observation 31bcb75f-f68b-4ef5-a051-1338c4ea2a27 · outbound

This paper cites Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents.

AI Scientists Fail Without Strong Implementation Capability Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents

Reference 1987

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.588515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.588515Z digest=sha256:9f757b8f531f76bd1cabc7b13e642021309ea150619b53f6943622764db6ea16

Observation 50602bd2-cd08-49dd-99ad-4b24cadfc3b9 · outbound

This paper cites Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents.

AI Scientists Fail Without Strong Implementation Capability Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents

Reference 2009

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.336587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.336587Z digest=sha256:3d9f8e254c7498bb42fb035a3e312bd4fc6ad93c2f2492c5442463696c0826ab

Observation 8a0a26d8-9c2c-4f9e-96fc-38ad2251bbf6 · outbound

This paper cites s1: Simple test-time scaling.

AI Scientists Fail Without Strong Implementation Capability s1: Simple test-time scaling

Reference 2013

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.160309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.160309Z digest=sha256:618b50e43f3e2d807a0dcc48a9eae15e6788b0f729b48790368e9a7151f52137

Observation e8702435-4ef3-41b9-805c-cb0e4c488351 · outbound

This paper cites Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System.

AI Scientists Fail Without Strong Implementation Capability Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.903065Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.903065Z digest=sha256:c3cfc274ed610515f127d9ed23b1416dc2a7bee270f94fb01fdbf42ef5890534

Observation c8c668d9-075d-4330-9d09-355f19274d50 · outbound

This paper cites Scaling Laws for Neural Language Models.

AI Scientists Fail Without Strong Implementation Capability Scaling Laws for Neural Language Models

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.210248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.210248Z digest=sha256:33a29dfb91765d62282408312fe82639d966932c5a4983c30ef05e16d100f9dc

Observation db1dceec-20e1-46cb-88b5-1ec12348c48d · outbound

This paper cites Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,.

AI Scientists Fail Without Strong Implementation Capability Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.529426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:01.262343Z digest=sha256:c28392e22d2b8355109403ca6513a60b6c2cc03064db40ec5170645495455c82

Observation e37c7520-1da2-45ef-b12a-a850c6209bd6 · outbound

This paper cites Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz.

AI Scientists Fail Without Strong Implementation Capability Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.763454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T11:49:00.848110Z digest=sha256:f47c0f29fd1e5bc3dc2511348c23d19a91bdd66ccec3d4df2a85d6db43d84b2d

Observation 03c1fc2a-f737-4294-88ae-31b39d749740 · outbound

This paper cites SWE-Bench+: Enhanced Coding Benchmark for LLMs.

AI Scientists Fail Without Strong Implementation Capability SWE-Bench+: Enhanced Coding Benchmark for LLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:00.759281Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:00.759281Z digest=sha256:aa8fce5d22659f3a6610dc33871ac16a1fe601dc92708a4e16f08de8756a8f23

Pith citing papers

Observation 97cfaa6a-2bb8-435e-9301-ba03667c0551 · inbound

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation cites this paper.

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation AI Scientists Fail Without Strong Implementation Capability

Reference 37

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:31:27.256386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-12T04:12:49.742272Z digest=sha256:fc38a72289b402ce4d01d57140787440f3061896a9759bd1419de320e0dfaeb1

Observation f88f855f-8dd1-40e0-8d56-2bd040ecf91c · inbound

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility cites this paper.

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility AI Scientists Fail Without Strong Implementation Capability

Reference 41

Resolution
verified exact
arxiv_id, observed 2026-05-20T20:03:44.063892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-20T19:59:40.519962Z digest=sha256:4492be03503c5608e03d6da56a762d3f457412e1aa61a8bedba50dfc13ebe818

Observation 86739275-b7ef-446e-9e91-d13888aeffe3 · inbound

One Run Is Not an Idea: The Implementation Lottery in Automated Research cites this paper.

One Run Is Not an Idea: The Implementation Lottery in Automated Research AI Scientists Fail Without Strong Implementation Capability

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-01T12:50:06.841591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T12:50:06.841591Z digest=sha256:c73780fdaec6199d358cffab696fc026a0b1f0cc3b5799cb915250496b5ede01