Pith. sign in

Paper Citation Record · LEDGER

AI Scientists Fail Without Strong Implementation Capability

As of 9 August 2026, this Paper Citation Record lists 65 of 65 outbound references and 3 inbound Pith citation observations for arXiv:2506.01372.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.01372 v2

Coverage vector

measured 65 of 65 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T11:49:08.589917Z

measured 68 of 68 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T12:50:06.841591Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-20T20:03:44.060778Z

Reference resolution

65 of 65 outbound references displayed

  • verified exact1
  • verified fuzzy5
  • unresolved59
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 585cbaa4-8e54-47fb-9164-e43527107246 · outbound

This paper cites The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer.

AI Scientists Fail Without Strong Implementation Capability The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:00.983368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:00.983368Z digest=sha256:252f010628ab07a35dc9c7879e368088479b854a886b1014a5ca8df239c3fd94

Observation 455fb266-b19a-4eb2-9f40-29ccbf107ead · outbound

This paper cites Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?.

AI Scientists Fail Without Strong Implementation Capability Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.121192Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.121192Z digest=sha256:c254116330f92a3050139acf2df16a1cbb08caccbff1c87f8395c1bbf3f06524

Observation 6207316a-2237-4f4b-a5fe-c563dc2dee76 · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

AI Scientists Fail Without Strong Implementation Capability Why Do Multi-Agent LLM Systems Fail?

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.392416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.392416Z digest=sha256:14142b5f3981ef60f40719c3b2aa48d62cbfeddb96da855f325a44366348679d

Observation 089f937e-d284-4d45-9032-4f160e40483b · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

AI Scientists Fail Without Strong Implementation Capability MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.526190Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.526190Z digest=sha256:ebdbf145c3e212d8eb94774cd2b94bbe39b1cba469ab540c89abe5fcb2889400

Observation 876f5b07-7c47-418d-aa72-f9fd5c158357 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

AI Scientists Fail Without Strong Implementation Capability Evaluating Large Language Models Trained on Code

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.642722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.642722Z digest=sha256:b8895d3534ad67a3658ec983c7e274614e9e38b773e8945c1d3c681fd80c72c2

Observation eacc1515-4c04-404b-8f86-dd730f5c796a · outbound

This paper cites Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment.

AI Scientists Fail Without Strong Implementation Capability Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.756223Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.756223Z digest=sha256:5400b4c7f8b1d7b87061a49b20420b7a54e6fb3d86b9f654ce634c791f9b802b

Observation c24984a8-a972-4069-9cd9-29a63c0180ac · outbound

This paper cites IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery.

AI Scientists Fail Without Strong Implementation Capability IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.877094Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.877094Z digest=sha256:5a0160c2c32f94bef478dd1febb4b62410168acc88f2dc3df8a236a310d398fa

Observation 241d67cb-b175-4b1e-a3be-e5dc6f1f587a · outbound

This paper cites SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning.

AI Scientists Fail Without Strong Implementation Capability SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.009902Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.009902Z digest=sha256:d40dc5be0bc4ec806e93fbf5721877f616e2f6c805f58cd72591d3c54fb11299

Observation e2855918-989d-414d-9544-9df08d6fe3ee · outbound

This paper cites Towards an AI co-scientist.

AI Scientists Fail Without Strong Implementation Capability Towards an AI co-scientist

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.170925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.170925Z digest=sha256:37921680e7844b3a3e4e80063b0f83cfe6efaaddb85cb55ee1877d4cf0eb4a64

Observation 60bd406f-dec0-4d74-b55c-44969e5dc4f0 · outbound

This paper cites LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research.

AI Scientists Fail Without Strong Implementation Capability LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.277328Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.277328Z digest=sha256:9e80db3b2ce51fd1588920ae15a6b5c612baef2b51e3ae5aaaa55d7100d6d98f

Observation 11fd7b30-7776-474d-914b-ffb838c06046 · outbound

This paper cites Large Language Model based Multi-Agents: A Survey of Progress and Challenges.

AI Scientists Fail Without Strong Implementation Capability Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.382812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.382812Z digest=sha256:c0a44fd449774ccef27b3033a6ce6aca491243ad22611d04cc56d240771d1341

Observation cc8fcd72-2d9b-4c9e-9ac9-88fbd7848eca · outbound

This paper cites PaSa: An LLM Agent for Comprehensive Academic Paper Search.

AI Scientists Fail Without Strong Implementation Capability PaSa: An LLM Agent for Comprehensive Academic Paper Search

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.520844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.520844Z digest=sha256:43f4e32165f7e0baecbca62f1606aeb37ae896677619c82c42b6b36f59497caa

Observation 9c3c27de-bd74-4666-b467-a0261a7fe174 · outbound

This paper cites Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions.

AI Scientists Fail Without Strong Implementation Capability Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.632210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.632210Z digest=sha256:4e1710f7344c03a25768c7ef968d7711ebe7b2a05db24ec20e435b19fb7378dd

Observation 6ac99bae-9e1e-44f1-a113-6689bd9d5262 · outbound

This paper cites Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas.

AI Scientists Fail Without Strong Implementation Capability Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.748535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.748535Z digest=sha256:a4b7b613d93ae6e0e789250a4ba295a0d70d23aef012645e850d28121a70faaa

Observation f6d4187c-14cb-48e7-9afa-2a8043bb77aa · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

AI Scientists Fail Without Strong Implementation Capability LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.892900Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.892900Z digest=sha256:ed2643f60d6ce8b9db887ddb009291330efbd5db42e933e5af2e00cd97421444

Observation a76b139d-8395-4ad3-bb58-e36029c73cb7 · outbound

This paper cites CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation.

AI Scientists Fail Without Strong Implementation Capability CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.018962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.018962Z digest=sha256:76e6efbd2e53f911fa6c3f91be6d35b512ca257c9de8952da752961bedbbbc04

Observation c02ca024-d610-4280-b654-bec0e03fb7f3 · outbound

This paper cites AIDE: AI-Driven Exploration in the Space of Code.

AI Scientists Fail Without Strong Implementation Capability AIDE: AI-Driven Exploration in the Space of Code

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.119196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.119196Z digest=sha256:df76b95778108ea4a1abcc0eac87ac665bd59429d57599eb0ea23da69f3ffb62

Observation 204eeaaa-4a33-449e-8507-3885c6d0c685 · outbound

This paper cites LLMs Get Lost In Multi-Turn Conversation.

AI Scientists Fail Without Strong Implementation Capability LLMs Get Lost In Multi-Turn Conversation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.467915Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.467915Z digest=sha256:d8454c8c11a08c8819c101812ae32a0b141299f894be6d2d23cec6fea0d85975

Observation a2d5485d-3adc-4870-9c40-39e4f57dea87 · outbound

This paper cites DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration.

AI Scientists Fail Without Strong Implementation Capability DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.711750Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.711750Z digest=sha256:7a3a2a1a6df460db340cc2695455a8ebd6a924595725a9e065b9530f9ee29871

Observation 6a05857c-d6ba-441d-967d-6954f3293163 · outbound

This paper cites AIGS: Generating Science from AI-Powered Automated Falsification.

AI Scientists Fail Without Strong Implementation Capability AIGS: Generating Science from AI-Powered Automated Falsification

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.834636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.834636Z digest=sha256:c232f01a887ab4c2e24381bc323840c0111191ce88832bdf715f1228d261caaa

Observation 235aaf50-4cd0-46de-b0e1-be7201172ac7 · outbound

This paper cites The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery.

AI Scientists Fail Without Strong Implementation Capability The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.993632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.993632Z digest=sha256:a879d435b730be6bfd0b5b0570e015f96464cf4c1c32da8f865ca2c495e26a8b

Observation aded90f8-1b0e-468e-93ab-0942d7935376 · outbound

This paper cites Sparks of Science: Hypothesis Generation Using Structured Paper Data.

AI Scientists Fail Without Strong Implementation Capability Sparks of Science: Hypothesis Generation Using Structured Paper Data

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.355306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.355306Z digest=sha256:bf2e7f14fa1105c9a5dee93e21342fc9ca8c721d33fbd067cc67ea915bd87581

Observation 0beef106-8e32-460f-ac4f-fb8be80c23bf · outbound

This paper cites ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows.

AI Scientists Fail Without Strong Implementation Capability ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.506588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.506588Z digest=sha256:6e2b735d65d5682197658f5e196f5012f3947c36d364b7aec37ffd5a2df92e23

Observation 2361c1dc-27d8-4b59-8ae5-bf3f0db8e94a · outbound

This paper cites Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback.

AI Scientists Fail Without Strong Implementation Capability Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.638623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.638623Z digest=sha256:2aade6835d44cb85f07e03f7700bb9da0e384cd28cd558cc70ba25d406de11f0

Observation 6c18ebcd-7e77-4f2e-aa9a-5068916d1ea1 · outbound

This paper cites Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees.

AI Scientists Fail Without Strong Implementation Capability Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.767680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.767680Z digest=sha256:833d575ce643d429c800003cd1d09b4fcae94d7f8b8f0768f197506390833936

Observation e6c7066e-a501-4827-89d2-c129711fd55f · outbound

This paper cites Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation.

AI Scientists Fail Without Strong Implementation Capability Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.917967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.917967Z digest=sha256:19082dae44622126c22ab5a510f8f4956592539caf4d7b049d3273f0c397c5f5

Observation 39e3ba0f-4d41-4365-b62e-6c2cc684661d · outbound

This paper cites AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data.

AI Scientists Fail Without Strong Implementation Capability AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data

Reference 34

Resolution
verified exact
local_arxiv, observed 2026-08-07T11:49:09.076092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:05.074678Z digest=sha256:e955544b9a7793048aacab17a50459d7fb4d4ed012efda1e45c15f6ab0fff969

Observation 7d38d89a-c551-41ae-b75d-4196d32e43b5 · outbound

This paper cites Spark: A System for Scientifically Creative Idea Generation.

AI Scientists Fail Without Strong Implementation Capability Spark: A System for Scientifically Creative Idea Generation

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.153250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.153250Z digest=sha256:0681fdb277adfdce3636eb92c1bad531bde34fd6035dcfdc0e57f0e3ac4de61b

Observation cc5ffc26-7b64-4ee9-a7e9-e83c1cd9c747 · outbound

This paper cites Agent Laboratory: Using LLM Agents as Research Assistants.

AI Scientists Fail Without Strong Implementation Capability Agent Laboratory: Using LLM Agents as Research Assistants

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.207479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.207479Z digest=sha256:5fa444542e159775c81a232d333667ee8d817b1ed7eab9f5417d59ec8942e0a1

Observation 30edacd1-f051-4d43-991f-dc5313864317 · outbound

This paper cites Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,.

AI Scientists Fail Without Strong Implementation Capability Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.244211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.244211Z digest=sha256:8ab52eb108c122202584a0fab315902592f20965fa2d0a75f7bb1f86b7486f99

Observation 73dccdd8-c7f9-4942-a0aa-e64bb379a31b · outbound

This paper cites ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents.

AI Scientists Fail Without Strong Implementation Capability ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.401684Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.401684Z digest=sha256:6fb0bc718e38a95ff4922b9e5223c9b1ae4fcc297a7e9551e61aaa634ef73b4e

Observation 45f7760b-c717-4a88-9d42-87d77cc67b1e · outbound

This paper cites Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers.

AI Scientists Fail Without Strong Implementation Capability Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.287112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:05.535880Z digest=sha256:29e88e9bb3292618e52657199a1a4fc3d68cf3b823bd19b2bb2d8edff9a386ef

Observation 02fe6701-6a4d-4a7d-9d10-30c697994b52 · outbound

This paper cites CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark.

AI Scientists Fail Without Strong Implementation Capability CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.670557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.670557Z digest=sha256:440d7b7ac043c39551fc1ef7c4556b6950fbf0c6dfe2db6cd2d77d515d2bc16f

Observation 697ba589-c9bd-428e-9c24-33fdf2a7200f · outbound

This paper cites PaperBench: Evaluating AI's Ability to Replicate AI Research.

AI Scientists Fail Without Strong Implementation Capability PaperBench: Evaluating AI's Ability to Replicate AI Research

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.813810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.813810Z digest=sha256:bdd7cffcbf2f8c8076162220b1445a041bd701f2be65a3369c492cb5c1c4edfd

Observation de0a2467-344b-4148-9fc7-a3d9826f11f3 · outbound

This paper cites ZeroSearch: Incentivize the Search Capability of LLMs without Searching.

AI Scientists Fail Without Strong Implementation Capability ZeroSearch: Incentivize the Search Capability of LLMs without Searching

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.037989Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.037989Z digest=sha256:850ea12b27dd6e2cd29c6d9488e1c70080797e7c449543baec1bc54eda68a96a

Observation 84be6792-5dfa-49f8-92da-dcfd78801cc6 · outbound

This paper cites SciPIP: An LLM-based Scientific Paper Idea Proposer.

AI Scientists Fail Without Strong Implementation Capability SciPIP: An LLM-based Scientific Paper Idea Proposer

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.160799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.160799Z digest=sha256:f51a14d4ad75b4381448dd331d1b4583296cf6011a5b652c7f6a48225877edcb

Observation 43e630c0-337e-430f-94d1-27ccad2cdf6e · outbound

This paper cites Large language models are better reasoners with self-verification.

AI Scientists Fail Without Strong Implementation Capability Large language models are better reasoners with self-verification

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.281808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.281808Z digest=sha256:9ccbaeae1335a632a50bf9da306a8ddad839ed8c3aff32c16ffa8095c1a4a5e7

Observation b3a60b3c-a999-42e4-8cf4-12660257330c · outbound

This paper cites Shifting Long-Context LLMs Research from Input to Output.

AI Scientists Fail Without Strong Implementation Capability Shifting Long-Context LLMs Research from Input to Output

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.406833Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.406833Z digest=sha256:bf0678ec7f98141122e65c0464986c8490bbdb253a1a4ec8fe922afe480df91c

Observation 8fdc8173-864d-447b-9033-9030ba33c6ee · outbound

This paper cites Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models.

AI Scientists Fail Without Strong Implementation Capability Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.537534Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.537534Z digest=sha256:274ca6f46577f715a713d61d610627170bc91a9c37861ca306f866ae4c23567c

Observation 3749524d-2ac7-4278-af41-25adaf01aefa · outbound

This paper cites The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search.

AI Scientists Fail Without Strong Implementation Capability The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.629089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.629089Z digest=sha256:c9dec9703b6a34fb61545dcc157b94e072ab38a7ce062b6217fbbbf420d80bb4

Observation 2e2b4c57-17d5-4d04-b0f0-534c632e87cc · outbound

This paper cites Qwen3 Technical Report.

AI Scientists Fail Without Strong Implementation Capability Qwen3 Technical Report

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.712106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.712106Z digest=sha256:2061d809fa0276138ff4f1f1e5ed774dc559cd67d45f717350086accc4d5fa01

Observation ac39e507-a84f-499d-85d7-57c8fcc4520f · outbound

This paper cites ResearchTown: Simulator of Human Research Community.

AI Scientists Fail Without Strong Implementation Capability ResearchTown: Simulator of Human Research Community

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.773231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.773231Z digest=sha256:c638bd6f03b12e9d202e1266e24dfc588e8b3509da060522c1e26b6f2e71e34d

Observation bd66b695-43eb-4d03-a77a-27df4917229c · outbound

This paper cites Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback.

AI Scientists Fail Without Strong Implementation Capability Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.874611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.874611Z digest=sha256:d6e48a88c69271eb1e13bb08cc1e5afb87d7e207b5b3bc4db78bfede74999c3c

Observation c0e1b13b-fb6f-4693-bfb9-df451bed8998 · outbound

This paper cites A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?.

AI Scientists Fail Without Strong Implementation Capability A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.967707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.967707Z digest=sha256:0c7fe2cd85baa13687f2ad2ffa53bcdaa75f34c7cba4ace5df041b9a71eaeb53

Observation ac38bdae-467d-4f26-842e-a8c00a2581cc · outbound

This paper cites OpenResearcher: Unleashing AI for Accelerated Scientific Research.

AI Scientists Fail Without Strong Implementation Capability OpenResearcher: Unleashing AI for Accelerated Scientific Research

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:07.021150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:07.021150Z digest=sha256:c98a367fe74208bfa40702e536946a43d921bc9435e5412618a5bd7cba5ecd97

Observation 65160443-072e-4bf0-b947-7d4a503fc407 · outbound

This paper cites DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process.

AI Scientists Fail Without Strong Implementation Capability DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:07.108809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:07.108809Z digest=sha256:52e8f02f831da536cc971ef625450ee90d370c0525975572a10e554edede725c

Observation 22ce0db0-4cfd-4eba-9b78-1bf14c45e807 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:12.017902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.196636Z digest=sha256:62cb193869e9f836cc4d7a6693668a6ff439e4dc6d5ebd30f79fcc937d5e4847

Observation 9f75f9e0-8ad2-49d0-9c37-ae48a51465cb · outbound

This paper cites 20 AI Scientists Fail Without Strong Implementation Capability.

AI Scientists Fail Without Strong Implementation Capability 20 AI Scientists Fail Without Strong Implementation Capability

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:11.816501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.292111Z digest=sha256:51019cbe81d93ee3b3e0673c74f309a54d90c8c24d9a385b79537b5ca340c97c

Observation da08517b-7ead-4848-8887-6e2a8692ecee · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.589600Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.393120Z digest=sha256:850e94deac3dd5fe0a7c9f51a775fbdb109ea5d66bf716165d72962af141b503

Observation 915f0bc9-9492-486b-b8a0-8002cdd1da20 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 58

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.299542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.495776Z digest=sha256:33723958898001c3fa170437305aa6146225e7bce64ac0eabaebe49b18cbd0fb

Observation de53a12d-9fb8-474d-accd-d93fc7eb84f1 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.107790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.630519Z digest=sha256:b30522ccaf9892f6d9f8ef5a4c20d708999a36bd7a1416fd5124ece0fc402602

Observation fcf12ab1-8867-44de-bf73-2ff2ea178a2e · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.828847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.747320Z digest=sha256:bbdc35ee51d5144f4e3299becdd366ed4f9c4fc9f01c85b1bdc3a9d867cf5fe8

Observation e9a5207f-ab4c-4ab9-bb35-e21f6bb3a22d · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 61

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.568651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:07.952347Z digest=sha256:05280b670ef521d1a1f449022d689074d84b97527ae7819ff7c6526f3b2679bc

Observation 7891ea88-2462-4c41-9c95-90195d0ccbbb · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.280713Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:08.144957Z digest=sha256:3c5f77b284b63b2521fd503743caf843a64ea043308024d221473eba01940c56

Observation d31021fc-58fb-40a7-bf35-a0eb1c798360 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.030667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:08.278926Z digest=sha256:e921c5a69e4aff90ccb4985e4d360ebdb18bcaa4f5eec15cf35ce4f1fb5404c2

Observation a58418a2-43df-4c82-8413-ba25425592fb · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:09.735966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:08.400971Z digest=sha256:12ed648ee2fda4c53c3fa5332ef6de095011af4876f253d255246087a9623da5

Observation 25f635d1-381d-415d-9193-43ec5624fd91 · outbound

This paper cites Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field.

AI Scientists Fail Without Strong Implementation Capability Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:09.569047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:08.589917Z digest=sha256:1a8546879d8b6f6cafba8cbd6b002981115baea5f131437051fba01e7e7bce77

Observation 31bcb75f-f68b-4ef5-a051-1338c4ea2a27 · outbound

This paper cites Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents.

AI Scientists Fail Without Strong Implementation Capability Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents

Reference 1987

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.588515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.588515Z digest=sha256:52cfb630d0d9c7673b44ed466468438b86f7648dc42e35dcc3f20e03ce58b3bc

Observation 50602bd2-cd08-49dd-99ad-4b24cadfc3b9 · outbound

This paper cites Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents.

AI Scientists Fail Without Strong Implementation Capability Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents

Reference 2009

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.336587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.336587Z digest=sha256:1d1ac7dc71656b0ce109284f21c1e90e137f2783cf3e04e4b0c85e37434da4be

Observation 8a0a26d8-9c2c-4f9e-96fc-38ad2251bbf6 · outbound

This paper cites s1: Simple test-time scaling.

AI Scientists Fail Without Strong Implementation Capability s1: Simple test-time scaling

Reference 2013

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.160309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.160309Z digest=sha256:a03ce22c7b32585cd1e9e20062197e62853cc318a8558dc2c5aab9e5c7e30494

Observation e8702435-4ef3-41b9-805c-cb0e4c488351 · outbound

This paper cites Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System.

AI Scientists Fail Without Strong Implementation Capability Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.903065Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.903065Z digest=sha256:c68cbb82b6b19370733072e46ec897457f42adaed0da5701ece193571d73e79f

Observation c8c668d9-075d-4330-9d09-355f19274d50 · outbound

This paper cites Scaling Laws for Neural Language Models.

AI Scientists Fail Without Strong Implementation Capability Scaling Laws for Neural Language Models

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.210248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.210248Z digest=sha256:1fdd2377ac9aca50f7e38be6e34a38d0ab0011329bfaa19a37f7ea76b2c23c1c

Observation db1dceec-20e1-46cb-88b5-1ec12348c48d · outbound

This paper cites Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,.

AI Scientists Fail Without Strong Implementation Capability Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.529426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:01.262343Z digest=sha256:2d338f0a4ba86171ebe34c0042c8239fcb855af05e96cf0a29ebe77709b17e46

Observation e37c7520-1da2-45ef-b12a-a850c6209bd6 · outbound

This paper cites Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz.

AI Scientists Fail Without Strong Implementation Capability Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.763454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T11:49:00.848110Z digest=sha256:0bea5e6e98c8d184f07260fa05f56a57c84b2169ca879ba54cf73878f942a339

Observation 03c1fc2a-f737-4294-88ae-31b39d749740 · outbound

This paper cites SWE-Bench+: Enhanced Coding Benchmark for LLMs.

AI Scientists Fail Without Strong Implementation Capability SWE-Bench+: Enhanced Coding Benchmark for LLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:00.759281Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:00.759281Z digest=sha256:2d83e9834803ecc97c06b4d38285b199375da485d2af0cfa17d75ff49b411839

Pith citing papers

Observation 97cfaa6a-2bb8-435e-9301-ba03667c0551 · inbound

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation cites this paper.

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation AI Scientists Fail Without Strong Implementation Capability

Reference 37

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:31:27.256386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-12T04:12:49.742272Z digest=sha256:6d8e5f85e4847731bc8c39b5a81921a952801d623124131ee1689ef9fd2ae557

Observation f88f855f-8dd1-40e0-8d56-2bd040ecf91c · inbound

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility cites this paper.

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility AI Scientists Fail Without Strong Implementation Capability

Reference 41

Resolution
verified exact
arxiv_id, observed 2026-05-20T20:03:44.063892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-20T19:59:40.519962Z digest=sha256:c69bce72de0140f110cea1870fc3c10c5bebd6a81dd015aff218530a7be0de67

Observation 86739275-b7ef-446e-9e91-d13888aeffe3 · inbound

One Run Is Not an Idea: The Implementation Lottery in Automated Research cites this paper.

One Run Is Not an Idea: The Implementation Lottery in Automated Research AI Scientists Fail Without Strong Implementation Capability

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-01T12:50:06.841591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T12:50:06.841591Z digest=sha256:0252f9e5667f4a0915b19201b10491dc61422148502282a01c9ae511e342811d