Pith. sign in

Paper Citation Record · LEDGER

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

As of 19 August 2026, this Paper Citation Record lists 31 of 31 outbound references and 21 inbound Pith citation observations for arXiv:2506.20803.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.20803 v1

Coverage vector

measured 31 of 31 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T22:46:33.156020Z

measured 52 of 52 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 21 of 21 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T16:57:31.387939Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

31 of 31 outbound references displayed

  • verified exact2
  • verified fuzzy7
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

5
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 00703af7-326d-4ffc-b93c-00dacbf50e1b · outbound

This paper cites ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:35.190941Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.291276Z digest=sha256:d897288dcd4c1a9b102331eccadece53cc94851ade5a5db0d6d4723b8a732502

Observation 67fd02ed-a4bf-4d53-a634-a0ad047660a0 · outbound

This paper cites AegisLLM: Scaling Agentic Systems for Self-Reflective Defense in LLM Security.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas AegisLLM: Scaling Agentic Systems for Self-Reflective Defense in LLM Security

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.294610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.294610Z digest=sha256:33415c8f135d3e748c67001a752e6064f3df37d7c4ea4038a6108ff044263c4d

Observation 228813cc-0da4-46f0-8bf2-3bd2f3fc728d · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:34.988182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.298312Z digest=sha256:73dc63cfc92080246f840596259f39b16d11ea613e0a0b39030e2844d24b17a8

Observation 98378095-ac1b-4c4f-88a7-0c3de786aa44 · outbound

This paper cites MKA: Leveraging Cross-Lingual Consensus for Model Abstention.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas MKA: Leveraging Cross-Lingual Consensus for Model Abstention

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.302278Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.302278Z digest=sha256:a169ba00fd7964b61510641630061df9a1010297aad91a9fe8df70095ccdc413

Observation eb204c3a-d88b-4077-b0e3-58a2dde035fe · outbound

This paper cites GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluation.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluation

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:34.736239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.305812Z digest=sha256:d9c12c960e0daadc4e30951a632e2ee9da64732845b6bcba1251ea8c64dacb1c

Observation bc61364e-4920-4792-b090-a888717aff0b · outbound

This paper cites Robin: A multi-agent system for automating scientific discovery.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Robin: A multi-agent system for automating scientific discovery

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.311908Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.311908Z digest=sha256:ca1da3970d70c6bcc3a52f4001561a4167d7c4f45c57d70a1b149dcf982e341d

Observation fc741bfc-a45e-4124-8c5e-3b35c936be64 · outbound

This paper cites Towards an AI co-scientist.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Towards an AI co-scientist

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.324482Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.324482Z digest=sha256:9dab57c35963653c925922c735840e60c151422c86c9f317f9d129aa619f0468

Observation c7302cbb-5dcf-4c0a-81b8-1cfc06a113be · outbound

This paper cites Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.340092Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.340092Z digest=sha256:4105cd845f74a4082da5b084a9e121ecb1cdc8e80a7ef90545937eb3a280acc8

Observation b555cb75-8a55-487b-8429-0ff88055c6cd · outbound

This paper cites ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.360665Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.360665Z digest=sha256:edcc1a4e938855770f04064267fcdd09f1a7efb4c1b2a060ae8d4af8b8fb7458

Observation aec80428-b394-42a8-8609-6c56c78011e8 · outbound

This paper cites Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:34.474816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.380745Z digest=sha256:44d32444f7bb33bf10914838a77aa99a5c079a1351fb5db5849ec5ef686f767b

Observation 2ab0eccf-1846-4796-83ff-da46695cc234 · outbound

This paper cites ML-Agent: Reinforcing LLM Agents for Autonomous Machine Learning Engineering.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas ML-Agent: Reinforcing LLM Agents for Autonomous Machine Learning Engineering

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.398654Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.398654Z digest=sha256:0baa519d3112140533286e50121bd9f5050bee6c19af3e10f2d7c08206a790dc

Observation 80e5480a-d942-4a84-b4da-0e154b53ff9c · outbound

This paper cites The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.410987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.410987Z digest=sha256:5dcc54f356b82491ea190d8886bfb5d4255b2b4d0f45f210ec79b8787864c1c4

Observation 096d9ea9-c184-4cc3-9609-1cf21468d86a · outbound

This paper cites AlphaEvolve: A coding agent for scientific and algorithmic discovery.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas AlphaEvolve: A coding agent for scientific and algorithmic discovery

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.430763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.430763Z digest=sha256:b5034a0ee2463166ab5401f1c7943565069ef0f0e0f94cdd9c56561126cb5cea

Observation 4922400d-bfb2-4c28-a819-628dc7d78ad4 · outbound

This paper cites Sparks of Science: Hypothesis Generation Using Structured Paper Data.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Sparks of Science: Hypothesis Generation Using Structured Paper Data

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.449311Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.449311Z digest=sha256:ab981384aee93535d85e2b7651af5eba22d8c218934d6ef8a430e53400960eda

Observation 30c85b91-49e7-4937-a634-b0b933e1094b · outbound

This paper cites PolyPrompt: Automating Knowledge Extraction from Multilingual Language Models with Dynamic Prompt Generation.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas PolyPrompt: Automating Knowledge Extraction from Multilingual Language Models with Dynamic Prompt Generation

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:46:33.488984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.459855Z digest=sha256:cf439af6db30c1c7f085dc26e082aca83aa0a6221cfc71f8d744f74f80420ad4

Observation 1c778db2-2db4-4144-9714-876a10428770 · outbound

This paper cites Agent Laboratory: Using LLM Agents as Research Assistants.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Agent Laboratory: Using LLM Agents as Research Assistants

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.469365Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.469365Z digest=sha256:4592969741e217468412b2d42bea5024bc3a928bee891a734fdacbfdf6245de3

Observation db1c6437-2bef-476a-9b20-a1e4b10dce65 · outbound

This paper cites Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.481284Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.481284Z digest=sha256:8a3ed5642aea9453b52f7a3448006312e8ebd28e5c05f8d7215583455348d79f

Observation 1304bac4-e3b0-4c61-b74d-e54f6d1e89de · outbound

This paper cites Do grant proposal texts matter for funding decisions? a field experiment.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Do grant proposal texts matter for funding decisions? a field experiment

Reference 18

Resolution
verified exact
doi, observed 2026-08-06T22:46:33.291371Z

Source-reported events for the cited work

correction dated 2025-07-31. Source: crossref record 10.1007/s11192-025-05378-z->10.1007/s11192-024-04968-7:correction, observed 2026-07-11T03:07:12.810595+00:00. This notice travels one citation hop only.

source=arxiv_source observed=2026-08-06T22:46:32.493449Z digest=sha256:e05addc9b6ed627d3478eb5128d0daee524b4189619907b1443929af7d138c7e

Observation 4fa9087a-1413-4dc8-bd64-04df1a96429b · outbound

This paper cites PaperBench: Evaluating AI's Ability to Replicate AI Research.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas PaperBench: Evaluating AI's Ability to Replicate AI Research

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.508384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.508384Z digest=sha256:b0cc4d172411352c83b568ba23396cdf8d2f5ac7387692032315298fed610fd6

Observation 7c4f7d9d-15af-4f9b-aeb7-f1d761c34805 · outbound

This paper cites Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:34.210417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.518304Z digest=sha256:741a34d25dca092fac9b007e84add685ecb3b458273065d2f88e69b0fb018d73

Observation cf35c5c4-4142-4fc9-904d-8697248ce283 · outbound

This paper cites SciMON: Scientific Inspiration Machines Optimized for Novelty.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas SciMON: Scientific Inspiration Machines Optimized for Novelty

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:34.075925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.531862Z digest=sha256:aa7907b34d95089fd637cc4d9e18b350120c3c3d6aaa4f2cdeef72a1aa1a20a7

Observation 3a74ba77-5c9c-446e-a6d5-bc8516f37112 · outbound

This paper cites SciPIP: An LLM-based Scientific Paper Idea Proposer.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas SciPIP: An LLM-based Scientific Paper Idea Proposer

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.550114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.550114Z digest=sha256:c28de464604f54ba4de21f05f38a24e65c7ee74f99233d8b6023cd16c512f6f6

Observation 75729d29-f9d4-45d6-9258-680d865673ea · outbound

This paper cites Predicting Empirical AI Research Outcomes with Language Models.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Predicting Empirical AI Research Outcomes with Language Models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.625500Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.625500Z digest=sha256:a4540d49093aa851ae6f695ff51f057b29570f7e393cb0f620c124301c2495bd

Observation 07005814-025f-417a-b89c-e587dbdbdbfe · outbound

This paper cites CycleResearcher: Improving Automated Research via Automated Review.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas CycleResearcher: Improving Automated Research via Automated Review

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:46:33.948261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.675985Z digest=sha256:c7034d6bdedf1c1091ba05b7c630037243c2e3e835181958a8ee0eacb9d2731d

Observation d6c149a9-9e06-4ed2-9645-1f0d172889d3 · outbound

This paper cites The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.774937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.774937Z digest=sha256:ba1e848e15c5d5151641d384a82da57880df8f6ceac3006a3e00cbdae95369a3

Observation ee2ec944-7953-4fb2-b559-fa5dda004153 · outbound

This paper cites an unresolved cited work.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:46:33.843638Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:32.835580Z digest=sha256:e18ad7ccb5cd753f505d2da3c70adba4369f8f1cdcf651d1b8f37db0cd0b617c

Observation 41a2dcef-2df7-4852-90cf-5c5f2302e465 · outbound

This paper cites Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.924554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.924554Z digest=sha256:94def475145a534512e009cd1d7a5f9e9c4db8c12257eec7afb705b527178a2c

Observation 752cd971-5ef7-4051-a633-16f5c3105158 · outbound

This paper cites DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:32.974824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:32.974824Z digest=sha256:d1d605c839eb214852f3ad045527f40ac9f009199a1aac58927c436d1610e1fc

Observation 46068ff3-3751-4f20-a76c-059dd8f25427 · outbound

This paper cites @esa (Ref.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas @esa (Ref

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:33.041988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:33.041988Z digest=sha256:97fa1571a41675b86cad23401c5bfe7fe7525e6436aa0d56faa2439342b78cdf

Observation cd9b7540-cd1b-4e3a-8dc7-a405e752411a · outbound

This paper cites an unresolved cited work.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Unresolved cited work

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T22:46:33.113858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:46:33.113858Z digest=sha256:03bc55c0adf6766eb8e07ff3327a91dbcb32659b3fe614dcdabf2fda090d187b

Observation 2ba246fc-1f3e-46e9-b782-0e3ef5bc0616 · outbound

This paper cites an unresolved cited work.

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:46:33.702397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-08-06T22:46:33.156020Z digest=sha256:4cf5f8917ef89a16b0623b887fb54fed1120338f8da5703543ed1734aee4ff70

Pith citing papers

Observation 5921caf9-3a17-4d79-9786-fc65a55f9fce · inbound

The Ramon Llull's Thinking Machine for Automated Ideation cites this paper.

The Ramon Llull's Thinking Machine for Automated Ideation The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-15T16:57:31.387939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T16:57:31.387939Z digest=sha256:74663e09420cda7ca3d02ffce1def49ed44766959562df3301a773356786020c

Observation 0ed6a4f8-d435-46e3-a8f4-50c19c7b8ac4 · inbound

AI Can Learn Scientific Taste cites this paper.

AI Can Learn Scientific Taste The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-02T18:14:49.432140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T18:14:49.432140Z digest=sha256:0df9de581317b378def93a17f3af9bd6fd72c443aef829c434f0cce2e7754542

Observation 9949dd71-25f5-4968-b5d1-670f981561cc · inbound

GIANTS: Generative Insight Anticipation from Scientific Literature cites this paper.

GIANTS: Generative Insight Anticipation from Scientific Literature The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 18

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T07:41:00.552303Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-10T17:03:15.684802Z digest=sha256:03042254f3896d7c9079bf1c4fba7dc328a1e7ff5459593e4d1e2dff0746bcd4

Observation 044efe7b-72d8-4864-9ad5-53c35b3dc21a · inbound

From Planning to Revision: How AI Writing Support at Different Stages Alters Ownership cites this paper.

From Planning to Revision: How AI Writing Support at Different Stages Alters Ownership The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-05-10T16:15:33.902253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-10T16:15:30.759417Z digest=sha256:fb1538d469acca43720c2f66f9f2889f6a7a4f7535027f91610a9bea1c0803d6

Observation 570744b8-3df6-4651-b28f-afd51983726e · inbound

LLMs Generate Kitsch cites this paper.

LLMs Generate Kitsch The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 3

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T22:28:21.223860Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-13T22:25:13.409458Z digest=sha256:4b9c47329efe921342b054f51c432aa91aabc4a763ed10b904350ad565d69393

Observation ddc097c4-4d02-45e6-8dbe-57570441d222 · inbound

Intern-Atlas: A Methodological Evolution Graph as Research Infrastructure for AI Scientists cites this paper.

Intern-Atlas: A Methodological Evolution Graph as Research Infrastructure for AI Scientists The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 29

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T10:16:28.550299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-07T06:42:17.145367Z digest=sha256:9d673e8984d55ec735662d5d49ad366c64d133e7083ef71628db90a9d88608ad

Observation e7633602-7dc8-445d-8878-b630e77f9868 · inbound

Back to the Beginning of Heuristic Design: Bridging Code and Knowledge with LLMs cites this paper.

Back to the Beginning of Heuristic Design: Bridging Code and Knowledge with LLMs The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 74

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T19:56:10.169967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-08T10:35:18.493523Z digest=sha256:cf4d2c07a37009eb49bdcd8279e3e4da6a223f9a8133142323667e3e83bb0fdf

Observation 50e7016b-2e05-4c35-85be-1fc8291b34a6 · inbound

Assessing the Creativity of Large Language Models: Testing, Limits, and New Frontiers cites this paper.

Assessing the Creativity of Large Language Models: Testing, Limits, and New Frontiers The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 19

Resolution
verified exact
arxiv_id, observed 2026-05-14T19:12:50.807123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-14T19:11:07.615149Z digest=sha256:2dd4517367c5cb444f32accd5bc095607299c5900289ed6955ebf09498d0d0d5

Observation 4af4b0c6-37a8-4a13-92ba-9b6ddd322ea7 · inbound

AI for Auto-Research: Roadmap & User Guide cites this paper.

AI for Auto-Research: Roadmap & User Guide The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 185

Resolution
verified exact
arxiv_id, observed 2026-05-20T10:33:12.535856Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-20T10:30:50.256635Z digest=sha256:1977f9483fbc4836ac27f583426ddedfa21845f906671d2182ce2698969d382c

Observation b026461f-8a43-4a19-8ea0-a840c966dae9 · inbound

AI for Auto-Research: Roadmap & User Guide cites this paper.

AI for Auto-Research: Roadmap & User Guide The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 184

Resolution
unresolved
no resolver link, observed 2026-08-02T13:43:46.164762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T13:43:46.164762Z digest=sha256:24c2ebd727a4f1014737f6d0a49de32573077c7217a5dd226043c64fb059eeb3

Observation 57cc7d64-b31e-4b0e-ac57-b0cfc488eb74 · inbound

Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluation cites this paper.

Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluation The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 5

Resolution
verified exact
arxiv_id, observed 2026-05-22T01:50:54.720402Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-22T01:46:49.952433Z digest=sha256:12e3501aea46303b629fb1389dabcae68077fadbeb361e986491bfa88356e62c

Observation 6f270a66-6110-40d3-b08c-2ded9fd70e3f · inbound

SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones? cites this paper.

SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones? The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 12

Resolution
metadata mismatch
arxiv_id, observed 2026-06-29T08:23:15.803581Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-29T08:13:42.770740Z digest=sha256:0c259679a2eabb97b4cf1931c2742aa187f1c137f1897ad3f50ee79e9aa2ca6b

Observation 4affd43c-bcbd-46a2-bca8-4da7f884a6df · inbound

Can AI Agents Synthesize Scientific Conclusions? cites this paper.

Can AI Agents Synthesize Scientific Conclusions? The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 108

Resolution
metadata mismatch
arxiv_id, observed 2026-07-03T05:47:41.449102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-27T13:05:07.718882Z digest=sha256:03afb490dce45a3abf45940304c3f7511be76f78d41f24e8901cee1673e244d4

Observation 1e1ab769-01bd-43e5-8bd0-903555bdda78 · inbound

Measuring the Gap Between Human and LLM Research Ideas cites this paper.

Measuring the Gap Between Human and LLM Research Ideas The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 3

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T12:26:56.091188Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-07-02T12:22:54.748120Z digest=sha256:f1d899583a353f39112b1a1c277660ff5bd7b72da855a83af1e88d2b67fa2bff

Observation 1aa1b5ea-6b5f-4e98-ad7c-3f15b4a5674e · inbound

ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes cites this paper.

ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 46

Resolution
unresolved
no resolver link, observed 2026-07-11T19:11:37.739920Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T19:11:37.739920Z digest=sha256:1810f248e3f5b8454c05a5ee653b12c38096a7fabacd7ef59eb80fa1ec909af9

Observation bce017b7-dd87-48ca-bb02-a5878b6ccb61 · inbound

Budgeted Subset Refinement for Execution-Aware LLM Research Ideation cites this paper.

Budgeted Subset Refinement for Execution-Aware LLM Research Ideation The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T14:33:45.588264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T14:33:45.588264Z digest=sha256:02a0b2f673c7f56223479d27ca99f29160a79f7e61ceac1b1435f4f6ccd677de

Observation c0ff8717-d4c8-4d91-ad5e-76183b470780 · inbound

Revibing Code from Papers: Reimplementing HCI Artifacts cites this paper.

Revibing Code from Papers: Reimplementing HCI Artifacts The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-15T15:24:46.329603Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T15:24:46.329603Z digest=sha256:2aed197dce300fbfbca4f349ea61b10b93f0781d63c1b168025dd56c009662db

Observation 1a671460-725d-485a-9989-34d35d766423 · inbound

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation cites this paper.

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-04T23:25:09.648518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T23:25:09.648518Z digest=sha256:a43df05f0db7834661d199a6eb0993177463cc46b6f6d01ae5ae0f13897de165

Observation ed1ad1a1-61ef-4dfd-b8ff-2c1325abd7d6 · inbound

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation cites this paper.

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T00:15:14.211946Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:15:14.211946Z digest=sha256:3f96a250193369a05e57ecec6472c15612c0cac9165f7638abaf2686ffb962a4

Observation 5cd9b6dc-a3b1-4987-9e08-7abcba53c8d1 · inbound

Idea Search: Guiding Tree Search with Ideas to Explore Diverse Scientific Methods cites this paper.

Idea Search: Guiding Tree Search with Ideas to Explore Diverse Scientific Methods The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-14T04:23:27.552071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T04:23:27.552071Z digest=sha256:4cb0758a67534c82ffd6594ba6733c8da32c59d5d4e1869e858b925e34f10dfe

Observation b507956c-5f35-4ec7-9050-c2446868c4d1 · inbound

Tree-of-Ideas: Automated Research Ideation via Cross-Trajectory Reasoning over Scholarly Evolution cites this paper.

Tree-of-Ideas: Automated Research Ideation via Cross-Trajectory Reasoning over Scholarly Evolution The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-12T18:21:41.264689Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T18:21:41.264689Z digest=sha256:ef82494addaf8a2c627da17c91e71c070b0eba23d484a35a62bc5cc8203c7165