Pith. sign in

Paper Citation Record · LEDGER

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

As of 23 August 2026, this Paper Citation Record lists 43 of 43 outbound references and 13 inbound Pith citation observations for arXiv:2602.02905.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2602.02905 v2

Coverage vector

measured 43 of 43 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T05:17:18.477910Z

measured 56 of 56 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 13 of 13 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T23:22:10.051070Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

43 of 43 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved41
  • parse uncertain0
  • malformed identifier2
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 60b5d011-6f12-4057-876a-fec078a6ca27 · outbound

This paper cites 2.Experiment Completeness: Whether all key experiments from the paper are captured in the tree structure.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights 2.Experiment Completeness: Whether all key experiments from the paper are captured in the tree structure

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.402142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.402142Z digest=sha256:176edbbbec7ec9ddb62f920fbe466cd4e9a50e52e2e2c3131544dad4542fb893

Observation 85532995-9951-458c-be16-567d8fb3682f · outbound

This paper cites ChemCrow: Augmenting large-language models with chemistry tools.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights ChemCrow: Augmenting large-language models with chemistry tools

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.382660Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.382660Z digest=sha256:8e87284cd1017fe492e54a239dabfcd7595e1be6407be0a3fa0efe55d6819084

Observation b3016884-444a-4dcb-8cc6-da3351167143 · outbound

This paper cites 4.Structural Coherence: Whether the hierarchical decomposition follows a logical parent-child relationship.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights 4.Structural Coherence: Whether the hierarchical decomposition follows a logical parent-child relationship

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.404462Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.404462Z digest=sha256:e8d964655e8d81157c71b0edc5843777db347aabbcf07e3daee9f1f89c2e08ab

Observation 97034d38-aa55-41b9-8a0a-1decd5c58c65 · outbound

This paper cites AgentRxiv: Towards Collaborative Autonomous Research.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights AgentRxiv: Towards Collaborative Autonomous Research

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.388441Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.388441Z digest=sha256:6609f409766025f36827b19301ddfa82bae15ffe80273773ff57eabf66d76053

Observation 65a82c89-567e-44b8-82cd-f489ab58f16c · outbound

This paper cites PaperBench: Evaluating AI's Ability to Replicate AI Research.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights PaperBench: Evaluating AI's Ability to Replicate AI Research

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.391571Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.391571Z digest=sha256:c0077d2400a8e94a636e7ca55b27ae90a72cd6a7557c3de03484dad826f4664e

Observation 74c209ba-2920-48f4-8962-66a51de19d7d · outbound

This paper cites Wang, X., Chen, Y ., Yuan, L., Zhang, Y ., Li, Y ., Peng, H., and Ji, H.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Wang, X., Chen, Y ., Yuan, L., Zhang, Y ., Li, Y ., Peng, H., and Ji, H

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.394215Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.394215Z digest=sha256:23d381a0c0baa1dd4a68f98f5d3bb48f6e7b57ffdca0487df3277bd829f24eb9

Observation 497e45f6-f199-44ca-9d36-716652175e33 · outbound

This paper cites CycleResearcher: Improving Automated Research via Automated Review.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights CycleResearcher: Improving Automated Research via Automated Review

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.396653Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.396653Z digest=sha256:0007fb2699fb5b456b8de09246e75a5765d0906bb56da7e9d2e290df5c47ff1b

Observation acd4b857-3906-4289-97d5-7ed911cbef95 · outbound

This paper cites ResearcherBench: Evaluating Deep AI Research Systems on the Frontiers of Scientific Inquiry.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights ResearcherBench: Evaluating Deep AI Research Systems on the Frontiers of Scientific Inquiry

Reference 8

Resolution
malformed identifier
no resolver link, observed 2026-08-03T05:17:18.399197Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.399197Z digest=sha256:f45b6069f1795632eed33043742057f0369727db5d2ab91707bdb591d3254b17

Observation 2894f4f6-dfaa-4889-8c2f-fba9c0a6fa48 · outbound

This paper cites The results, shown in Table 9, demonstrate consistently high scores across all aspects, confirming the quality and reliability of the LLM-generated problem trees used in FIRE-Bench.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights The results, shown in Table 9, demonstrate consistently high scores across all aspects, confirming the quality and reliability of the LLM-generated problem trees used in FIRE-Bench

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.406752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.406752Z digest=sha256:1b47205d0c63b780f7ec42ae10f4bd1448f0ea166696ae32ad911b1e50d249a7

Observation e346ac83-7587-43e9-8a17-cadc287323e9 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.409136Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.409136Z digest=sha256:0b1aea24c5f80057d01d7e06dc691c8afc6de0a70a7498be0e2929f9ace52a20

Observation 4b21656a-ccaa-4a2d-ab2b-6e88bf3942b6 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.411320Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.411320Z digest=sha256:c779991765b1882fc5d98453f8f5b005bd47b454b775584f7cea37cc0ad0bf5e

Observation 7aa854b5-5295-4794-8fd9-7b2d3109d286 · outbound

This paper cites RAGChecker atomized claims:.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights RAGChecker atomized claims:

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.413489Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.413489Z digest=sha256:28eb2271b8b1027cb17169155eaf1d98a3f41a53db10128fc090ff222dbd8611

Observation 6a0ae846-524a-4573-8a5c-538ec13481f9 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.416426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.416426Z digest=sha256:1f8c7ea5ee48017b08d391f65a02264b9848f5b6a99982470e32868ab67b0d35

Observation 477d1391-90f4-4294-b7b4-c5c831028d43 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.418547Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.418547Z digest=sha256:7f54a39d5d91af28fd38f18a0524231af066fcd1a5d6a42f6c7a074d1be2d382

Observation fd17c4b8-326a-41d2-a72c-ac4588afdc22 · outbound

This paper cites Metrics:TP = 3, Precision = 1.0, Recall = 1.0, F1 = 1.0 Justification:Human claim 1 matches RAGChecker claim 1 (both assert early placement improves accuracy).

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Metrics:TP = 3, Precision = 1.0, Recall = 1.0, F1 = 1.0 Justification:Human claim 1 matches RAGChecker claim 1 (both assert early placement improves accuracy)

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.420532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.420532Z digest=sha256:4a6bf735f716ff720b7cb54b327e3e17e4cecf22aac0428c21109a8aebbf3bbf

Observation d1e30399-aec4-42db-9e38-c74987c133c0 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.423022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.423022Z digest=sha256:4bc11809a7f55dcfbda19c450f7a2cd164e086ead78504026597b85f4ef42ff7

Observation 73bc7f87-dd03-46f5-b7ca-51e6a50b4a1a · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.425163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.425163Z digest=sha256:3f288b5f37bec426bba64a2eab9477ca2a127068d2999ec25efc027db6635fc4

Observation 22f520c5-bd3f-4c38-b472-68208029aabd · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.427051Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.427051Z digest=sha256:5cf03941cebe954c9060dee28c64bf7378d2aa3ad11ce047296298943c7b6ac5

Observation 2f85c355-5ccc-4117-8b3e-7ad977a3f15b · outbound

This paper cites RAGChecker atomized claims:.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights RAGChecker atomized claims:

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.429683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.429683Z digest=sha256:ca81718d514a75a31539ddedca8ee5c670c14d7ac6414a06f0c3878767e74056

Observation 355d5656-0101-4fdb-9432-5cf081143deb · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.431618Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.431618Z digest=sha256:89ac3af1903dacffa5aa1a374daf8810f2c1f0b6d786dd5d20ff2bd4b823cba3

Observation 5540bfc0-a11d-49f0-817c-b4200d77ae21 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.434028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.434028Z digest=sha256:b05095753c402e193f776a0b12406c47e7b1af4bf50391c6be535819649ab0da

Observation 1168059c-bb01-4367-92e5-1e8eeef2d8bc · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.435949Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.435949Z digest=sha256:f6c4ff899a8d530cc82a8c2fab9ae3d08bb1b1f283f5e9142fc93f10f544f92e

Observation 6d1e2341-4c4f-4a5b-8d61-c0fc19db9310 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.438132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.438132Z digest=sha256:46d9e460757294b9215d57680479c40b3aa117862d4dae2a58770a771cf27176

Observation 3f10cf8d-b672-4446-b153-82c2cf059a4f · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.440157Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.440157Z digest=sha256:7253c0faff2e12a45a24ab0992afe7046c4a6f7ae48d8787dca99cd713348761

Observation bc92d0a5-1997-4c97-9c09-e1e7e2b7d3bc · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.441996Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.441996Z digest=sha256:b03f80b1e6492c21e64ba1a640e794d99f442a199c445cbf19803666a6632074

Observation d82287d3-bb57-4f8d-94b7-7915c525684f · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.444226Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.444226Z digest=sha256:9666d0ae6596033f8b2a8f8fdf85ba825ca7d7274698dc59c062e9966950175c

Observation 6bc373ca-f690-484f-be95-3b20e69ef209 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.446247Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.446247Z digest=sha256:987470b7e225279bb83f5551612eefbf40949fb8eaa101e319df0944e64d7a8b

Observation 552975c7-f36f-4e3f-bfcf-82c7dc9a6f0c · outbound

This paper cites RAGChecker atomized claims:.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights RAGChecker atomized claims:

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.448150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.448150Z digest=sha256:9002b6fc17665097c69f573a030daf277ec7e0309ad00cfd2afb042e35d85a7d

Observation e36a50f1-0890-420b-b975-0e36220e5cc7 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.450332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.450332Z digest=sha256:7a74a6124cb99ff79262c2bfdb92a72be6560b3136a8ffdadd447374fae39103

Observation 6a2a1ba0-7e65-43f2-9229-c9b52fb6428b · outbound

This paper cites 23 FIRE-Bench: Evaluating Agents on the Rediscovery of Scientific Insights.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights 23 FIRE-Bench: Evaluating Agents on the Rediscovery of Scientific Insights

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.452604Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.452604Z digest=sha256:7b8c1ee0bc0f4cba5e1295bb1b4ca728d0839ef50fe6f1159d21e45c89231580

Observation b8b80036-acd3-4e72-8468-47914f61206f · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.454632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.454632Z digest=sha256:f9fd140bcac5e2e33031d59d7573a820f319d1ea48a642e9dafcc086b4083741

Observation 0623cee0-2dd3-4153-8712-a759d2e157f3 · outbound

This paper cites Models better at using relevant information at beginning of input context and the performance drops in later position.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Models better at using relevant information at beginning of input context and the performance drops in later position

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.456565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.456565Z digest=sha256:a351859fd8f0b7376027091ca46c30552a8ac73e0db07556eac067c4ec3609a3

Observation 438ef993-8b29-4ac9-8fa4-72e397a28885 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.458929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.458929Z digest=sha256:baf97d2a08ecd65fc2b5b784ef115f2df51061229ec7739ed8f6d9b5040b54ce

Observation 3453e61c-a3a7-482e-90c0-aedc35aad6f5 · outbound

This paper cites first... second.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights first... second

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.461003Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.461003Z digest=sha256:01d149529fa63d2b24a8945a75067757861dc1bd8777b01558d94f9e6804fe46

Observation 8eec02cb-75eb-4023-83f8-416861793dc3 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.463236Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.463236Z digest=sha256:aab12dffed76fa3049fa0f1f1b80a36c62a9e33a5b678fabcd84d94994570cdf

Observation 490dcc49-928d-4493-a08e-761684ea4651 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.465475Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.465475Z digest=sha256:ad9228a7def62854bfbea772ca5be85cb49ea6716046a0e89f1a27348a0e7ab3

Observation 4202df0a-fa54-4014-a08e-d5c2be75b097 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.467556Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.467556Z digest=sha256:ecf4fc81603851551fcee1509c98973f17187f7f894aad0b691d93223deffe45

Observation 8b623832-05c7-4c1d-963a-dcb5dbe47b3a · outbound

This paper cites paper": {.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights paper": {

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.469520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.469520Z digest=sha256:ede4c19fb3027a700579b23b0d9df294ce54821e94796c82c012c4cdc0729fca

Observation 9af276e9-f419-4a2d-add7-9cfeb2f711c4 · outbound

This paper cites {gt}". And the false negative conclusion missed by AI research agent:.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights {gt}". And the false negative conclusion missed by AI research agent:

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.473651Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.473651Z digest=sha256:c264f6e60ad7ef206f29b16cfd351caada28683dda28c2165a482d42ecbd3982

Observation d12c8058-1e34-4aef-8588-fd9326be0319 · outbound

This paper cites an unresolved cited work.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights Unresolved cited work

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.475908Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.475908Z digest=sha256:79ec2843426bda884aa20b4f6e5e3bcde77afa7514e3f461edc82b136ba420b1

Observation 8152cf2a-c86d-4d62-8bf9-092ecde2c23b · outbound

This paper cites {gt}". And the false positive conclusion generated by an AI research agent:.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights {gt}". And the false positive conclusion generated by an AI research agent:

Reference 44

Resolution
malformed identifier
no resolver link, observed 2026-08-03T05:17:18.477910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.477910Z digest=sha256:57e287e49cf68d00f8f98cc2998088d49391277d989fa7b3cc160541c20341b8

Observation d5f29e90-b949-46ec-9c5c-79d65cf60fb8 · outbound

This paper cites ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.385882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.385882Z digest=sha256:983647867289d25181e61f3935c9944838734142cf59ce29a876126620ff2de9

Observation da817f0d-259e-41ab-a4eb-2561511ca1a3 · outbound

This paper cites ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models.

FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-03T05:17:18.379513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T05:17:18.379513Z digest=sha256:664050a8c9203b9e5367e45c36b015ec264df50c23356b9a01860e918eb7bae8

Pith citing papers

Observation 70392bc8-573d-456f-aaaf-417787b1c0ca · inbound

CellScientist: Dual-Space Hierarchical Orchestration for Closed-Loop Refinement of Virtual Cell Models cites this paper.

CellScientist: Dual-Space Hierarchical Orchestration for Closed-Loop Refinement of Virtual Cell Models FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-11T01:07:26.231896Z digest=sha256:9448b0cb96960cc0bc90283d13eabbb57b94c2abc2882e2f8e803be71c7392d8

Observation d4e56307-b23b-4f2c-92cb-1fe798064293 · inbound

MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AI cites this paper.

MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AI FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 105

Resolution
metadata mismatch
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-12T01:13:35.990078Z digest=sha256:e14e09ec93664d5d8ea998f48a443f46a270435ef8acb1ae3553cba6646e318e

Observation 05dda5d5-c53b-4cf4-933c-187747fa5d41 · inbound

MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AI cites this paper.

MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AI FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 107

Resolution
metadata mismatch
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-30T23:12:57.154537Z digest=sha256:a6380e92c3f6fe0e1b21b8ea5b242203f05aa82d95b8df5ba1e1ec2a9d61dad1

Observation 4d64b97b-8781-4b8d-acf9-52addbcdd093 · inbound

AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery cites this paper.

AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 96

Resolution
verified exact
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-25T04:46:43.679185Z digest=sha256:9cbd5d6df9941d607e86ad7d5ef7a2234ae17468a9a5cb3c5320137ff54753d8

Observation 5dae8655-6ba0-4ef9-a23c-faaff92950e3 · inbound

ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence cites this paper.

ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 30

Resolution
verified exact
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-29T21:19:03.281629Z digest=sha256:583d8bc946621e56db0dc564c1bca6b83f335c4bf2cccd0e5605dcd738f7dfbc

Observation 4cf207b5-5848-4295-b211-216a32274e48 · inbound

ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues cites this paper.

ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 28

Resolution
metadata mismatch
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-27T01:01:24.456670Z digest=sha256:ad678de0fc11969b89027f433251f0984f01c6d4ed143646897a1db4650b63c6

Observation 9c519e0a-6c3e-459c-aa60-a223f3be3432 · inbound

Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvements cites this paper.

Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvements FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-26T09:13:18.849983Z digest=sha256:caaad1e4804162142adf78610a50e7acc4d2c90b37499b7b88fb771b68502aa4

Observation 064b3e11-07ee-4cd4-8249-d90cf0837319 · inbound

NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? cites this paper.

NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 84

Resolution
metadata mismatch
arxiv_id, observed 2026-07-14T01:19:58.512370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-26T00:13:14.940915Z digest=sha256:0adcaeeeaf4fac1b84d88ac989c235327d339ec33a90897b5ff7b53b3a0b0f22

Observation 3d4f5eef-eed7-425f-823a-030ea1e3c421 · inbound

Towards Autonomous and Auditable Medical Imaging Model Development cites this paper.

Towards Autonomous and Auditable Medical Imaging Model Development FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 46

Resolution
unresolved
no resolver link, observed 2026-07-14T11:05:51.130839Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T11:05:51.130839Z digest=sha256:c6b05af58bed907cf1bd04b852844ad24c0d44c507b61b722b6e68b473c724a3

Observation 15f66bc1-57d8-4608-886c-8243edea3907 · inbound

FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Quality cites this paper.

FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Quality FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T06:42:08.783508Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T06:42:08.783508Z digest=sha256:ceeb118d99ca91ca823fa2df4fdc489096c7a703e15faa2365c8382dec0db09c

Observation e1c5551e-0e51-4b1a-be11-471aa150cbf1 · inbound

Before the Action: Benchmarking LLMs on Prospective Hypothesis Discovery cites this paper.

Before the Action: Benchmarking LLMs on Prospective Hypothesis Discovery FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-01T22:27:24.054724Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T22:27:24.054724Z digest=sha256:9f88d531c2387dd7a17c0e38990ee8e4f90876f3b4404bd2fdf3a80ecd36a7e3

Observation 25037601-cfe4-4099-b06a-ba3ebc732871 · inbound

ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D cites this paper.

ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-01T12:50:00.281600Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T12:50:00.281600Z digest=sha256:545745c69d7904171ad5b3ed54dfdfbc64d359efc69b277cbefb084377aeb23e

Observation d0398953-3ace-4068-b09a-45f52d3761a1 · inbound

ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchs cites this paper.

ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchs FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-15T23:22:10.051070Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:22:10.051070Z digest=sha256:7d63b035cdca074c8a9cef83c85f7e0beb1a237693437a2594278987781126f5