Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T06:02:25.819108Z
Paper Citation Record · LEDGER
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization
As of 10 August 2026, this Paper Citation Record lists 40 of 40 outbound references and 0 inbound Pith citation observations for arXiv:2608.06301.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
40 of 40 outbound references displayed
- verified exact1
- verified fuzzy4
- unresolved34
- parse uncertain0
- malformed identifier1
- metadata mismatch0
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation 7c5f7cd5-2b14-40f1-a771-e60121272912 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 1
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.840406Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 84c6ef51-45d5-495f-9a85-66d6b116523e · outbound
This paper cites Program Synthesis with Large Language Models.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Program Synthesis with Large Language Models
Reference 2
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.621540Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6b862b9b-a108-44ff-b7c2-bfc126a7f381 · outbound
This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
Reference 3
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.626627Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5fecd972-8608-4139-bedb-a94f5cec91d0 · outbound
This paper cites HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry
Reference 5
- Resolution
- verified exact
- local_arxiv, observed 2026-08-07T06:02:26.542719Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 06ae2d74-049d-4f54-a113-92f478ceaf97 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 6
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.823414Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 7e24c6bc-e978-4394-a654-b4a3c2cfc91a · outbound
This paper cites Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMs.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMs
Reference 7
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.649833Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1ad6944b-e18e-41d3-b5e1-095ed755382e · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 8
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.655395Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4e70b33f-ef19-4b64-b8e2-73e9f5469edd · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 9
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.792632Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 95aa86d1-88d4-415c-97c5-7a24d9379dfd · outbound
This paper cites DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Reference 10
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.668797Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 72497daf-5131-42b4-be49-78a98649a566 · outbound
This paper cites ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
Reference 11
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.673512Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b114c3e1-3999-451f-90ca-dd70996b620e · outbound
This paper cites Meta-Harness: End-to-End Optimization of Model Harnesses.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Meta-Harness: End-to-End Optimization of Model Harnesses
Reference 12
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.678912Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 45050dee-36a5-4044-bb03-177129addcc5 · outbound
This paper cites Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
Reference 13
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.684162Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 59ab5bed-bff7-4a79-bee9-45284fe28a2e · outbound
This paper cites RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement
Reference 14
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.689165Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7a5ea708-3a4e-48e5-a781-7d8f087d9d65 · outbound
This paper cites Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
Reference 15
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.694406Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 832e847c-45be-4983-ae0d-e267fdca825c · outbound
This paper cites GAIA: a benchmark for General AI Assistants.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization GAIA: a benchmark for General AI Assistants
Reference 16
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.699110Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ac423a22-3cfe-41b3-918c-a10db151494c · outbound
This paper cites AlphaEvolve: A coding agent for scientific and algorithmic discovery.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization AlphaEvolve: A coding agent for scientific and algorithmic discovery
Reference 17
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.704618Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6d6365fd-311e-4770-9698-675129b7400d · outbound
This paper cites Opsahl-Ong, A.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Opsahl-Ong, A
Reference 18
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.710081Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ad972446-d52d-4349-a01d-73c312377a8b · outbound
This paper cites Ouyang, S.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Ouyang, S
Reference 19
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-07T06:02:26.773465Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 6a3d847d-bc83-419c-ba9a-46bfdafc02e9 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 20
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.718442Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f8c1677d-df60-4c64-b1d0-0381581b932d · outbound
This paper cites Romera-Paredes, M.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Romera-Paredes, M
Reference 22
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.731989Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 72fcfa4e-52d1-4680-a932-1113a7b1aafa · outbound
This paper cites Ursekar, A.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Ursekar, A
Reference 23
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-07T06:02:26.755690Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 8c554198-4a8f-4996-add4-14b687b00309 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 24
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.737554Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 6b69b85f-28e1-4de3-95f4-1ebd8cd4499e · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 25
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.745383Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5957b07f-23e7-492c-bfc7-8ae6bb7b80b7 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 26
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.716924Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 5cadbf08-4f74-4106-b420-6f947be9a055 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 27
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.692576Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation c3ee986a-611a-463a-941e-2e856cb77cad · outbound
This paper cites RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
Reference 28
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.759327Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation db2fe2c1-8763-4894-8e1e-9ca36870d67f · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 29
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T06:02:26.671001Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation f0aa53e8-970e-4a68-b894-3261e7658649 · outbound
This paper cites Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows
Reference 30
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.768245Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 07ccd406-2445-4169-8b89-6f761f2e1fb8 · outbound
This paper cites an unresolved cited work.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Unresolved cited work
Reference 31
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.772900Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5853d2ef-5886-4c79-908a-c3d9a07ba557 · outbound
This paper cites G\"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization G\"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement
Reference 33
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.787406Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fd38340b-54e5-4194-bb30-b1108b5bc95d · outbound
This paper cites TextGrad: Automatic "Differentiation" via Text.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization TextGrad: Automatic "Differentiation" via Text
Reference 34
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.793445Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8b7b2ce4-092c-41fe-8d39-6e49194a1169 · outbound
This paper cites Zelikman, E.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Zelikman, E
Reference 35
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-07T06:02:26.647834Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation fc3bd319-50f2-4c22-b079-517dfd5d96b7 · outbound
This paper cites LLM-AutoDiff: Auto-Differentiate Any LLM Workflow.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization LLM-AutoDiff: Auto-Differentiate Any LLM Workflow
Reference 36
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.783053Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e86ce37a-0105-4da9-9a23-55caca814dba · outbound
This paper cites Zhang, J.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Zhang, J
Reference 37
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-07T06:02:26.629708Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.
Observation 0382457f-3707-41e7-b59a-3175ac6c7b7c · outbound
This paper cites Stop Comparing LLM Agents Without Disclosing the Harness.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Stop Comparing LLM Agents Without Disclosing the Harness
Reference 38
- Resolution
- malformed identifier
- no resolver link, observed 2026-08-07T06:02:25.819108Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 73f9813b-71b4-42ab-adfc-fa76a52057a8 · outbound
This paper cites Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Reference 40
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.804071Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9aa97db2-102f-483b-9dd4-c900c79cfe0e · outbound
This paper cites AFlow: Automating Agentic Workflow Generation.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization AFlow: Automating Agentic Workflow Generation
Reference 42
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.813777Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f1e92752-39a5-4a6e-98a4-f093a899e2ea · outbound
This paper cites Evaluating Large Language Models Trained on Code.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization Evaluating Large Language Models Trained on Code
Reference 2021
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.635628Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 234b9e0a-50f4-453b-8d80-4979d8b30ea7 · outbound
This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Reference 2024
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.664469Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5ae73031-9670-42b4-b8d3-9d6859d5658e · outbound
This paper cites A Self-Improving Coding Agent.
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization A Self-Improving Coding Agent
Reference 2025
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T06:02:25.727335Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Pith citing papers
No inbound Pith citation observations are available.