Pith. sign in

Paper Citation Record · LEDGER

On the Limits of LLM-as-Judge for Scientific Novelty Assessment

As of 18 August 2026, this Paper Citation Record lists 12 of 12 outbound references and 4 inbound Pith citation observations for arXiv:2606.12071.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.12071 v1

Coverage vector

measured 12 of 12 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-27T07:40:55.207538Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-12T11:27:14.679948Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-04T23:25:11.939066Z

Reference resolution

12 of 12 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved11
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 000faf5e-c0c3-4869-93a7-c756329f3419 · outbound

This paper cites we leave X to future work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment we leave X to future work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:60735a1952f52e2d6a2aecf46fad73c35f316b351da261dd277fc5e068c1d604

Observation 15174f60-2529-4827-a610-957105e7ddf4 · outbound

This paper cites creative.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment creative

Reference 3

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:8e46e9b1bdd4f54e8f865141eb21be75d96439bf4c32b6dfb5e837534e20d531

Observation da077c1a-f257-4630-bd63-8a37065fa19b · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:83667579eab0bd7057501aacae3c021885e5e2bd798cc4156db96d10314cf5d8

Observation 3f849b24-64aa-4e59-983c-1eb0ab012ebe · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:56f2470accc43f6852cbbacb6a32e0f6961a1ebf7bcf6a28eb42d6c767ca29f2

Observation 93082ecb-3895-45dd-82ff-4e466bd3082f · outbound

This paper cites scores": [ {.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment scores": [ {

Reference 6

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:ced01fb0aa9ee5001139d0acc62d616178d652e94a5e49ed9f8f5e0b1151ada0

Observation 5c610611-bc47-4738-9028-b3acb66aa098 · outbound

This paper cites This measures whether the research question depends on the specific background paper’s method, dataset, benchmark, component, result, behavior, or setting.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment This measures whether the research question depends on the specific background paper’s method, dataset, benchmark, component, result, behavior, or setting

Reference 7

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:0b9bbac62d2b4ab5f314bca722dd6da3a58d21c95bba2c3dd7fe57bc7f7566ad

Observation 3f198958-3a89-4d06-9f74-738ba334bd60 · outbound

This paper cites Which failure modes does GRPO show under long-chain reason- ing?.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Which failure modes does GRPO show under long-chain reason- ing?

Reference 8

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:afe60a07a3d07d0a4baa8655ffefa910034fd9be362cc78fafd3db1639e4d4eb

Observation 5519d7cd-40eb-4e2d-8a21-6aabe33b10d9 · outbound

This paper cites ?”. Sinhahajari et al. (2026). On the Limits of LLM-as-Judge for Scientific Novelty Assessment. 31 •Each question must be specific, not a generic question such as “how to improve X.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment ?”. Sinhahajari et al. (2026). On the Limits of LLM-as-Judge for Scientific Novelty Assessment. 31 •Each question must be specific, not a generic question such as “how to improve X

Reference 10

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:14c5413331a92acd267a0b2c5cc60103fc78651ab735dca0ef38c2fe1b07ca33

Observation 0bf26d3d-fc2f-4d35-bec3-269e70f8ea90 · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:aacb422fb6b922b8c728922cfc3afc3e08c4cb896a5625f8af33f3c42409be61

Observation 22179afb-779e-4d98-af08-acf8172e41a4 · outbound

This paper cites Q., Gong, C., and Pan, S.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Q., Gong, C., and Pan, S

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-07-03T13:38:19.491781Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:7337af759d22472ed77df0c02841af7edf3327c116d7a2374987ef5f1abf7205

Observation 334d11eb-d806-4964-919d-2307082fe9cc · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:aac239c2ca32ca24425ec89b1fdf0c872d0b9763d36a07a369929f470febbf29

Observation 542c3534-6a2d-4f48-ba23-682b785da1b5 · outbound

This paper cites ?”. Output format The final visible answer must be a single JSON object conforming exactly to the following schema: {.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment ?”. Output format The final visible answer must be a single JSON object conforming exactly to the following schema: {

Reference 14

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:564150d87dfd8ae12b0a193369a90211602aba520c66a3e631322af6b460436e

Pith citing papers

Observation 9ca89140-f60a-4f64-8d1d-4d347f1dfe03 · inbound

IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation cites this paper.

IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-01T05:02:07.347709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T05:02:07.347709Z digest=sha256:8b17e22578bdefd0aa8ce18bca0bfee233560ba482c54deb388ccf9461a0b770

Observation a0b4ef6c-bc87-43a9-b333-fbe8fec22d15 · inbound

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation cites this paper.

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 68

Resolution
metadata mismatch
local_arxiv, observed 2026-08-04T23:25:11.942480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-04T23:25:10.774274Z digest=sha256:25a1458903d710d49ecb27296dbc1cf4a0b7e32249f2946204d61ac95732fb33

Observation ba30a67f-a21b-48b5-a817-4bccd02bc301 · inbound

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation cites this paper.

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 68

Resolution
unresolved
no resolver link, observed 2026-08-07T00:15:14.259145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:15:14.259145Z digest=sha256:67784caa22db1db4ed285e39a545821df95bcaf26b8d5227b61cdef8110c8e70

Observation a744e5b3-94de-4f9c-abd5-b48e66509e8b · inbound

V-FiLLM: Verified Financial LLM Reasoning Benchmark cites this paper.

V-FiLLM: Verified Financial LLM Reasoning Benchmark On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-12T11:27:14.679948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-12T11:27:14.679948Z digest=sha256:c65a6ffb29fb1976e027928ae957d5409b4786f23dc85a1cfdcaba809a849739