Pith. sign in

Paper Citation Record · LEDGER

On the Limits of LLM-as-Judge for Scientific Novelty Assessment

As of 13 August 2026, this Paper Citation Record lists 12 of 12 outbound references and 4 inbound Pith citation observations for arXiv:2606.12071.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.12071 v1

Coverage vector

measured 12 of 12 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-27T07:40:55.207538Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-12T11:27:14.679948Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-04T23:25:11.939066Z

Reference resolution

12 of 12 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved11
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 000faf5e-c0c3-4869-93a7-c756329f3419 · outbound

This paper cites we leave X to future work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment we leave X to future work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:60735a1952f52e2d6a2aecf46fad73c35f316b351da261dd277fc5e068c1d604

Observation 15174f60-2529-4827-a610-957105e7ddf4 · outbound

This paper cites creative.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment creative

Reference 3

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:8e46e9b1bdd4f54e8f865141eb21be75d96439bf4c32b6dfb5e837534e20d531

Observation da077c1a-f257-4630-bd63-8a37065fa19b · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:83667579eab0bd7057501aacae3c021885e5e2bd798cc4156db96d10314cf5d8

Observation 3f849b24-64aa-4e59-983c-1eb0ab012ebe · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:56f2470accc43f6852cbbacb6a32e0f6961a1ebf7bcf6a28eb42d6c767ca29f2

Observation 93082ecb-3895-45dd-82ff-4e466bd3082f · outbound

This paper cites scores": [ {.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment scores": [ {

Reference 6

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:ced01fb0aa9ee5001139d0acc62d616178d652e94a5e49ed9f8f5e0b1151ada0

Observation 5c610611-bc47-4738-9028-b3acb66aa098 · outbound

This paper cites This measures whether the research question depends on the specific background paper’s method, dataset, benchmark, component, result, behavior, or setting.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment This measures whether the research question depends on the specific background paper’s method, dataset, benchmark, component, result, behavior, or setting

Reference 7

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:0b9bbac62d2b4ab5f314bca722dd6da3a58d21c95bba2c3dd7fe57bc7f7566ad

Observation 3f198958-3a89-4d06-9f74-738ba334bd60 · outbound

This paper cites Which failure modes does GRPO show under long-chain reason- ing?.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Which failure modes does GRPO show under long-chain reason- ing?

Reference 8

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:afe60a07a3d07d0a4baa8655ffefa910034fd9be362cc78fafd3db1639e4d4eb

Observation 5519d7cd-40eb-4e2d-8a21-6aabe33b10d9 · outbound

This paper cites ?”. Sinhahajari et al. (2026). On the Limits of LLM-as-Judge for Scientific Novelty Assessment. 31 •Each question must be specific, not a generic question such as “how to improve X.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment ?”. Sinhahajari et al. (2026). On the Limits of LLM-as-Judge for Scientific Novelty Assessment. 31 •Each question must be specific, not a generic question such as “how to improve X

Reference 10

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:14c5413331a92acd267a0b2c5cc60103fc78651ab735dca0ef38c2fe1b07ca33

Observation 0bf26d3d-fc2f-4d35-bec3-269e70f8ea90 · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:aacb422fb6b922b8c728922cfc3afc3e08c4cb896a5625f8af33f3c42409be61

Observation 22179afb-779e-4d98-af08-acf8172e41a4 · outbound

This paper cites Q., Gong, C., and Pan, S.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Q., Gong, C., and Pan, S

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-07-03T13:38:19.491781Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:34a1602cd2a48660b5d4906c6fae024e6c1abe3ea905bb4aad6ea20a21444f4d

Observation 334d11eb-d806-4964-919d-2307082fe9cc · outbound

This paper cites an unresolved cited work.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:aac239c2ca32ca24425ec89b1fdf0c872d0b9763d36a07a369929f470febbf29

Observation 542c3534-6a2d-4f48-ba23-682b785da1b5 · outbound

This paper cites ?”. Output format The final visible answer must be a single JSON object conforming exactly to the following schema: {.

On the Limits of LLM-as-Judge for Scientific Novelty Assessment ?”. Output format The final visible answer must be a single JSON object conforming exactly to the following schema: {

Reference 14

Resolution
unresolved
no resolver link, observed 2026-06-27T07:40:55.207538Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-27T07:40:55.207538Z digest=sha256:564150d87dfd8ae12b0a193369a90211602aba520c66a3e631322af6b460436e

Pith citing papers

Observation 9ca89140-f60a-4f64-8d1d-4d347f1dfe03 · inbound

IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation cites this paper.

IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-01T05:02:07.347709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T05:02:07.347709Z digest=sha256:f3f8a474a190e15a70838e6f2743b4f0f135f0dad969b5eaceb337c2ab940a66

Observation a0b4ef6c-bc87-43a9-b333-fbe8fec22d15 · inbound

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation cites this paper.

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 68

Resolution
metadata mismatch
local_arxiv, observed 2026-08-04T23:25:11.942480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-04T23:25:10.774274Z digest=sha256:cfac0ab3422fdbcfd42c4ef208e115f083f89c746dff83e1ab8ba09c15e74479

Observation ba30a67f-a21b-48b5-a817-4bccd02bc301 · inbound

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation cites this paper.

Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 68

Resolution
unresolved
no resolver link, observed 2026-08-07T00:15:14.259145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T00:15:14.259145Z digest=sha256:47190de4ec641ab9fe73a3378ce81a33fa00377325cdb1e7897ab567c65e2c9c

Observation a744e5b3-94de-4f9c-abd5-b48e66509e8b · inbound

V-FiLLM: Verified Financial LLM Reasoning Benchmark cites this paper.

V-FiLLM: Verified Financial LLM Reasoning Benchmark On the Limits of LLM-as-Judge for Scientific Novelty Assessment

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-12T11:27:14.679948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-12T11:27:14.679948Z digest=sha256:67e0540ad05fef2cdc2d3f47200e4ae4c883595ce84e8282755b166aed57939f