Paper Citation Record · LEDGER

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment

As of 6 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 1 inbound Pith citation observation for arXiv:2604.11543.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.11543 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-10T16:20:44.551760Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-11T19:11:37.739920Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

verified exact4
verified fuzzy4
unresolved11
parse uncertain0
malformed identifier0
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation eafd7f3e-a649-47d6-a7bb-8b9ae0975af5 · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 1

Resolution: verified exact; local_arxiv, observed 2026-05-11T09:00:59.495696Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 549321d4-00f7-49dd-8656-19a035c7dd3d · outbound

This paper cites Reviewer2: Optimizing Review Generation Through Prompt Generation.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Reviewer2: Optimizing Review Generation Through Prompt Generation

Reference 2

Resolution: verified exact; arxiv_id, observed 2026-05-11T09:00:59.510291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation b167f2c2-79f3-4de0-998d-0323b8fbeb2e · outbound

This paper cites Qwen3 Technical Report.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Qwen3 Technical Report

Reference 3

Resolution: metadata mismatch; local_arxiv, observed 2026-05-11T09:00:59.506448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 63383334-3769-4905-a759-e0ccc87bb527 · outbound

This paper cites In this paper, we propose a novel transformer-based architecture that integrates syntactic information into language modeling.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment In this paper, we propose a novel transformer-based architecture that integrates syntactic information into language modeling

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-05-17T15:51:55.690274Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 0eb517ab-6a4a-46ce-8f8f-0580acba526a · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.698838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 72de0aff-8759-4edd-aa05-23afe4915516 · outbound

This paper cites new” or “novel.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment new” or “novel

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-05-17T15:51:55.687412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 94dd6201-2778-4c0a-8a30-9a7329312a30 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.701173Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c725fa04-ab54-463d-a369-97f581cb76c2 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.703886Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 56785e2a-4cf8-4a0d-a3f1-45a313b764a2 · outbound

This paper cites Model Rel.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Model Rel

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-05-11T09:00:59.517496Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation f0a9b020-82c1-478f-bf94-b814151b25fc · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.691927Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 994c9fba-8ee9-488f-98f0-8a0daf603174 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 11

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.710497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ee18ed52-e0c6-4146-8f77-0da3becbcf71 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.706728Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation e02ed532-d340-49e3-b8a2-c4f170d9db5d · outbound

This paper cites Positive.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Positive

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-05-17T15:51:55.701873Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5bebbff7-f2a0-4837-b2bc-1bb4089855bc · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.677264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 3198bb5c-e29e-4549-97b8-a4ca65fb4bb7 · outbound

This paper cites Positive.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Positive

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-05-17T15:51:55.679943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation abca0b71-f0a7-4ed0-a5bd-923c80450c65 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.674403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 3e3f5e1a-e356-4cf4-8db7-6890c4dc7233 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.671690Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 55b7180e-8425-41f7-9858-936e1378c8f3 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.682544Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ef92de0c-610f-46fe-b46f-03f60cfbc9f7 · outbound

This paper cites an unresolved cited work.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-05-17T15:51:55.685126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ec5b6199-75b3-4877-b1da-c98080b75e3d · outbound

This paper cites Discriminative Reasoning for Document-level Relation Extraction.

NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Discriminative Reasoning for Document-level Relation Extraction

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-05-11T09:00:59.514014Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Pith citing papers

Observation 2c66d0b1-a6ba-411f-9315-b777d9679cfd · inbound

ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes cites this paper.

ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment

Reference 56

Resolution: unresolved; no resolver link, observed 2026-07-11T19:11:37.739920Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.