Pith. sign in

Paper Citation Record · LEDGER

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers

As of 10 August 2026, this Paper Citation Record lists 68 of 68 outbound references and 0 inbound Pith citation observations for arXiv:2607.18360.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.18360 v1

Coverage vector

measured 68 of 68 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-01T16:39:25.621238Z

measured 68 of 68 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

68 of 68 outbound references displayed

  • verified exact2
  • verified fuzzy0
  • unresolved62
  • parse uncertain0
  • malformed identifier4
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a4ca199a-35b5-445a-9228-43be0f18298b · outbound

This paper cites CheckIfExist: Detecting citation hallucinations in the era of AI-generated content.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers CheckIfExist: Detecting citation hallucinations in the era of AI-generated content

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:16.453565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:16.453565Z digest=sha256:5b72ca2a324c22a277d40099be0e5b450d3711268f24f4cfcc0f7a752e00f7fc

Observation 96d2ddb9-cecd-4b89-8def-f0fa1def2ff3 · outbound

This paper cites Do language models know when they’re hallucinating references? InEACL, pages 912–928.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Do language models know when they’re hallucinating references? InEACL, pages 912–928

Reference 2

Resolution
verified exact
doi, observed 2026-08-01T16:43:36.794085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-01T16:39:16.574651Z digest=sha256:4cba240bf03b7333abf386700260b945549b818aeaef9eb66c69dba3d7f156f4

Observation 2dfbd8cb-e09f-4a41-866f-1b7525a698a1 · outbound

This paper cites McFarlane.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers McFarlane

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:16.693554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:16.693554Z digest=sha256:f8cf143e28e206b09c2552a4b0e268bb52a37592a78ff99149c144cfa6569b80

Observation 8dd1c074-02b7-495e-9f2e-1f92f2d82cc1 · outbound

This paper cites Compound deception in elite peer review: A failure mode taxonomy of 100 fabricated citations at NeurIPS 2025.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Compound deception in elite peer review: A failure mode taxonomy of 100 fabricated citations at NeurIPS 2025

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:16.813869Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:16.813869Z digest=sha256:18fe799303b34d65ba3aef3f9b72d04af706fa8d2cd2b4904888f2eaa257b955

Observation e86f0cd8-8be4-4d66-a8bb-f53cf63c718c · outbound

This paper cites The Case of the Mysterious Citations.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers The Case of the Mysterious Citations

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:16.931878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:16.931878Z digest=sha256:7242dd207a3d07a1c473a3cdcc36acf375a85fc00f87018502b61ccaec29a431

Observation ff5a0105-ce04-49ed-8060-a122c1a4b916 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Evaluating Large Language Models Trained on Code

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.044720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.044720Z digest=sha256:6e82347610801feb1195c290a5bcd0918b96f7b851bd51d99829c50978850b36

Observation ea5825fe-ce2e-4609-9dc5-0793dd77700d · outbound

This paper cites dblp computer science bibliography — monthly snapshot XML release of october 2025, 2025.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers dblp computer science bibliography — monthly snapshot XML release of october 2025, 2025

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.162955Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.162955Z digest=sha256:cbc2bacdf8ca318a0b02c4fdf540c74ab991252687b6eb023f73a7287b389f72

Observation 2123adec-a691-4cba-a95e-c6efec3bbe01 · outbound

This paper cites DeepSeek-V3 Technical Report.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers DeepSeek-V3 Technical Report

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.274599Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.274599Z digest=sha256:5fedfc8b1472b9b4928dda00c66ef9ab36ccffb4fa531ffde475a1242919907d

Observation 66682b2e-3ba2-4f9c-bb92-3b97aa18833a · outbound

This paper cites The reusable holdout: Preserving validity in adaptive data analysis.Science, 349(6248):636–638,.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers The reusable holdout: Preserving validity in adaptive data analysis.Science, 349(6248):636–638,

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.364274Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.364274Z digest=sha256:cf298042376faa4b2528a582d8cd9535363b3d4d851cc44c2cb00e663fa5346f

Observation 2ad82efd-51df-4a5b-a3ff-2fe674d191f2 · outbound

This paper cites Tibshirani.An Introduction to the Bootstrap.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Tibshirani.An Introduction to the Bootstrap

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.665889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.665889Z digest=sha256:62534a1658107eeda60eaf671df5e7d69c509813118a19a0ae3fbdf282c74d7e

Observation dd183d00-9ddf-4196-9928-4b4239fcebfe · outbound

This paper cites On the foundations of noise-free selective classification.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers On the foundations of noise-free selective classification

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.778550Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.778550Z digest=sha256:803f14d533a706079681bfde62047d52344a008a214c5ef1d51c091074fd6cd9

Observation b7b5819d-e88b-4e27-9fee-b42ef2b2d2cf · outbound

This paper cites Hal- luHard: A hard multi-turn hallucination benchmark.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Hal- luHard: A hard multi-turn hallucination benchmark

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.949817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.949817Z digest=sha256:6412c89f1fb8364f6b556463cb4a9981fe5aa0243534777eb1beb20723fcdc8d

Observation b096e203-0691-4411-9686-f33dab1e3fe1 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.108326Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.108326Z digest=sha256:1ccf752ad0f7c79c0f83490b008ae532569554c142f8ef2934920ae2ae8c2030

Observation 3524e218-ebe0-4232-a97b-d51b0743da4c · outbound

This paper cites RARR: Researching and revising what language models say, using language models.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers RARR: Researching and revising what language models say, using language models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.253804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.253804Z digest=sha256:26dc3452bf37a0e9d89781daeab8b8f52e20430a175d992803303005737df9c0

Observation 2b2ee0c9-e67b-4550-8132-1c08f3c18240 · outbound

This paper cites Datasheets for datasets.Communications of the ACM, 64(12):86–92, 2021.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Datasheets for datasets.Communications of the ACM, 64(12):86–92, 2021

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.394303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.394303Z digest=sha256:d09e531d58701d1e3032df6738b829d182db5729fb19237a3dfbb996892efa8c

Observation 71a31ff5-1b91-45ec-b9b1-892f4baea620 · outbound

This paper cites Selective classification for deep neural net- works.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Selective classification for deep neural net- works

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.494520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.494520Z digest=sha256:374cf654747f2f2b5bf6f438b53ea15557c175bbae17096e8268fc62e53ee7cf

Observation dc0b3423-7f7d-4c7e-85f5-8807ac122fe3 · outbound

This paper cites Onebench to test them all: Sample-level benchmarking over open-ended capabilities.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Onebench to test them all: Sample-level benchmarking over open-ended capabilities

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.651771Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.651771Z digest=sha256:f9298dee6ff37515b8d3465bf917792ceed7a8e79f92b0e70ba537d79e2ebde5

Observation 70945020-a574-4864-92f3-bcf1426ad4c6 · outbound

This paper cites Gemini 2.5: Our most intelligent AI model, 2025.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Gemini 2.5: Our most intelligent AI model, 2025

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.808194Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.808194Z digest=sha256:3664df3c9d2bab484e8130946f7ba9ab68c8f7968a1a7f89c9e2bc2ea2766ea7

Observation f067d904-65fd-4d9a-9d6a-bd97a03ef306 · outbound

This paper cites HaRC: Hallucinated reference checker, 2024.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers HaRC: Hallucinated reference checker, 2024

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:18.950200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:18.950200Z digest=sha256:20538d0834d6005129b5c44ead334f6c321b60625da40cc8cc8d37a74cec1a4d

Observation 1ab82b12-0906-419e-affe-7d04cfba1bb0 · outbound

This paper cites Princeton University Press, 2026.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Princeton University Press, 2026

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:19.091134Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:19.091134Z digest=sha256:cc8a28a51f44510cedc22811297f0f06076e7785ec95d7272dab186d66ab7c60

Observation 3c152b01-94f6-498a-973b-02d6d08f55b9 · outbound

This paper cites The dataset nutrition label.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers The dataset nutrition label

Reference 21

Resolution
verified exact
doi, observed 2026-08-01T16:43:36.747160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-01T16:39:19.243712Z digest=sha256:dac10abd39f4c3359bc90d729e521bc60b380cbe83165b6adf7f0e61cc6e2703

Observation 9642dfb7-90db-49aa-a2a2-6bf3952ca3f7 · outbound

This paper cites RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:19.388179Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:19.388179Z digest=sha256:70a22b2da6cebe55cd4c759ff147ccaee1a2043f9f2f1a7cfe4e201612fa2aae

Observation 6ca848a1-98aa-42e8-bce3-73d759cdbac8 · outbound

This paper cites A survey on hallu- cination in large language models: Principles, taxonomy, challenges, and open questions.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers A survey on hallu- cination in large language models: Principles, taxonomy, challenges, and open questions

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:19.570105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:19.570105Z digest=sha256:464d59ccc45a6b0f971a8c7b3b684a4590cb893ef8932315124124d181d2a13c

Observation 7c620f76-405b-42ee-9596-39df52256aeb · outbound

This paper cites Livecodebench: Holistic and con- tamination free evaluation of large language models for code.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Livecodebench: Holistic and con- tamination free evaluation of large language models for code

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:19.747061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:19.747061Z digest=sha256:2ae180fa4e4ce210dd7aa1804d4cc2e763a0a113761340df3cd6ac43f18c1a29

Observation 2bd039a4-6cec-48bc-8823-0cafd2f0a256 · outbound

This paper cites Survey of hallucination in natural language generation.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Survey of hallucination in natural language generation

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:19.897043Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:19.897043Z digest=sha256:f94a57160ae03b3192f0899ab50c3fe466a78d869496f85c5dd54a7010a4cce7

Observation 17a1f6d6-1466-488e-abfe-9944528c8355 · outbound

This paper cites Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:20.096515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:20.096515Z digest=sha256:7dab8962d0d81b0af6f00da3586f788145aa223a514042551731a298ef33b43a

Observation 5e155767-1956-4d7d-a858-827ddd4cbb4d · outbound

This paper cites Dynabench: Rethinking benchmarking in NLP.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Dynabench: Rethinking benchmarking in NLP

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:20.246515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:20.246515Z digest=sha256:d4ffae89d3732517d8ab7969da89d86cc3dbfe20bdbe234ef28cdb2722150a16

Observation 2c83f8ab-d2d7-47a3-8ef2-4e2f9c7fedb9 · outbound

This paper cites Richard Landis and Gary G.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Richard Landis and Gary G

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:20.514873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:20.514873Z digest=sha256:08c4fee1a34ed4e7eb14cb1d3302bcd537662f927d2abc2b55dbc43cd84e41ae

Observation b8295c6e-dda6-4d1b-8370-689f3da440f8 · outbound

This paper cites Halueval: A large- scale hallucination evaluation benchmark for large language models.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Halueval: A large- scale hallucination evaluation benchmark for large language models

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:20.690296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:20.690296Z digest=sha256:4f0156d57f5ae7477416e9df555c5e2f656bba60b6f1f205692cf4f7db85fb94

Observation 92d000b4-f9df-413f-ab5e-97fb51ab130d · outbound

This paper cites FActScore: Fine-grained atomic evaluation of factual precision in long form text generation.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers FActScore: Fine-grained atomic evaluation of factual precision in long form text generation

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:20.859214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:20.859214Z digest=sha256:3d519a17010a30ca5aa3b236f8984089e7dcc2e9abc05d3cd23b4d5f6eefa15a

Observation fc61f4a0-5c91-439d-9fde-2b9b35a0a9f5 · outbound

This paper cites Large enough: Mistral Large 2, 2024.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Large enough: Mistral Large 2, 2024

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:21.199905Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:21.199905Z digest=sha256:459a3f3f404c58cd59bfa596cf4d8701b148bc210252c495557a5735d9f9ccc5

Observation abdd7d02-07aa-45e9-9bd9-c3f2631c208f · outbound

This paper cites Cooper, and Milos Hauskrecht.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Cooper, and Milos Hauskrecht

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:21.348034Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:21.348034Z digest=sha256:e5d79837d3a38d735ed329708f75d1c0f3b85c6b26d84eccbf3c53e0de17db12

Observation 32535d8d-660c-48ad-951f-0361f897cb38 · outbound

This paper cites GPT-5.1 Instant and GPT-5.1 Thinking system card addendum, 2025.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers GPT-5.1 Instant and GPT-5.1 Thinking system card addendum, 2025

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:21.526541Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:21.526541Z digest=sha256:e8e9a66ae9152d6fac5ca2960ed19e9e4ca322e59088d078e8f6a988cbbf7033

Observation b838bf6c-0a73-4b4b-9083-c96a25b9f64b · outbound

This paper cites PostTrainBench: Can LLM agents automate LLM post-training? arXiv preprint arXiv:2603.08640, 2026.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers PostTrainBench: Can LLM agents automate LLM post-training? arXiv preprint arXiv:2603.08640, 2026

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:21.708297Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:21.708297Z digest=sha256:8e7368726134a380afebcca21dc9e121faba9772873cd41547d69abb2d068fca

Observation cff62856-6d20-4dc6-abdb-cf3db7ef8f25 · outbound

This paper cites BibTeX Citation Hallucinations in Scientific Publishing Agents: Evaluation and Mitigation.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers BibTeX Citation Hallucinations in Scientific Publishing Agents: Evaluation and Mitigation

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:21.860728Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:21.860728Z digest=sha256:22a2da9b11312c8170c81d045b89cbf82694adad04f3240ce981b543feea8545

Observation a5ec6246-c625-4c0d-9856-dc9b2e55c6df · outbound

This paper cites Detecting and Correcting Reference Hallucinations in Commercial LLMs and Deep Research Agents.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Detecting and Correcting Reference Hallucinations in Commercial LLMs and Deep Research Agents

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.014524Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.014524Z digest=sha256:100520f52c5eb52ac10416d13865e5a438efecb7a85b13efa00320403af829be

Observation 6d8700cc-bddd-46fa-a394-44f524dd85d6 · outbound

This paper cites HALoGEN: Fantastic LLM Hallucinations and Where to Find Them.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers HALoGEN: Fantastic LLM Hallucinations and Where to Find Them

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.192400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.192400Z digest=sha256:05ffad3c0451c912e0214593209e29892db9e406eb71c3af499cd5e08c60f824

Observation f1487ba8-e4e6-4833-9bf4-0f41870a5e8d · outbound

This paper cites bibtex-updater: Automated BibTeX verification and updating, 2025.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers bibtex-updater: Automated BibTeX verification and updating, 2025

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.300782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.300782Z digest=sha256:979d0e76eb8eea0c29041ae35dad8bc085221968f1ccc6bf4fa881ab990e8626

Observation 5484748b-e88a-4206-9a23-2ba2161d59ce · outbound

This paper cites HalluCitation matters: Revealing the impact of hallucinated references with 300 hallucinated papers in ACL conferences.arXiv preprint arXiv:2601.18724, 2026.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers HalluCitation matters: Revealing the impact of hallucinated references with 300 hallucinated papers in ACL conferences.arXiv preprint arXiv:2601.18724, 2026

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.463174Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.463174Z digest=sha256:8d77d46f5499e4c6f7c658d1dff4d2a21dae7805cdec15aebe7ef1570cd2ae68

Observation 0cb8b240-4c18-4d12-98cb-5cb5564f03b4 · outbound

This paper cites HalluCiteChecker: A Lightweight Toolkit for Hallucinated Citation Detection and Verification in the Era of AI Scientists.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers HalluCiteChecker: A Lightweight Toolkit for Hallucinated Citation Detection and Verification in the Era of AI Scientists

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.592424Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.592424Z digest=sha256:a521a841a4dc09829756a38fb16ce1ebed7160160ed791f83b169803ebebd09a

Observation 66ae7da8-e65f-45c7-ba1d-e332579e1401 · outbound

This paper cites CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Era.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Era

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.701394Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.701394Z digest=sha256:600f649bd256b3174ad9845712a140ae6a6754f9438a1b76b961c8ba25cd61e0

Observation 9c23b35e-8ac0-4fee-af0a-db5d0b2df2ad · outbound

This paper cites GPTZero finds 100 new hallucinations in NeurIPS 2025 accepted papers, 2026.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers GPTZero finds 100 new hallucinations in NeurIPS 2025 accepted papers, 2026

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.799052Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.799052Z digest=sha256:77185701f7726f61b648eae1187c22a42475a6f9f47fabcb477bbb29ebfd23b7

Observation 65ead706-5244-4057-9d8a-fff47c02a091 · outbound

This paper cites verify-citations: Automated citation verification tool, 2025.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers verify-citations: Automated citation verification tool, 2025

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.895626Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.895626Z digest=sha256:2291107dc33ee23b86bdad6eaf2ec291174b1ef781fd4215a1916e79fba64c21

Observation 5de7cac0-ed8f-4214-b463-c8908b80b388 · outbound

This paper cites Fact or fiction: Verifying scientific claims.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Fact or fiction: Verifying scientific claims

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:22.994947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:22.994947Z digest=sha256:3c3ac87094725053dd6518a15a99604a0f50c180eb30c6e7b45a1d18bb016a48

Observation 767298bd-41bc-4862-9a8f-09239b5c3fba · outbound

This paper cites Walters and Esther Isabelle Wilder.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Walters and Esther Isabelle Wilder

Reference 45

Resolution
malformed identifier
no resolver link, observed 2026-08-01T16:39:23.071292Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.071292Z digest=sha256:e3d1612a8196d18911e99ab8e700bc81a6b3240710a67a664085ec872acce653

Observation 0ef84b25-9f5f-481b-9fef-7b33508db6a8 · outbound

This paper cites GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language Models.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language Models

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:23.183295Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.183295Z digest=sha256:f586c5755b03ca83eeca4bc0b3083529880ad27c1e34522be75fe5ae44a2fc6a

Observation d0ef3467-0203-47ea-b723-49c055535845 · outbound

This paper cites Qwen3 Technical Report.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Qwen3 Technical Report

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:23.283637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.283637Z digest=sha256:3efd9f48609667c5f9a4e86f9667faa569cf303a360b3e49a93e822625242b13

Observation a8e6dc35-89b0-49d7-91ee-22c9aaad9b62 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 52

Resolution
malformed identifier
no resolver link, observed 2026-08-01T16:39:23.596255Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.596255Z digest=sha256:34d6341ebea75e85b25a18d5acaaf0264d89bebfc44cd17a92eb8184a762d88e

Observation 8d50e4d3-cd22-4ac8-a85d-7647a2f97bf6 · outbound

This paper cites John Doe,.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers John Doe,

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:23.712217Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.712217Z digest=sha256:9c127efb98950d3f64688730ac06cd340343bc53c8d2c4796b2365a4925d8aeb

Observation 7d0987ee-7a9f-4f31-82f3-8867613b71eb · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:23.808252Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.808252Z digest=sha256:a26dcbaa3e50ffb2a048737402da61b4059594da30605af846c608b213a39f62

Observation c218e179-6be2-46c1-8efb-59754a47e1cf · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:23.937709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.937709Z digest=sha256:4118b164e83bd292296764e3c19892ef60a80bc7551bfe441af2eb4e3f15f9ad

Observation 330eebd8-0370-444b-aca6-1a80f4d06a81 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.071051Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.071051Z digest=sha256:ca08e3e1fdde4217fb9935325ec9fb08df36738e43914c0aea241e2e24a60957

Observation e7451a5b-88ba-4c81-bbc7-791b9cecd6c5 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.178436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.178436Z digest=sha256:073a80dff411a09884c90192bdd858f85888b07f4b870b70567bdcc1d05126c9

Observation a3d4c049-f639-4a78-b193-d1c001c74476 · outbound

This paper cites Author1.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Author1

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.308514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.308514Z digest=sha256:bb347126d24aba16da3d9177d57221033c86fb91f5384d6fa6c3d3a4a9f08f5a

Observation 4a25cc41-bb69-4d8e-8f14-3a07155c37ea · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.390424Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.390424Z digest=sha256:bd876756367dc77916916ae706d257455ea96833eb71c017f20237a3d9b75719

Observation 9a5937f5-b73b-463d-a2ba-681d4044c952 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.531711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.531711Z digest=sha256:8cc2d5ab0dd8ba405b1390812e97af2ec656b9a5d3c5c5575ae5f6bb19f59831

Observation 48908ce6-30c7-4334-a866-e2d87b45a7ba · outbound

This paper cites label ":.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers label ":

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.663016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.663016Z digest=sha256:01481c9a630ba59d1b8160e381528d5d3fe47e69a7e110c416fd79e9862fa1d7

Observation 5af17e95-340c-4540-acce-9ba700d057a5 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.816976Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.816976Z digest=sha256:2070e99c1c23cf44767a6469e6e57d63c9e08f136b7fa9b40542de2795295e3e

Observation 01ed2fe6-1a6b-4821-9ef3-974231715258 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:24.938740Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:24.938740Z digest=sha256:8087579980a245ec4360f5edeec430573aa03585148951c77db620ebf89ee9ed

Observation a2139506-46d7-4340-b5af-eacc8d2048c4 · outbound

This paper cites an unresolved cited work.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Unresolved cited work

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:25.055132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:25.055132Z digest=sha256:09438247dbb016fc64e574341f3dd585309e756b9faade39ee512d91cd796dfa

Observation ba5bb76d-efdc-46f3-acba-bda8e7046396 · outbound

This paper cites label ":.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers label ":

Reference 65

Resolution
malformed identifier
no resolver link, observed 2026-08-01T16:39:25.245695Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:25.245695Z digest=sha256:86021dbeb02ede9bd9f526fd96c41a954e4be1f70538c017d470d35add31740d

Observation 9a6184dd-4bbd-44c4-82bb-3a0466801df0 · outbound

This paper cites This rules out approaches requiring human-in-the-loop validation or expensive API calls to language models.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers This rules out approaches requiring human-in-the-loop validation or expensive API calls to language models

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:25.337771Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:25.337771Z digest=sha256:0854f92e7b42a02e9c714285cebdca4ceddd63d8831bd876fc3e44df6ba2ae44

Observation e8fcdfda-cdd4-4785-80e5-4ce1a9bcb691 · outbound

This paper cites A tool that requires a separate platform or manual invocation will not be adopted.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers A tool that requires a separate platform or manual invocation will not be adopted

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:25.504948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:25.504948Z digest=sha256:e23744375f8cdd5c52f900a936d5c8839a0be177911ddb1bae6f9784dfcdc0ac

Observation 6aae4041-836c-45de-9fff-93712de0ef54 · outbound

This paper cites Co-designed (reference upper bound).

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers Co-designed (reference upper bound)

Reference 68

Resolution
malformed identifier
no resolver link, observed 2026-08-01T16:39:25.621238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:25.621238Z digest=sha256:3267ac312aa2be2247acf0596d30b606b3001ae18cd279dd2769475f3dee2b47

Observation acaeb136-4906-4391-a621-1574c747884b · outbound

This paper cites URL https://doi.org/10.1126/science.aaa9375.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers URL https://doi.org/10.1126/science.aaa9375

Reference 2015

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:17.484330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:17.484330Z digest=sha256:87ef6b51013ab7e0f416904ffe25445107c85f1f54f4110e7ba7b6434a57c513

Observation 2e5efcbd-9ec4-4c73-b7a0-f620aa913bc1 · outbound

This paper cites URL https://doi.org/10.18653/v1/ 2023.emnlp-main.741.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers URL https://doi.org/10.18653/v1/ 2023.emnlp-main.741

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:21.054587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:21.054587Z digest=sha256:f2dc1bdab41425cc757fbb15cbe6ff708b4edc1760baf35a5edc1655b8935138

Observation 9ed0038b-8f27-4f7e-93fa-5131735759e2 · outbound

This paper cites The 448-entry temporal supplement (§ F.1) validates the probe’s findings at scale; the probe additionally covers 2026 arXiv submissions.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers The 448-entry temporal supplement (§ F.1) validates the probe’s findings at scale; the probe additionally covers 2026 arXiv submissions

Reference 2026

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:23.466720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:23.466720Z digest=sha256:70ff32e57f182ea22891d5dc1db26cfc14f16e717362ba0a323ace9641368144

Observation 86f2f853-467b-4bf1-bd2a-840ebd028573 · outbound

This paper cites doi: 10.18653/v1/2021.naacl-main.324.

HALLMARK: Diagnosing Three Failure Modes in LLM Citation Verifiers doi: 10.18653/v1/2021.naacl-main.324

Reference 4124

Resolution
unresolved
no resolver link, observed 2026-08-01T16:39:20.366984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T16:39:20.366984Z digest=sha256:111a5a98f051782e9d1330191d69f8562505b1ec32545e3340cad370b6a98c02

Pith citing papers

No inbound Pith citation observations are available.