Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T00:42:00.744078Z
Paper Citation Record · LEDGER
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems
As of 19 August 2026, this Paper Citation Record lists 47 of 47 outbound references and 2 inbound Pith citation observations for arXiv:2506.13023.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-03T03:31:57.115743Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-05-12T06:56:25.816992Z
Reference resolution
47 of 47 outbound references displayed
- verified exact2
- verified fuzzy0
- unresolved45
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation b7e7fa89-b442-4d94-84f2-9057e858b0ef · outbound
This paper cites URL: " 'urlintro :=.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems URL: " 'urlintro :=
Reference 1
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:55.025553Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e44464ca-76e2-4262-9634-e1e24b409a50 · outbound
This paper cites write newline.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems write newline
Reference 2
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:55.088737Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f6ef7597-a1e8-4265-aae1-a122bea82018 · outbound
This paper cites CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligence.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligence
Reference 3
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:55.150430Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 70737066-5392-448d-b5f0-56da4bfdc21d · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 4
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.500799Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation b29994e1-e520-458c-9398-e461fd6822bd · outbound
This paper cites Nonlinear magnetotransport in a two-dimensional system with merging Dirac points.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Nonlinear magnetotransport in a two-dimensional system with merging Dirac points
Reference 5
- Resolution
- verified exact
- local_arxiv, observed 2026-08-07T00:42:01.051006Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 3ba1b176-e31e-4000-827e-f8e5c6988b69 · outbound
This paper cites Constitutional AI: Harmlessness from AI Feedback.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Constitutional AI: Harmlessness from AI Feedback
Reference 6
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:55.803388Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fd8154e2-6976-479d-a6bd-d8f89700d420 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 7
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:56.383787Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dc7fc515-b35b-40a6-a7da-08eec3435c08 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 8
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:57.561083Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 780324b9-af44-46dd-940d-ffcb4d55765c · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 9
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.477139Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 4a0438f7-bf4a-4e06-9684-33e6933f3387 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 10
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:58.152037Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f93bdff4-a826-4900-bf70-0fa746f6d686 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 11
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.462014Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation dd2fe6f7-5fef-45dd-9ad6-33e9ea7903c6 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 12
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.452800Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 405a2d2b-f35f-44b5-84ca-14438ddbf78e · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 13
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.444862Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 3c41ca9d-9b79-4dc9-a1e0-adba8fad9a31 · outbound
This paper cites Ragas: Automated Evaluation of Retrieval Augmented Generation.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Ragas: Automated Evaluation of Retrieval Augmented Generation
Reference 14
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:58.504833Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 11858e3e-c27f-41e1-956c-87c828b16d32 · outbound
This paper cites 3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPW.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems 3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPW
Reference 15
- Resolution
- verified exact
- local_arxiv, observed 2026-08-07T00:42:00.924360Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0bec8112-9cd3-4831-8ab0-ec7afcd86abe · outbound
This paper cites RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture
Reference 16
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:58.679114Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f46efb1e-fb6a-49d7-8379-0029ecb1ed3c · outbound
This paper cites Measuring Massive Multitask Language Understanding.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Measuring Massive Multitask Language Understanding
Reference 17
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:58.746451Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9dad363f-11bf-44f6-838a-2426a5812db1 · outbound
This paper cites The Curious Case of Neural Text Degeneration.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems The Curious Case of Neural Text Degeneration
Reference 18
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:58.814385Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 92afdbd0-2b66-4631-83e3-ce1ab56e096b · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 19
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.436421Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 86465bb2-5ee1-4187-83a6-030eb2f0f0ab · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 20
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.427526Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation deed5173-2d31-4430-8bae-dde95d74ce0a · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 21
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.362244Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation bcdd5aa9-d9e3-42e2-97be-2e44823959c7 · outbound
This paper cites Gecko: Versatile Text Embeddings Distilled from Large Language Models.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Gecko: Versatile Text Embeddings Distilled from Large Language Models
Reference 22
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.075872Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c6732bcf-8056-4bb5-b5a9-74fb0bb6e8ca · outbound
This paper cites u ttler, Mike Lewis, Wen-tau Yih, Tim Rockt \.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems u ttler, Mike Lewis, Wen-tau Yih, Tim Rockt \
Reference 23
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.156541Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6b3d8773-7197-4904-8d2c-ed3bf958c55c · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 24
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.244286Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0b157d4c-63e4-49b7-96d9-51756a502d5b · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 25
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.216619Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d42d9b90-5293-4981-8dfd-10ca73702984 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 26
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:05.051249Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 30b3c064-e258-4041-8b26-21fb49ecf6fd · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 27
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:04.810877Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 69ee82bb-fcd1-403b-95f0-7dd3180716c5 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 28
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:04.649397Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 020237c6-295c-4296-a744-a7939af620af · outbound
This paper cites Efficient Estimation of Word Representations in Vector Space.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Efficient Estimation of Word Representations in Vector Space
Reference 29
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.607752Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cba32ef5-396a-4996-af11-2699a7447165 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 30
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:04.419751Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 531b3d5a-f391-426d-ac77-61a3331cde91 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 31
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.754292Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3fd5efdd-3b06-4f37-8c08-264fd4d31d2e · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 32
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.821208Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dd7738e9-8fab-4a7c-950a-2a771d03f07c · outbound
This paper cites A Call for Clarity in Reporting BLEU Scores.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems A Call for Clarity in Reporting BLEU Scores
Reference 33
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:41:59.863470Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 07334985-040c-42c5-833f-84ab012df7a3 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 34
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:04.243673Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 4ba1326c-6ec3-45a5-a4ef-59f86d93f76b · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 35
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:04.032109Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a7c848ac-0b6e-47d5-991c-332ea3b84f30 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 36
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:03.832291Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 049aaf93-5a7a-4d19-9993-4c60be60f8ef · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 37
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:03.626977Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 84b5961c-b554-4580-b6e3-ce3473f63f75 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 38
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:03.322232Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation bc2758da-98c6-455a-affe-6dde1df2cf2a · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 39
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:02.981413Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 3ce35ece-cab8-49da-bcef-ef3d652811bd · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 40
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:02.699584Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation f0dc5543-7060-48a8-abe2-3cf99de835ee · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 41
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:02.352995Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 1d687255-39ce-4b33-bb0f-5f19771a3906 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 42
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:02.070152Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation e6ba99c2-7fbc-4fa2-b703-e7d258fe8faf · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 43
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:42:00.538128Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation af684115-14c5-4f6b-a600-28c5ab4e40fe · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 44
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:01.795390Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 9eb822df-f7aa-46a5-b5a4-eeab3cfcbf72 · outbound
This paper cites Self-Consistency Improves Chain of Thought Reasoning in Language Models.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Self-Consistency Improves Chain of Thought Reasoning in Language Models
Reference 45
- Resolution
- unresolved
- no resolver link, observed 2026-08-07T00:42:00.640741Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 67469c4a-4155-499d-87dd-a872400a7ee6 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 46
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:01.430916Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 430ec4c4-6fd1-425a-9780-a0eec59c8773 · outbound
This paper cites an unresolved cited work.
A Practical Guide for Evaluating LLMs and LLM-Reliant Systems Unresolved cited work
Reference 47
- Resolution
- unresolved
- raw_fallback, observed 2026-08-07T00:42:01.293465Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Pith citing papers
Observation 01179ef3-63b8-40ec-a2b3-03f347775ce8 · inbound
SAGE: Scalable AI Governance & Evaluation cites this paper.
SAGE: Scalable AI Governance & Evaluation A Practical Guide for Evaluating LLMs and LLM-Reliant Systems
Reference 26
- Resolution
- unresolved
- no resolver link, observed 2026-08-03T03:31:57.115743Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4c6a325d-1bb6-408a-914a-2e96956c1daa · inbound
Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insights cites this paper.
Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insights A Practical Guide for Evaluating LLMs and LLM-Reliant Systems
Reference 13
- Resolution
- verified exact
- arxiv_id, observed 2026-05-12T06:56:25.823633Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.