Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-16T11:23:32.410720Z
Paper Citation Record · LEDGER
The Viability of Crowdsourcing for RAG Evaluation
As of 18 August 2026, this Paper Citation Record lists 54 of 54 outbound references and 0 inbound Pith citation observations for arXiv:2504.15689.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
54 of 54 outbound references displayed
- verified exact3
- verified fuzzy3
- unresolved42
- parse uncertain0
- malformed identifier5
- metadata mismatch1
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation 5262b4e8-87ca-4678-a72e-7de14ca9f923 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 1
- Resolution
- metadata mismatch
- raw_fallback, observed 2026-08-16T11:23:33.792902Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation acb63bf9-1782-4ea8-9fc9-57b09ae2c70d · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 2
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.397006Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 93393c73-1d2f-4539-a7ba-6438c8fe6bc4 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 3
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.402735Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ae675d78-d6a1-485a-a8bd-b513b6562619 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 4
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:35.096806Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 16ebf940-02cf-4205-abdf-545487ff6ea5 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 5
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.411947Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 732c4ddd-a944-4f3a-b3bc-c25e3ab7271e · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 6
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.416228Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cdb48cf6-cda1-4124-a1a1-5deb0e1c1c18 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 7
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.501590Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c577c88f-378a-4a27-bfa9-6f1536e17b44 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 9
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.994977Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 40b5d9d6-043c-469c-8721-c98c0fcbee27 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 10
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.615767Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 30c696d4-0b02-41fe-aa5d-14fd0d07f1a5 · outbound
This paper cites RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems.
The Viability of Crowdsourcing for RAG Evaluation RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems
Reference 11
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.620649Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3bc6fa3a-c9e5-4ce5-bd5e-2843f3018700 · outbound
This paper cites Retrieval-Augmented Generation for Large Language Models: A Survey.
The Viability of Crowdsourcing for RAG Evaluation Retrieval-Augmented Generation for Large Language Models: A Survey
Reference 12
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.625937Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 91ed95a0-a907-49a0-ac8f-650651eb7ed2 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 13
- Resolution
- malformed identifier
- no resolver link, observed 2026-08-16T11:23:31.631103Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 502b8b66-b8a9-4aa9-b806-43bf3394d22c · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 14
- Resolution
- malformed identifier
- raw_fallback, observed 2026-08-16T11:23:34.977349Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation c4ec3ccb-3f70-4200-b68e-cfe11c884e64 · outbound
This paper cites News Summarization and Evaluation in the Era of GPT-3.
The Viability of Crowdsourcing for RAG Evaluation News Summarization and Evaluation in the Era of GPT-3
Reference 15
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.641262Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bcde05b7-7abc-4771-84b4-ae24e996b533 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 16
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.747482Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4aeed2c2-981c-49c2-a4c2-871f0a3c645d · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 17
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.873687Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 78121e47-c545-42da-a742-2fc75291da59 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 18
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.804978Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 76209994-0040-4f57-a730-76e2a488f637 · outbound
This paper cites HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution.
The Viability of Crowdsourcing for RAG Evaluation HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution
Reference 19
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.808074Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 11566562-9c1c-4982-bb10-a9627be0e383 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 20
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.629638Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 98401115-dbc2-4d94-8b89-63c7de381cee · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 21
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.818009Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5533f8d6-7e4b-446d-92ed-1db88643fde5 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 22
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.822428Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 230ee0a5-cf08-4271-a78f-dbed8dac3491 · outbound
This paper cites LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.
The Viability of Crowdsourcing for RAG Evaluation LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods
Reference 23
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.826819Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bb8abfd3-d552-49cb-a22e-f30374e7090d · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 24
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.832120Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1f3a6fc0-e15e-465f-ad11-39f49804e181 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 25
- Resolution
- verified exact
- doi, observed 2026-08-16T11:23:32.822889Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation adb631cf-8a38-4f3d-a8bb-cc671f1ed3dc · outbound
This paper cites RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge.
The Viability of Crowdsourcing for RAG Evaluation RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge
Reference 26
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.920347Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 33efcc42-6adb-478e-b378-bf9ea2e7c84e · outbound
This paper cites CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models.
The Viability of Crowdsourcing for RAG Evaluation CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
Reference 27
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.970375Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 18f9adb5-4ebe-4d1e-8c4d-74c0113e94f4 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 28
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.974736Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e836bb3d-acd4-4bc9-8c9f-c9daaf28c033 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 29
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.978702Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 45f565d7-5e07-4616-b59a-8b6102dc7802 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 30
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.543028Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 52ae062a-fa73-49fc-aa38-eb3f20695a60 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 31
- Resolution
- malformed identifier
- no resolver link, observed 2026-08-16T11:23:31.988146Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 057365b5-fe82-4474-a85a-0904932e625b · outbound
This paper cites Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track.
The Viability of Crowdsourcing for RAG Evaluation Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track
Reference 32
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.992673Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ef65e120-4a1d-49bb-a461-70e54a6b108b · outbound
This paper cites Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework.
The Viability of Crowdsourcing for RAG Evaluation Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework
Reference 33
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:31.997517Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e8e871fd-eb6b-430b-bcb9-e95f2cfc17d8 · outbound
This paper cites SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval.
The Viability of Crowdsourcing for RAG Evaluation SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval
Reference 34
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.040373Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ce7e22b2-cfd8-4660-a409-63a950e21d88 · outbound
This paper cites Rahmani, Emine Yilmaz, Nick Craswell, and Bhaskar Mitra.
The Viability of Crowdsourcing for RAG Evaluation Rahmani, Emine Yilmaz, Nick Craswell, and Bhaskar Mitra
Reference 35
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-16T11:23:34.489629Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 60ea6de6-b938-488a-8196-bf6cbd57f613 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 36
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.149160Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 84c38575-66d2-418f-8673-98d4f63683f2 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 37
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.153315Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c09f319a-6bfa-4f11-9ccb-b554db8bac54 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 38
- Resolution
- malformed identifier
- no resolver link, observed 2026-08-16T11:23:32.157019Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 28dce794-67bb-4c0c-9953-9f68cdcf05d5 · outbound
This paper cites Don't Use LLMs to Make Relevance Judgments.
The Viability of Crowdsourcing for RAG Evaluation Don't Use LLMs to Make Relevance Judgments
Reference 39
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.161229Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 35aa9e78-a227-4e34-ad9e-a52cdbef24c6 · outbound
This paper cites MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries.
The Viability of Crowdsourcing for RAG Evaluation MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries
Reference 40
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.165540Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b0c10945-e488-453a-9e08-363e44700bfe · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 41
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.170083Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5f5085ef-25ae-4249-93df-4c8116fcb5de · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 42
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.346124Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation e89becd6-4dea-47af-b421-8bfe5ce6c65b · outbound
This paper cites LLMs Can Patch Up Missing Relevance Judgments in Evaluation.
The Viability of Crowdsourcing for RAG Evaluation LLMs Can Patch Up Missing Relevance Judgments in Evaluation
Reference 43
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.183873Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a23395fa-66c6-49b9-92e8-7d76a481e8e0 · outbound
This paper cites A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look.
The Viability of Crowdsourcing for RAG Evaluation A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look
Reference 44
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.188741Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 072d3418-6a8c-431b-b20e-348ab16cb58d · outbound
This paper cites Bernstein.
Reference 45
- Resolution
- verified exact
- doi, observed 2026-08-16T11:23:32.533651Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 83395c02-a1f9-41a5-ba42-1af0613d0d59 · outbound
This paper cites Voorhees.
Reference 46
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-16T11:23:34.282153Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation d7329889-8d30-4753-a47c-90dc38ec075f · outbound
This paper cites DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation.
The Viability of Crowdsourcing for RAG Evaluation DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation
Reference 47
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.201343Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cc3b95da-dbc0-492b-8bc0-d7c0039b8cd9 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 48
- Resolution
- verified exact
- doi, observed 2026-08-16T11:23:32.504078Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 849c784d-2944-4254-8b15-f7fc8c1dccf5 · outbound
This paper cites Weinberger, and Yoav Artzi.
The Viability of Crowdsourcing for RAG Evaluation Weinberger, and Yoav Artzi
Reference 49
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.211594Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9d4e87bd-6dc5-4871-815e-401c83044f59 · outbound
This paper cites McKeown, and Tatsunori B.
The Viability of Crowdsourcing for RAG Evaluation McKeown, and Tatsunori B
Reference 50
- Resolution
- malformed identifier
- no resolver link, observed 2026-08-16T11:23:32.292788Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7379c63c-c706-4d02-9f1b-f7b87efc3634 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 51
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:33.928446Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 37983d2e-9505-46cb-9daf-330a5f50a4e6 · outbound
This paper cites an unresolved cited work.
The Viability of Crowdsourcing for RAG Evaluation Unresolved cited work
Reference 2013
- Resolution
- unresolved
- raw_fallback, observed 2026-08-16T11:23:34.766959Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 74406c70-8f68-4e28-b617-30b4995fcef4 · outbound
This paper cites In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020.
The Viability of Crowdsourcing for RAG Evaluation In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020
Reference 2020
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-16T11:23:34.027021Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.
Observation 7f0cb658-d9f9-4342-adfe-97325473e336 · outbound
This paper cites JudgeBlender: Ensembling Judgments for Automatic Relevance Assessment.
The Viability of Crowdsourcing for RAG Evaluation JudgeBlender: Ensembling Judgments for Automatic Relevance Assessment
Reference 2024
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.144827Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a6c8b95a-3662-4a07-9281-c8ad2d755c5e · outbound
This paper cites GenTREC: The First Test Collection Generated by Large Language Models for Evaluating Information Retrieval Systems.
The Viability of Crowdsourcing for RAG Evaluation GenTREC: The First Test Collection Generated by Large Language Models for Evaluating Information Retrieval Systems
Reference 2025
- Resolution
- unresolved
- no resolver link, observed 2026-08-16T11:23:32.178961Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Pith citing papers
No inbound Pith citation observations are available.