Paper Citation Record · LEDGER

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

As of 14 August 2026, this Paper Citation Record lists 100 of 111 outbound references and 5 inbound Pith citation observations for arXiv:2505.18893.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.18893 v4

Coverage vector

measured 100 of 111 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:26:35.172094Z

measured 105 of 105 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-12T05:51:08.101805Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-18T11:01:17.051563Z

Reference resolution

100 of 111 outbound references displayed

verified exact16
verified fuzzy9
unresolved73
parse uncertain0
malformed identifier0
metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b6498dfe-01a4-4634-8264-996152b6d865 · outbound

This paper cites A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.857333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation afb07c4a-ea11-47ed-8bbc-ef50e31253d9 · outbound

This paper cites The simple macroeconomics of ai.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The simple macroeconomics of ai

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.861646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 13aa2236-d300-49fa-99ff-cedd3cfd80e9 · outbound

This paper cites Xue, Peter S.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Xue, Peter S

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.865827Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7fd991af-7b41-4e67-9c06-d50e1bceecf0 · outbound

This paper cites Fairwashing: the risk of rationalization.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Fairwashing: the risk of rationalization

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.869537Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c75d47a0-c066-4280-aaae-84dfc118e1ab · outbound

This paper cites Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.873016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e5d9c44-e9f7-4219-9232-0e72a5efa586 · outbound

This paper cites Incentives and the replication crisis in social sciences: A critical review of open science practices.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Incentives and the replication crisis in social sciences: A critical review of open science practices

Reference 6

Resolution: metadata mismatch; raw_fallback, observed 2026-08-07T14:26:36.348633Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation d6d4a213-1e5c-4d61-aaef-8f1b1d76f227 · outbound

This paper cites On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pages 610–623, 2021.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pages 610–623, 2021

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.880419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de6df55b-695b-4d35-a3bb-34d9a51a4001 · outbound

This paper cites Participatory ai for humani- tarian innovation: A briefing paper.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Participatory ai for humani- tarian innovation: A briefing paper

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.883256Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9e69c03f-2cbb-4428-b26b-2f491535c4b3 · outbound

This paper cites Bertrand and S.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Bertrand and S

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.886559Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c5fce2e-95ec-4374-8ce1-8140fa5b4cbd · outbound

This paper cites A metrological framework for uncertainty evaluation in machine learning classification models, May 2025.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects A metrological framework for uncertainty evaluation in machine learning classification models, May 2025

Reference 10

Resolution: verified exact; raw_fallback, observed 2026-08-07T14:26:36.209532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation bbc6fd49-e9fc-40e6-b19c-f20c786f8bd7 · outbound

This paper cites Blaire et al.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Blaire et al

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.896063Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ee319d7f-274d-44ef-90f0-d9866723a3a3 · outbound

This paper cites Atlas of ai risks: Enhancing public understanding of ai risks.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Atlas of ai risks: Enhancing public understanding of ai risks

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.899053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aedc55e4-e36c-4170-991f-bdfc8c010225 · outbound

This paper cites Bommasani, P.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Bommasani, P

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.901755Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c75045d6-2669-42b7-afe8-ea8c61338dbd · outbound

This paper cites The impact of ai on the workforce: Tasks versus jobs? Economics Letters, 244:111971, 2024.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The impact of ai on the workforce: Tasks versus jobs? Economics Letters, 244:111971, 2024

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.904300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a4c7aa42-8f94-4c35-b56e-1b75abbdee98 · outbound

This paper cites Overcoming Failures of Imagination in AI Infused System Development and Deployment.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Overcoming Failures of Imagination in AI Infused System Development and Deployment

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.907267Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0be35d7-ac87-4eb3-becc-ddc532641f27 · outbound

This paper cites Evaluating the replicability of social science experiments in nature and science between 2010 and 2015.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Evaluating the replicability of social science experiments in nature and science between 2010 and 2015

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.910193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d765c08-716b-4479-977c-fef9e604199a · outbound

This paper cites Carlini et al.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Carlini et al

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.913162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6dc8f480-07f4-49d1-afcb-3cb4b57346d9 · outbound

This paper cites Quantifying Memorization Across Neural Language Models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Quantifying Memorization Across Neural Language Models

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.915543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 76c89e6d-1f98-451e-ba59-bb9b2433b228 · outbound

This paper cites Stealing Part of a Production Language Model.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Stealing Part of a Production Language Model

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.918711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c234d425-3000-4e85-8a67-7c03b38df923 · outbound

This paper cites Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.921482Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b43a77c0-b060-4f31-b1de-fee303a5bda9 · outbound

This paper cites an unresolved cited work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Unresolved cited work

Reference 22

Resolution: verified exact; raw_fallback, observed 2026-08-07T14:26:35.865414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 94969559-75ce-400e-9a19-bdd43a4e090d · outbound

This paper cites A survey on evaluation of large language models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects A survey on evaluation of large language models

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.926568Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 91935f16-ca15-48b2-91f5-508b35d498fe · outbound

This paper cites Jailbreaking Black Box Large Language Models in Twenty Queries.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Jailbreaking Black Box Large Language Models in Twenty Queries

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.929840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation feac4b48-4dc3-46c2-83c5-59543cc190ee · outbound

This paper cites From representational harms to quality-of-service harms: A case study on llama 2 safety safeguards.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects From representational harms to quality-of-service harms: A case study on llama 2 safety safeguards

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.934020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0cc1cb86-35dc-4ee9-892a-74586c65d2ac · outbound

This paper cites A Shared Standard for Valid Measurement of Generative AI Systems' Capabilities, Risks, and Impacts.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects A Shared Standard for Valid Measurement of Generative AI Systems' Capabilities, Risks, and Impacts

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.937671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3dbf9447-7d0d-4ac6-90fd-f2d82493a473 · outbound

This paper cites Underspecification Presents Challenges for Credibility in Modern Machine Learning.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Underspecification Presents Challenges for Credibility in Modern Machine Learning

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.941345Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cf9b0241-1673-46db-96ed-9f827a69b119 · outbound

This paper cites an unresolved cited work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Unresolved cited work

Reference 28

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.328171Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation d069ae07-c330-4943-a552-6cfd9f6509cd · outbound

This paper cites Hard Choices in Artificial Intelligence.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Hard Choices in Artificial Intelligence

Reference 29

Resolution: verified exact; local_arxiv, observed 2026-08-07T14:26:35.320244Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation e215c4e5-f5c9-49f7-b5e3-d11823d243e2 · outbound

This paper cites Show Your Work: Improved Reporting of Experimental Results.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Show Your Work: Improved Reporting of Experimental Results

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.951230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b94329f8-0d36-47c9-82e3-972b701a5976 · outbound

This paper cites Harmful speech detection by language models exhibits gender-queer dialect bias.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Harmful speech detection by language models exhibits gender-queer dialect bias

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.954291Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2baf5d17-acee-49c1-b1c1-78de82ef832d · outbound

This paper cites Do Membership Inference Attacks Work on Large Language Models?.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Do Membership Inference Attacks Work on Large Language Models?

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.957705Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27a92922-9afe-4233-8bee-adfea636cfb1 · outbound

This paper cites On the Impossible Safety of Large AI Models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects On the Impossible Safety of Large AI Models

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.961038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f81b78ef-f874-48e0-ac0e-dc952015b6c3 · outbound

This paper cites Ethics Owners: A New Model of Organi- zational Responsibility in Data-Driven Technology Companies.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Ethics Owners: A New Model of Organi- zational Responsibility in Data-Driven Technology Companies

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.965132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 57bdd006-8a2b-4623-9240-18f9b683c32c · outbound

This paper cites Can we trust ai benchmarks? an interdisciplinary review of current issues in ai evaluation, 2025.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Can we trust ai benchmarks? an interdisciplinary review of current issues in ai evaluation, 2025

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.967839Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d9144f5c-a105-452e-b9b9-7fa940cfa70f · outbound

This paper cites Code-ifying the law: How disciplinary divides afflict the development of legal software.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Code-ifying the law: How disciplinary divides afflict the development of legal software

Reference 36

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.309703Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 5c715418-5612-40a5-bc23-8f8a3049b866 · outbound

This paper cites The replication crisis has led to positive structural, procedural, and community changes.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The replication crisis has led to positive structural, procedural, and community changes

Reference 37

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.301963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 1e77dd89-d8be-4a04-b85a-7049d0e3445e · outbound

This paper cites Large ai models are cultural and social technologies.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Large ai models are cultural and social technologies

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.977694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 912652e7-2c8f-45ad-af8a-ebe7d919bd4f · outbound

This paper cites Value sensitive design: Theory and methods.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Value sensitive design: Theory and methods

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.980885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 922754ab-22d6-4c66-8236-2c38f5267b0e · outbound

This paper cites Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.983661Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 216ad4eb-e6b6-419d-99f4-a0b1f140232a · outbound

This paper cites Americans use ai in everyday prod- ucts without realizing it.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Americans use ai in everyday prod- ucts without realizing it

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.987374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02823ee1-8d02-44b8-850c-7dfb2eaf0e53 · outbound

This paper cites Gao et al.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Gao et al

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.990319Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 11d08791-fbb7-46e2-8098-3ec4fe98c7a1 · outbound

This paper cites RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.993546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b750134-73a6-41bf-8529-f164a08264bb · outbound

This paper cites Trust, attitudes and use of artificial intelligence: A global study 2025, 2025.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Trust, attitudes and use of artificial intelligence: A global study 2025, 2025

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.996603Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 21e2fd89-5fbc-4193-93a3-d61fdc487be4 · outbound

This paper cites Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:34.999548Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3967974e-db69-42e2-a3e9-3b0c560892d7 · outbound

This paper cites Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.002831Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f6658a23-0896-482b-8c79-329fa23fba89 · outbound

This paper cites Hoffmann and H.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Hoffmann and H

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.006652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c926737a-d81b-435e-bbcb-aad80a5548d2 · outbound

This paper cites Toward best research practices in AI Psychology.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Toward best research practices in AI Psychology

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.009530Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6dff38cc-eac9-4d50-bdad-b2c036b40754 · outbound

This paper cites Jansma, Anne M.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Jansma, Anne M

Reference 49

Resolution: verified exact; raw_fallback, observed 2026-08-07T14:26:35.735095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 7ed8dc78-8d6f-4246-9bf5-6470e13bef3f · outbound

This paper cites Survey of hallucination in natural language generation.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Survey of hallucination in natural language generation

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.015687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d92c4d55-08cd-44fd-b9e2-78926ff72c47 · outbound

This paper cites Kapoor and A.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Kapoor and A

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.018225Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 45e3f768-ff8e-4997-a239-db008ea79e4d · outbound

This paper cites Leakage and the Reproducibility Crisis in ML-based Science.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Leakage and the Reproducibility Crisis in ML-based Science

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.021540Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38652cd6-1e13-4aee-85f1-c1a215f4f512 · outbound

This paper cites Dynabench: Rethinking benchmarking in NLP.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Dynabench: Rethinking benchmarking in NLP

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.024268Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 899bf88f-a594-43e8-9260-272c5c1f009e · outbound

This paper cites Audiocaps: Gener- ating captions for audios in the wild.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Audiocaps: Gener- ating captions for audios in the wild

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.027858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a40fea5-a5a8-448c-b5b5-a511fd157b94 · outbound

This paper cites The History and Risks of Reinforcement Learning and Human Feedback.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The History and Risks of Reinforcement Learning and Human Feedback

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.031480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 91a7ef01-7a82-4026-92ec-eb315053b58e · outbound

This paper cites Challenging the Machine: Contestability in Government AI Systems.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Challenging the Machine: Contestability in Government AI Systems

Reference 56

Resolution: metadata mismatch; local_arxiv, observed 2026-08-07T14:26:35.657411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 64d8ebad-b86f-40e9-93af-4e72e8550326 · outbound

This paper cites Leask, Marlene Sandlund, Dawn A.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Leask, Marlene Sandlund, Dawn A

Reference 57

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.289958Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation f1be5504-2e3b-4263-849d-978860ae65e9 · outbound

This paper cites Lenaerts-Bergmans.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Lenaerts-Bergmans

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.041357Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1dc479c6-2bee-4ad7-adbd-e66ac3fdf5b9 · outbound

This paper cites Ai sustainability in practice part one: Foundations for sustainable ai projects.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Ai sustainability in practice part one: Foundations for sustainable ai projects

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.044083Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ebe4ec8b-d75c-4c46-b21d-be97a5e8b2fb · outbound

This paper cites Task Contamination: Language Models May Not Be Few-Shot Anymore.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Task Contamination: Language Models May Not Be Few-Shot Anymore

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.047220Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 025da3cb-08c6-465b-bc04-ee7fc410a902 · outbound

This paper cites LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.050363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 389ac5fe-c27c-46a5-89f0-ce659e480958 · outbound

This paper cites The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.053073Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 80abc088-bfa2-4bad-af30-d22e37c4e5d1 · outbound

This paper cites A survey of multimodel large language models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects A survey of multimodel large language models

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.056436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8321b673-345a-4700-8063-73ace51a30e3 · outbound

This paper cites Are we learn- ing yet? a meta review of evaluation failures across machine learning.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Are we learn- ing yet? a meta review of evaluation failures across machine learning

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.059571Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 71ae9f5c-30c4-4333-bb13-bb90ddc1d672 · outbound

This paper cites Jaffe, Abhishek Nagaraj, Imke Reimers, Michael D.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Jaffe, Abhishek Nagaraj, Imke Reimers, Michael D

Reference 65

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.276370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 1d8d6401-4b8e-4941-8a81-574bc731bfb5 · outbound

This paper cites Madaio, Jingya Chen, Hanna Wallach, and Jennifer Wortman Vaughan.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Madaio, Jingya Chen, Hanna Wallach, and Jennifer Wortman Vaughan

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.065115Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b144b970-4bcf-458b-b05e-3de02192adfd · outbound

This paper cites Martínez.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Martínez

Reference 67

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.263929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation e3916f63-794f-41c3-8416-7a72083a1402 · outbound

This paper cites Co-creation for policy: Participatory methodologies to structure multi-stakeholder policymaking processes.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Co-creation for policy: Participatory methodologies to structure multi-stakeholder policymaking processes

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.070857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4b8510a-71f7-4262-867d-cd6958f7bc51 · outbound

This paper cites How the u.s.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects How the u.s

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.073654Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a4196187-1308-4fdb-8173-321672f87d13 · outbound

This paper cites an unresolved cited work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Unresolved cited work

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.076211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 297a28dc-07a4-41c4-8260-0beafa2de4b3 · outbound

This paper cites Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland, May 2022.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland, May 2022

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.078657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 384418a1-47a4-4377-82b2-4d29ddb2faad · outbound

This paper cites thick alignment.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects thick alignment

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.081533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0fb0488-7956-4493-b034-2062815e1e4b · outbound

This paper cites Global law and policy tracker.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Global law and policy tracker

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.083993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2aa2749a-083c-4e8a-aecd-e8eee81c3ddf · outbound

This paper cites Governing with artificial intelli- gence, June 2024.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Governing with artificial intelli- gence, June 2024

Reference 74

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.450268Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 6351948b-f2f7-4b81-a4ab-4334be4af9b2 · outbound

This paper cites an unresolved cited work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Unresolved cited work

Reference 75

Resolution: unresolved; raw_fallback, observed 2026-08-07T14:26:36.444429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 5a5a82bc-8a7d-4109-b126-ca9d3ac66639 · outbound

This paper cites Concrete Problems in AI Safety, Revisited.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Concrete Problems in AI Safety, Revisited

Reference 76

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.092769Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8727bad5-1e4a-4d12-ad77-ec05658dcb6a · outbound

This paper cites The fallacy of ai functionality.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The fallacy of ai functionality

Reference 77

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.437542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 02799c20-8c4a-4d18-91f6-cf96df412c46 · outbound

This paper cites Do ImageNet Classifiers Generalize to ImageNet?.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Do ImageNet Classifiers Generalize to ImageNet?

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.097787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 43776d69-a635-4a3f-ba4b-125f8b1983db · outbound

This paper cites Just what do you think you’re doing, dave?’ a checklist for responsible data use in nlp, 2021.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Just what do you think you’re doing, dave?’ a checklist for responsible data use in nlp, 2021

Reference 79

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.431708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 1ecdc76c-e9db-4140-b20e-7139adcbf234 · outbound

This paper cites everyone wants to do the model work, not the data work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects everyone wants to do the model work, not the data work

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.104955Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c98d380a-778d-4c31-a646-cc36ab0d7ed6 · outbound

This paper cites Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.108420Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 77e59401-666e-4cf9-a07c-51e4cd5cf6d9 · outbound

This paper cites Towards a standard for identifying and managing bias in artificial intelligence.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Towards a standard for identifying and managing bias in artificial intelligence

Reference 82

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.425294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 77bd4954-ec1b-43fa-822b-e3b8e23b9ea0 · outbound

This paper cites The nist assessing risks and impacts of ai (aria) pilot evaluation plan.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The nist assessing risks and impacts of ai (aria) pilot evaluation plan

Reference 83

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.418317Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 62a57b4b-68de-4eb0-890c-8997794ef9a3 · outbound

This paper cites The assessing risks and impacts of ai (aria) program evaluation design document.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The assessing risks and impacts of ai (aria) program evaluation design document

Reference 84

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.411404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 01c71d18-bb95-4afc-af30-579cb758e17d · outbound

This paper cites an unresolved cited work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Unresolved cited work

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.121773Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 600715f3-d7eb-4e86-8cf6-0fffa551734d · outbound

This paper cites Sociotech- nical harms of algorithmic systems: Scoping a taxonomy for harm reduction.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Sociotech- nical harms of algorithmic systems: Scoping a taxonomy for harm reduction

Reference 86

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.405398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation cac46a0c-4816-447f-98a6-528cff44561f · outbound

This paper cites Taskbench: Benchmarking large language models for task automation.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Taskbench: Benchmarking large language models for task automation

Reference 87

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.398624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 750f819b-d2ca-4a8f-a004-eda5ac2c4dd0 · outbound

This paper cites Sponge Examples: Energy-Latency Attacks on Neural Networks.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Sponge Examples: Energy-Latency Attacks on Neural Networks

Reference 88

Resolution: verified exact; local_arxiv, observed 2026-08-07T14:26:35.493129Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation dfaf3510-8998-4495-8567-c8f1b0556c57 · outbound

This paper cites The leaderboard illusion, 2025.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The leaderboard illusion, 2025

Reference 89

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T14:26:36.391423Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation b7fb97db-f9b2-4406-918e-49ef8d7cba90 · outbound

This paper cites Participation is not a design fix for machine learning.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Participation is not a design fix for machine learning

Reference 90

Resolution: verified exact; arxiv_id_nonexistent, observed 2026-08-07T14:26:36.119406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 939774ff-aed7-4b9b-a9fe-e78202a7aabd · outbound

This paper cites Slota, Kenneth R.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Slota, Kenneth R

Reference 91

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.253071Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 698e6155-3e17-4dba-bd06-041a6fad14b0 · outbound

This paper cites Smith, Saleema Amershi, Solon Barocas, Hanna Wallach, and Jennifer Wort- man Vaughan.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Smith, Saleema Amershi, Solon Barocas, Hanna Wallach, and Jennifer Wort- man Vaughan

Reference 92

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.143758Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 327a6d97-73b4-435a-a8ce-c9502763c6ea · outbound

This paper cites Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.146625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 916cb51a-310c-4954-a515-4275a705dac3 · outbound

This paper cites Beyond Memorization: Violating Privacy Via Inference with Large Language Models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Beyond Memorization: Violating Privacy Via Inference with Large Language Models

Reference 94

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.149807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 875059d9-86ee-4a16-9e5f-08c8a702a231 · outbound

This paper cites Stadler, T.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Stadler, T

Reference 95

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.152617Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation acbb289e-5248-430f-b897-1ddec38e5994 · outbound

This paper cites The State of AI Governance Research: AI Safety and Reliability in Real World Commercial Deployment.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The State of AI Governance Research: AI Safety and Reliability in Real World Commercial Deployment

Reference 96

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.241286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 50853340-2cc3-44ab-99d2-a396c365cde0 · outbound

This paper cites Clio: Privacy-Preserving Insights into Real-World AI Use.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Clio: Privacy-Preserving Insights into Real-World AI Use

Reference 97

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.158699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1b863056-85ca-4ad5-8a72-aa4dcb8dc7a6 · outbound

This paper cites Theofanos, Y.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Theofanos, Y

Reference 98

Resolution: verified exact; doi, observed 2026-08-07T14:26:35.231664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 2419bd08-0f63-4c67-9ce0-4d078fe84f63 · outbound

This paper cites The Problem with Metrics is a Fundamental Problem for AI.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects The Problem with Metrics is a Fundamental Problem for AI

Reference 99

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.164741Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8eac081b-b223-465d-8eaf-9f6cbc90ee97 · outbound

This paper cites Analytical results for uncertainty propagation through trained machine learning regression models.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Analytical results for uncertainty propagation through trained machine learning regression models

Reference 100

Resolution: verified exact; local_arxiv, observed 2026-08-07T14:26:35.394639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 3f77eb93-eaad-43e1-ba36-b1630bf5b225 · outbound

This paper cites an unresolved cited work.

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects Unresolved cited work

Reference 101

Resolution: unresolved; no resolver link, observed 2026-08-07T14:26:35.172094Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 81957865-3309-4ca0-b7f3-67330616efe2 · inbound

VERA-MH Concept Paper cites this paper.

VERA-MH Concept Paper Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-18T07:01:01.468094Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 1a9ec25c-73eb-4398-9ea7-343f82de5a0c · inbound

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners cites this paper.

Towards Real-World Validity in Generative AI Benchmarks: Understanding and Designing Domain-Centered Evaluations for Journalism Practitioners Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Reference 61

Resolution: verified exact; arxiv_id, observed 2026-05-18T11:01:17.054618Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 0a088f9a-f81a-47f6-9c1c-d282ffcf339a · inbound

Making AI Evaluation Deployment Relevant Through Context Specification cites this paper.

Making AI Evaluation Deployment Relevant Through Context Specification Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Reference 16

Resolution: metadata mismatch; arxiv_id, observed 2026-05-15T14:50:05.136829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 4b82fe65-407b-4be2-be87-fa8e4fcb69dd · inbound

Context Collapse: Barriers to Adoption for Generative AI in Workplace Settings cites this paper.

Context Collapse: Barriers to Adoption for Generative AI in Workplace Settings Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Reference 108

Resolution: verified exact; arxiv_id, observed 2026-05-10T23:35:52.592560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

Observation 4fd5fcbf-fb47-42be-a0bc-346bc73b5029 · inbound

The Foreign Policy AI Evaluation Gap cites this paper.

The Foreign Policy AI Evaluation Gap Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Reference 21

Resolution: unresolved; no resolver link, observed 2026-07-12T05:51:08.101805Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.