REVIEW 5 cited by
An Audit on the Perspectives and Challenges of Hallucinations in NLP
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We audit how hallucination in large language models (LLMs) is characterized in peer-reviewed literature, using a critical examination of 103 publications across NLP research. Through the examination of the literature, we identify a lack of agreement with the term `hallucination' in the field of NLP. Additionally, to compliment our audit, we conduct a survey with 171 practitioners from the field of NLP and AI to capture varying perspectives on hallucination. Our analysis calls for the necessity of explicit definitions and frameworks outlining hallucination within NLP, highlighting potential challenges, and our survey inputs provide a thematic understanding of the influence and ramifications of hallucination in society.
Forward citations
Cited by 5 Pith papers
-
DeepTRACE: Auditing Deep Research AI Systems for Tracking Reliability Across Citations and Evidence
An audit framework and empirical study showing that generative search engines and deep research agents frequently produce one-sided answers and weakly supported citations, with citation accuracy between 40 and 80%.
-
Social Scientists on the Role of AI in Research
Randomized survey wording makes social scientists report more familiarity but less trust in "AI" than in "machine learning", with ethical concerns concentrated on generative AI.
-
Identifying and Mitigating the Influence of the Prior Distribution in Large Language Models
LLMs often compute correct answers to simple deterministic tasks in their internal representations, and light fine-tuning of early layers lets them access that information by suppressing a learned prior over outputs.
-
Hallucination Detection with Small Language Models
A multi-small-model ensemble with sentence splitting, z-score normalization, and harmonic mean detects hallucinations in RAG answers with a reported 10% F1 gain over single-model baselines.
-
Scientific Hypothesis Generation and Validation: Methods, Datasets, and Future Directions
A survey of LLM-based hypothesis generation and validation whose taxonomy is useful in outline but whose citations and tool descriptions are unreliable.
Discussion (0). Continue with ORCID to comment.