REVIEW 6 cited by
Confabulation: The Surprising Value of Large Language Model Hallucinations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This paper presents a systematic defense of large language model (LLM) hallucinations or 'confabulations' as a potential resource instead of a categorically negative pitfall. The standard view is that confabulations are inherently problematic and AI research should eliminate this flaw. In this paper, we argue and empirically demonstrate that measurable semantic characteristics of LLM confabulations mirror a human propensity to utilize increased narrativity as a cognitive resource for sense-making and communication. In other words, it has potential value. Specifically, we analyze popular hallucination benchmarks and reveal that hallucinated outputs display increased levels of narrativity and semantic coherence relative to veridical outputs. This finding reveals a tension in our usually dismissive understandings of confabulation. It suggests, counter-intuitively, that the tendency for LLMs to confabulate may be intimately associated with a positive capacity for coherent narrative-text generation.
Forward citations
Cited by 6 Pith papers
-
Optimization Is Not All You Need
Optimization can measure how improbable generated text is but cannot tell whether that unlikelihood is error or invention, yet it now sets the protocols of legitimate language.
-
AI Virtue: What is "Good" Knowledge in the Age of Artificial Intelligence?
Uses digital humanities corpus analysis on 2024 AI literature to map epistemic virtues and outline a generativity-centered framework for evaluating AI knowledge-worth.
-
Thinking beyond the anthropomorphic paradigm benefits LLM research
Anthropomorphic language and assumptions are common and growing in LLM research, and the authors propose a framework for moving beyond them while keeping what is useful.
-
Not All Needles Are Found: How Fact Distribution and Don't Make It Up Prompts Shape Retrieval, Reasoning, and Hallucination in Long-Context LLMs
On a new extended needle-in-a-haystack benchmark, explicit anti-hallucination prompts and dispersed fact placement cause some long-context LLMs to over-refuse or collapse in accuracy, while others remain robust.
-
VulCoCo: A Simple Yet Effective Method for Detecting Vulnerable Code Clones
VulCoCo retrieves candidate code clones with embeddings and validates them with an LLM, outperforming prior vulnerable-clone detectors on a new synthetic benchmark and finding real-world clones that led to 15 CVEs.
-
Personalized Constitutionally-Aligned Agentic Superego: Secure AI Behavior Aligned to Diverse Human Values
An external 'superego' module that filters agentic AI plans against user-selected 'constitutions' plus a universal safety floor is reported to cut harmful outputs by up to 98% on safety benchmarks.
Discussion (0). Continue with ORCID to comment.