REVIEW 21 cited by
Retrieval Augmentation Reduces Hallucination in Conversation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of neural-retrieval-in-the-loop architectures - recently shown to be effective in open-domain QA (Lewis et al., 2020b; Izacard and Grave, 2020) - for knowledge-grounded dialogue, a task that is arguably more challenging as it requires querying based on complex multi-turn dialogue context and generating conversationally coherent responses. We study various types of architectures with multiple components - retrievers, rankers, and encoder-decoders - with the goal of maximizing knowledgeability while retaining conversational ability. We demonstrate that our best models obtain state-of-the-art performance on two knowledge-grounded conversational tasks. The models exhibit open-domain conversational capabilities, generalize effectively to scenarios not within the training data, and, as verified by human evaluations, substantially reduce the well-known problem of knowledge hallucination in state-of-the-art chatbots.
Forward citations
Cited by 21 Pith papers
-
ToolGrad: Efficient Tool-use Dataset Generation with Textual "Gradients"
ToolGrad inverts tool-use dataset generation: build valid tool-call chains first, synthesize queries second, yielding lower cost and near-100% pass rates.
-
Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning
RRPO formulates document reranking as a sequential MDP and optimizes a pointwise reranker with PPO using LLM generation rewards and a reference-anchored deterministic baseline.
-
UnWeaving the knots of GraphRAG -- turns out VectorRAG is almost enough
UnWeaver disentangles documents into entities via LLM to retrieve original chunks, yielding a simpler alternative to GraphRAG that still reduces noise and preserves source fidelity.
-
MCERF: Advancing Multimodal LLM Evaluation of Engineering Documentation with Enhanced Retrieval
MCERF delivers a 41.1% relative accuracy gain on the DesignQA benchmark by combining ColPali vision-language retrieval with four specialized reasoning modes and dynamic routing.
-
Hallucination Detection and Mitigation with Diffusion in Multi-Variate Time-Series Foundation Models
Pre-trained multivariate time-series imputation models frequently return values that violate known relations between variables, and a diffusion-based score can detect and filter these errors.
-
Respecting Temporal-Causal Consistency: Entity-Event Knowledge Graphs for Retrieval-Augmented Generation
A mention-level entity-event knowledge graph for RAG modestly improves temporal-causal question answering on a new narrative benchmark, with gains mostly coming from adding HyDE-style hypothetical answers.
-
SQLens: An End-to-End Framework for Error Detection and Correction in Text-to-SQL
SQLens uses weak supervision over database and LLM error signals to detect clause-level semantic errors in text-to-SQL and fixes them iteratively, improving execution accuracy on BIRD and Spider.
-
Understanding Mental Models of Generative Conversational Search and The Effect of Interface Transparency
Users of generative conversational search mostly hold abstract, incomplete mental models, and added interface transparency did not reliably improve those models or satisfaction.
-
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization
LeTS hybridizes process-level and outcome-level rewards for GRPO-based RAG training, improving accuracy and reducing redundant searches on multi-hop QA benchmarks.
-
Safety Degradation in AI Agents
Adding retrieval to aligned LLMs degrades safety: refusal rates fall, bias and harmfulness rise, and prompt-based mitigation only partially restores alignment.
-
X$^3$-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
X3-OPD improves audio-grounded reasoning by training the audio student on its own rollouts with token-level teacher feedback, using a three-tier paired text-audio corpus.
-
HG-RAG: Hierarchy-Guided Retrieval-Augmented Generation for Structured Knowledge Graphs
HG-RAG retrieves context by walking up, across, and down a hierarchical knowledge graph and outperforms flat dense retrieval on synthetic hierarchy queries—though its hallucination-rate claim is contradicted by its ow...
-
KinyaColBERT: A Lexically Grounded Retrieval Model for Low-Resource Retrieval-Augmented Generation
KinyaColBERT, a morphology-aware two-tier ColBERT retriever, reports large MRR gains over multilingual baselines and commercial APIs on a new Kinyarwanda agricultural retrieval benchmark.
-
Dr. GPT Will See You Now, but Should It? Exploring the Benefits and Harms of Large Language Models in Medical Diagnosis using Crowdsourced Clinical Cases
In a physician-rated crowdsourced study, 76% of LLM responses to everyday health queries were valid, with GPT-4o highest (85%) and Llama3-8b lowest (50%); RAG did not consistently improve responses.
-
Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decoding
FarSight adds upper-triangular negative biases to the causal mask to absorb outlier-token attention, reducing hallucinations in MLLMs without training.
-
RAG-TESTER: Automated End-to-End Testing of Retrieval-Augmented Large Language Models
A coverage-oriented test generator that adds negative-rejection and complex-passage queries to RAG evaluation, reported to detect 6.6% more failures than a strategy-free baseline in 24 model configurations.
-
Inteligencia Artificial jur\'idica y el desaf\'io de la veracidad: an\'alisis de alucinaciones, optimizaci\'on de RAG y principios para una integraci\'on responsable
Legal AI hallucination persists in commercial RAG tools (17-34%+ of queries), so the report argues the fix is consultative, source-citing system design plus mandatory human oversight, not better generative models.
-
Diverse And Private Synthetic Datasets Generation for RAG evaluation: A multi-agent framework
A multi-agent LLM framework generates synthetic QA datasets for RAG evaluation by combining clustering-based sampling, PII pseudonymization, and QA curation, with reported diversity gains and 0.75-0.90 masking accuracy.
-
Compute Can't Handle the Truth: Why Communication Tax Prioritizes Memory and Interconnects in Modern AI Infrastructure
A CXL-based disaggregated memory architecture with hybrid XLink interconnects is proposed and prototyped, claiming large speedups for memory-bound AI and HPC workloads.
-
Machine Assistant with Reliable Knowledge: Enhancing Student Learning via RAG-based Retrieval
A RAG-based tutoring and support chatbot with hybrid search and an instructor feedback loop is described, but no quantitative evaluation of its accuracy is provided.
-
A comprehensive taxonomy of hallucinations in Large Language Models
A survey that organizes LLM hallucination types, causes, benchmarks, and mitigations, and restates the theorem that hallucination is inevitable for computable LLMs.
Discussion (0). Sign in to comment.