REVIEW 2 cited by
Fine-tune the Entire RAG Architecture (including DPR retriever) for Question-Answering
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In this paper, we illustrate how to fine-tune the entire Retrieval Augment Generation (RAG) architecture in an end-to-end manner. We highlighted the main engineering challenges that needed to be addressed to achieve this objective. We also compare how end-to-end RAG architecture outperforms the original RAG architecture for the task of question answering. We have open-sourced our implementation in the HuggingFace Transformers library.
Forward citations
Cited by 2 Pith papers
-
Efficient Learning Content Retrieval with Knowledge Injection
Fine-tuning Phi models with QLoRA and combining them with RAG on 920 GPT-4-generated Q&A pairs produces a limited-resource chatbot that scores best with Phi-2 plus RAG on automatic metrics.
-
Automatic Dataset Generation for Knowledge Intensive Question Answering Tasks
Fine-tuning Llama-3-8b and Mistral-7b-v0.3 on LLM-generated QA pairs from IBM Technotes can improve no-context QA scores over training on human-annotated TechQA data, but the evaluation may be inflated by test-documen...
Discussion (0). Continue with ORCID to comment.