REVIEW 7 cited by
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Instruction-tuned language models (LM) are able to respond to imperative commands, providing a more natural user interface compared to their base counterparts. In this work, we present Promptriever, the first retrieval model able to be prompted like an LM. To train Promptriever, we curate and release a new instance-level instruction training set from MS MARCO, spanning nearly 500k instances. Promptriever not only achieves strong performance on standard retrieval tasks, but also follows instructions. We observe: (1) large gains (reaching SoTA) on following detailed relevance instructions (+14.3 p-MRR / +3.1 nDCG on FollowIR), (2) significantly increased robustness to lexical choices/phrasing in the query+instruction (+12.9 Robustness@10 on InstructIR), and (3) the ability to perform hyperparameter search via prompting to reliably improve retrieval performance (+1.4 average increase on BEIR). Promptriever demonstrates that retrieval models can be controlled with prompts on a per-query basis, setting the stage for future work aligning LM prompting techniques with information retrieval.
Forward citations
Cited by 7 Pith papers
-
Certified Domain Consistency for Multi-Domain Retrieval: Label-Free Per-Domain Contamination Control with Conformal Risk Guarantees
C3R certifies per-domain retrieval contamination budgets using a two-split conformal scheme, without query-time domain labels.
-
More Than Efficiency: Embedding Compression Improves Domain Adaptation in Dense Retrieval
Query-only PCA compression improves retrieval NDCG@10 in most tested model-dataset pairs at 90% retention, with gains largest in structured domains like SpartQA.
-
Benchmarking Information Retrieval Models on Complex Retrieval Tasks
CRUMB is a new benchmark for complex, multi-aspect retrieval tasks on which state-of-the-art retrieval models score poorly, and query rewriting does not rescue the best models.
-
ERank: Fusing Supervised Fine-Tuning and Reinforcement Learning for Effective and Efficient Text Reranking
ERank trains a pointwise reasoning-LLM reranker with fine-grained integer scoring and a listwise reinforcement-learning reward, reporting nDCG@10 of 40.2 on BRIGHT for its 32B variant with BM25 hybrid scoring.
-
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective
Diffusion-language-model embeddings beat LLM embeddings on long-document and reasoning retrieval benchmarks, but the paper overstates some gains and releases no code or data.
-
O1 Embedder: Let Retrievers Think Before Action
A jointly trained retriever that first generates query thoughts and then encodes them improves accuracy on 12 retrieval benchmarks.
-
Ranking Free RAG: Replacing Re-ranking with Selection in RAG for Sensitive Domains
METEORA uses DPO-tuned rationales to select and verify evidence chunks in RAG, and claims better recall, precision, evidence efficiency, and poisoning defense, though key evaluation details are missing.
Discussion (0). Continue with ORCID to comment.