Pith. sign in

REVIEW

mRobust04: A Multilingual Version of the TREC Robust 2004 Benchmark

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2209.13738 v1 pith:RQPTUMPO submitted 2022-09-27 cs.CL cs.AI

Vitor Jeronymo , Mauricio Nascimento , Roberto Lotufo , Rodrigo Nogueira This is my paper · ORCID
classification cs.CLcs.AI
keywords datasetmultilingualbenchmarkmrobust04robustversionavailabledatasets
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Robust 2004 is an information retrieval benchmark whose large number of judgments per query make it a reliable evaluation dataset. In this paper, we present mRobust04, a multilingual version of Robust04 that was translated to 8 languages using Google Translate. We also provide results of three different multilingual retrievers on this dataset. The dataset is available at https://huggingface.co/datasets/unicamp-dl/mrobust

Discussion (0). Continue with ORCID to comment.

Pith tools