The reviewed record of science sign in
Pith

arxiv: 2501.04153 · v1 · pith:H6AQJSGA · submitted 2025-01-07 · cs.CL · cs.LG

Multilingual Open QA on the MIA Shared Task

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:H6AQJSGArecord.jsonopen to challenge →

classification cs.CL cs.LG
keywords languageretrievalmethodquestionresourceclirdifferenthence
0
0 comments X
read the original abstract

Cross-lingual information retrieval (CLIR) ~\cite{shi2021cross, asai2021one, jiang2020cross} for example, can find relevant text in any language such as English(high resource) or Telugu (low resource) even when the query is posed in a different, possibly low-resource, language. In this work, we aim to develop useful CLIR models for this constrained, yet important, setting where we do not require any kind of additional supervision or labelled data for retrieval task and hence can work effectively for low-resource languages. \par We propose a simple and effective re-ranking method for improving passage retrieval in open question answering. The re-ranker re-scores retrieved passages with a zero-shot multilingual question generation model, which is a pre-trained language model, to compute the probability of the input question in the target language conditioned on a retrieved passage, which can be possibly in a different language. We evaluate our method in a completely zero shot setting and doesn't require any training. Thus the main advantage of our method is that our approach can be used to re-rank results obtained by any sparse retrieval methods like BM-25. This eliminates the need for obtaining expensive labelled corpus required for the retrieval tasks and hence can be used for low resource languages.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.