Pith sign in

REVIEW 8 cited by

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2103.10730 v2 pith:VBEKGOOL submitted 2021-03-19 cs.CL

MuRIL: Multilingual Representations for Indian Languages

Simran Khanuja , Diksha Bansal , Sarvesh Mehtani , Savya Khosla , Atreyee Dey , Balaji Gopalan , Dilip Kumar Margam , Pooja Aggarwal
show 6 more authors
Rajiv Teja Nagipogu Shachi Dave Shruti Gupta Subhash Chandra Bose Gali Vish Subramanian Partha Talukdar
This is my paper
classification cs.CL
keywords languagesmultilingualmurilindiatransliterateddatalanguagetext
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

India is a multilingual society with 1369 rationalized languages and dialects being spoken across the country (INDIA, 2011). Of these, the 22 scheduled languages have a staggering total of 1.17 billion speakers and 121 languages have more than 10,000 speakers (INDIA, 2011). India also has the second largest (and an ever growing) digital footprint (Statista, 2020). Despite this, today's state-of-the-art multilingual systems perform suboptimally on Indian (IN) languages. This can be explained by the fact that multilingual language models (LMs) are often trained on 100+ languages together, leading to a small representation of IN languages in their vocabulary and training data. Multilingual LMs are substantially less effective in resource-lean scenarios (Wu and Dredze, 2020; Lauscher et al., 2020), as limited data doesn't help capture the various nuances of a language. One also commonly observes IN language text transliterated to Latin or code-mixed with English, especially in informal settings (for example, on social media platforms) (Rijhwani et al., 2017). This phenomenon is not adequately handled by current state-of-the-art multilingual LMs. To address the aforementioned gaps, we propose MuRIL, a multilingual LM specifically built for IN languages. MuRIL is trained on significantly large amounts of IN text corpora only. We explicitly augment monolingual text corpora with both translated and transliterated document pairs, that serve as supervised cross-lingual signals in training. MuRIL significantly outperforms multilingual BERT (mBERT) on all tasks in the challenging cross-lingual XTREME benchmark (Hu et al., 2020). We also present results on transliterated (native to Latin script) test sets of the chosen datasets and demonstrate the efficacy of MuRIL in handling transliterated data.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources

    cs.CL 2026-04 unverdicted novelty 7.0

    A unified survey that consolidates Indian NLP resources by task, language, domain, and modality while identifying gaps in coverage and generalization.

  2. Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracy

    cs.CL 2025-08 unverdicted novelty 7.0

    Human rationales in supervision for Telugu sentiment analysis improve model alignment with human reasoning and often produce gains in predictive performance.

  3. ks-pret-5m: a 5 million word, 12 million token kashmiri pretraining dataset

    cs.CL 2026-04 accept novelty 6.0

    KS-PRET-5M is a newly released 5.09 million word Kashmiri pretraining dataset containing 12.13 million subword tokens after MuRIL tokenization, made available as a continuous text stream under CC BY 4.0.

  4. Mitigating Extrinsic Gender Bias for Bangla Classification Tasks

    cs.CL 2024-11 unverdicted novelty 5.0

    Constructs gender-perturbed Bangla classification benchmarks and proposes RandSymKL debiasing that reduces extrinsic gender bias in pretrained models.

  5. AgriGov: A Structured Multilingual Dataset Curation for Indian Government Schemes for Farmers

    cs.CL 2026-06 unverdicted novelty 4.0

    AgriGov is a new structured trilingual dataset of ~8000 sentence pairs from 50 Indian farmer schemes, created via scraping, MT pipeline, and corpus augmentation for NLP tasks.

  6. MKJ at SemEval-2026 Task 9: A Comparative Study of Generalist, Specialist, and Ensemble Strategies for Multilingual Polarization

    cs.CL 2026-04 unverdicted novelty 4.0

    A language-adaptive combination of generalist, specialist, and ensemble transformer models achieves 0.796 macro F1 and 0.826 accuracy on multilingual polarization detection across 22 languages.

  7. A study on the impact of region specific data on the performance of Indic ASR

    eess.AS 2026-06 unverdicted novelty 3.0

    Empirical study finds consistent positive correlation between inter-district geographic distance and ASR word error rate when models are finetuned on single-district Indic speech data.

  8. Scripts Through Time: A Survey of the Evolving Role of Transliteration in NLP

    cs.CL 2026-04 unverdicted novelty 3.0

    A survey that taxonomizes motivations for transliteration in cross-lingual NLP, reviews incorporation approaches and their evolution, analyzes trade-offs in settings like code-mixing and language families, and offers ...