L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Library
read the original abstract
Despite being the third most popular language in India, the Marathi language lacks useful NLP resources. Moreover, popular NLP libraries do not have support for the Marathi language. With L3Cube-MahaNLP, we aim to build resources and a library for Marathi natural language processing. We present datasets and transformer models for supervised tasks like sentiment analysis, named entity recognition, and hate speech detection. We have also published a monolingual Marathi corpus for unsupervised language modeling tasks. Overall we present MahaCorpus, MahaSent, MahaNER, and MahaHate datasets and their corresponding MahaBERT models fine-tuned on these datasets. We aim to move ahead of benchmark datasets and prepare useful resources for Marathi. The resources are available at https://github.com/l3cube-pune/MarathiNLP.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
L3Cube-MahaPOS: A Marathi Part-of-Speech Tagging Dataset and BERT Models
Introduces a 32k-sentence gold-standard POS tagging dataset for Marathi and benchmarks models achieving up to 88.67% token accuracy.
-
IndicGuard: A Multilingual Safety Guard Model and Dataset for Indic Languages
IndicGuard provides a culturally nuanced safety dataset for ten Indic languages and a fine-tuned Gemma-3-4B-IT model that outperforms CultureGuard on moderation tasks and generalizes to unseen low-resource languages.
-
Structure-Preserving Document Translation via Multi-Stage LLM Pipeline: A Case Study in Marathi
A multi-stage LLM pipeline for structure-preserving Marathi-to-English translation of government PDFs using layout-aware OCR and HTML reconstruction.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.