Pith. sign in

REVIEW 2 cited by

L3Cube-IndicNews: News-based Short Text and Long Document Classification Datasets in Indic Languages

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2401.02254 v2 pith:NR3426N2 submitted 2024-01-04 cs.CL cs.LG

Aishwarya Mirashi , Srushti Sonavane , Purva Lingayat , Tejas Padhiyar , Raviraj Joshi This is my paper · ORCID
classification cs.CLcs.LG
keywords newsclassificationdatasetslanguagesindiccategorycontainingdataset
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

In this work, we introduce L3Cube-IndicNews, a multilingual text classification corpus aimed at curating a high-quality dataset for Indian regional languages, with a specific focus on news headlines and articles. We have centered our work on 10 prominent Indic languages, including Hindi, Bengali, Marathi, Telugu, Tamil, Gujarati, Kannada, Odia, Malayalam, and Punjabi. Each of these news datasets comprises 10 or more classes of news articles. L3Cube-IndicNews offers 3 distinct datasets tailored to handle different document lengths that are classified as: Short Headlines Classification (SHC) dataset containing the news headline and news category, Long Document Classification (LDC) dataset containing the whole news article and the news category, and Long Paragraph Classification (LPC) containing sub-articles of the news and the news category. We maintain consistent labeling across all 3 datasets for in-depth length-based analysis. We evaluate each of these Indic language datasets using 4 different models including monolingual BERT, multilingual Indic Sentence BERT (IndicSBERT), and IndicBERT. This research contributes significantly to expanding the pool of available text classification datasets and also makes it possible to develop topic classification models for Indian regional languages. This also serves as an excellent resource for cross-lingual analysis owing to the high overlap of labels among languages. The datasets and models are shared publicly at https://github.com/l3cube-pune/indic-nlp

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. L3Cube-IndicHeadline-ID: A Dataset for Headline Identification and Semantic Evaluation in Low-Resource Indian Languages

    cs.CL 2025-09 conditional novelty 5.0 of 10

    A new benchmark dataset and evaluation for choosing the true news headline among semantic, lexical, and random distractors in ten Indic languages and English.

  2. On Limitations of LLM as Annotator for Low Resource Languages

    cs.CL 2024-11 conditional novelty 4.0 of 10

    On Marathi classification tasks, LLM annotators underperform fine-tuned BERT models by 10 to 14 points in accuracy.

Pith tools