Pith. sign in

REVIEW 2 cited by

BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2205.11081 v4 pith:BH2HSC7Z submitted 2022-05-23 cs.CL

classification cs.CL
keywords banglabanglanlgbanglat5generationlanguagebenchmarkdatasetdialogue
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This work presents BanglaNLG, a comprehensive benchmark for evaluating natural language generation (NLG) models in Bangla, a widely spoken yet low-resource language. We aggregate six challenging conditional text generation tasks under the BanglaNLG benchmark, introducing a new dataset on dialogue generation in the process. Furthermore, using a clean corpus of 27.5 GB of Bangla data, we pretrain BanglaT5, a sequence-to-sequence Transformer language model for Bangla. BanglaT5 achieves state-of-the-art performance in all of these tasks, outperforming several multilingual models by up to 9% absolute gain and 32% relative gain. We are making the new dialogue dataset and the BanglaT5 model publicly available at https://github.com/csebuetnlp/BanglaNLG in the hope of advancing future research on Bangla NLG.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Empowering Bengali Education with AI: Solving Bengali Math Word Problems through Transformer Models

    cs.CL 2025-01 conditional novelty 5.0 of 10

    Fine-tuning mT5, BanglaT5, mBART50 and a basic Transformer on a newly translated Bengali math word problem dataset yields up to 97.3% solution accuracy on elementary arithmetic problems.

  2. BeliN: A Novel Corpus for Bengali Religious News Headline Generation using Contextual Feature Fusion

    cs.CL 2025-01 conditional novelty 5.0 of 10

    Adding category, aspect, and sentiment labels to Bengali religious news articles improves transformer-based headline generation over a content-only baseline, with BanglaT5 reaching BLEU 18.61.

Pith tools