REVIEW 10 cited by
The State and Fate of Linguistic Diversity and Inclusion in the NLP World
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Language technologies contribute to promoting multilingualism and linguistic diversity around the world. However, only a very small number of the over 7000 languages of the world are represented in the rapidly evolving language technologies and applications. In this paper we look at the relation between the types of languages, resources, and their representation in NLP conferences to understand the trajectory that different languages have followed over time. Our quantitative investigation underlines the disparity between languages, especially in terms of their resources, and calls into question the "language agnostic" status of current models and systems. Through this paper, we attempt to convince the ACL community to prioritise the resolution of the predicaments highlighted here, so that no language is left behind.
Forward citations
Cited by 10 Pith papers
-
ChiKhaPo: A Large-Scale Multilingual Benchmark for Evaluating Lexical Comprehension and Generation in Large Language Models
ChiKhaPo is an 8-subtask benchmark that measures word-level comprehension and generation in 2,700+ languages and shows state-of-the-art models perform poorly on low-resource languages.
-
Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
The authors introduce AibTrans, a multilingual image-text translation benchmark, show that common translation metrics mislead on dense images, and find that balanced multilingual fine-tuning preserves generalization b...
-
Mind the Gap! Choice Independence in Using Multilingual LLMs for Persuasive Co-Writing Tasks in Different Languages
Users who first used a Spanish AI writing assistant subsequently used the English AI writing assistant less, suggesting a spillover that violates choice independence.
-
Text2Cypher Across Languages: Evaluating and Finetuning LLMs
A new multilingual Text2Cypher benchmark shows LLMs rank English highest, Spanish next, and Turkish lowest, and multilingual finetuning narrows the language gap more than English-only finetuning.
-
Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMs
Selective pre-translation, translating only some prompt components into English, generally outperforms both full prompt translation and direct inference across tasks and languages, with the largest gains for low-resou...
-
Salamandra Technical Report
Salamandra is an open, from-scratch multilingual LLM family with 2B, 7B, and 40B checkpoints, instruction-tuned variants, a vision proof-of-concept, and detailed evaluations across Iberian and European languages.
-
LinguaMark: Do Multimodal Models Speak Fairly? A Benchmark-Based Evaluation
A multilingual visual question-answering benchmark across 11 languages and 5 social attributes, evaluated on 7 large multimodal models.
-
Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise
A multi-agent router that selects culturally specialized LLM personas reports a jump in self-scored cultural alignment from 0.208 to 0.820, but the metric and the claimed method are not independently validated.
-
Diffusion Models Through a Global Lens: Are They Culturally Inclusive?
CultDiff benchmark tests diffusion models on cultural artifacts from ten countries and adds CultDiff-S, a human-aligned image similarity metric.
-
Understanding Public Perception of Crime in Bangladesh: A Transformer-Based Approach with Explainability
Fine-tuned XLM-RoBERTa achieves 97% accuracy on a new private Bengali crime-comment sentiment dataset, though the claimed edge over prior methods is not based on shared benchmarks.
Discussion (0). Continue with ORCID to comment.