Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propaganda

Ahmad Qadi; Areej Jaber; Lina Duaibes; Mais Qandeel; Mustafa Jarrar

Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propaganda

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.09327 v1 pith:PNO7EW22 submitted 2024-07-12 cs.AI cs.CL

Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propaganda

Lina Duaibes , Areej Jaber , Mustafa Jarrar , Ahmad Qadi , Mais Qandeel This is my paper

classification cs.AI cs.CL

keywords biascorpuspropagandapostsannotatedannotationsfignewsmedia

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

read the original abstract

The proliferation of bias and propaganda on social media is an increasingly significant concern, leading to the development of techniques for automatic detection. This article presents a multilingual corpus of 12, 000 Facebook posts fully annotated for bias and propaganda. The corpus was created as part of the FigNews 2024 Shared Task on News Media Narratives for framing the Israeli War on Gaza. It covers various events during the War from October 7, 2023 to January 31, 2024. The corpus comprises 12, 000 posts in five languages (Arabic, Hebrew, English, French, and Hindi), with 2, 400 posts for each language. The annotation process involved 10 graduate students specializing in Law. The Inter-Annotator Agreement (IAA) was used to evaluate the annotations of the corpus, with an average IAA of 80.8% for bias and 70.15% for propaganda annotations. Our team was ranked among the bestperforming teams in both Bias and Propaganda subtasks. The corpus is open-source and available at https://sina.birzeit.edu/fada

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks
cs.LG 2025-02 unverdicted novelty 6.0

Empirical study across 10 tasks showing bias inheritance from LLM-augmented data harms related downstream performance, with three misalignment factors and three mitigation strategies identified.