A Comprehensive Dataset for Human vs. AI Generated Image Detection
read the original abstract
Multimodal generative AI systems like Stable Diffusion, DALL-E, and MidJourney have fundamentally changed how synthetic images are created. These tools drive innovation but also enable the spread of misleading content, false information, and manipulated media. As generated images become harder to distinguish from photographs, detecting them has become an urgent priority. To combat this challenge, we release MS COCOAI, a novel dataset for AI generated image detection consisting of 96000 real and synthetic datapoints, built using the MS COCO dataset. To generate synthetic images, we use five generators: Stable Diffusion 3, Stable Diffusion 2.1, SDXL, DALL-E 3, and MidJourney v6. Based on the dataset, we propose two tasks: (1) classifying images as real or generated, and (2) identifying which model produced a given synthetic image. The dataset is available at https://huggingface.co/datasets/Rajarshi-Roy-research/Defactify_Image_Dataset.
This paper has not been read by Pith yet.
Forward citations
Cited by 4 Pith papers
-
When Eyes Betray AI: Social Gaze Consistency as a Semantic Cue for AI-Generated Image Detection
Social gaze consistency between interacting people is proposed as a new semantic cue orthogonal to low-level artifacts for detecting AI-generated images, with reported accuracy gains on vision and vision-language models.
-
Findings of the Counter Turing Test: AI-Generated Image Detection
The Counter Turing Test competition finds F1-scores above 0.83 for binary real-vs-AI classification but only 0.4986 at best for identifying the specific generative model.
-
Findings of the Counter Turing Test: AI-Generated Image Detection
A competition using a new 50k-image dataset found high accuracy in binary real-vs-AI detection but only modest success in identifying the exact generative model.
-
Findings of the Counter Turing Test: AI-Generated Image Detection
Binary AI vs. real image classification reaches F1 > 0.83 while identifying the exact generative model achieves a highest F1 of 0.4986 on the MS COCOAI dataset.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.