Abstract:In recent years, the field of artificial intelligence has witnessed a remarkable surge in the generation of synthetic images, driven by advancements in deep learning techniques. These synthetic images, often created through complex algorithms, closely mimic real photographs, blurring the lines between reality and artificiality. This proliferation of synthetic visuals presents a pressing challenge: how to accurately and reliably distinguish between genuine and generated images. This article, in particular, explores the task of detecting images generated by text-to-image diffusion models, highlighting the challenges and peculiarities of this field. To evaluate this, we consider images generated from captions in the MSCOCO and Wikimedia datasets using two state-of-the-art models: Stable Diffusion and GLIDE. Our experiments show that it is possible to detect the generated images using simple multi-layer perceptrons (MLPs), starting from features extracted by CLIP or RoBERTa, or using traditional convolutional neural networks (CNNs). These latter models achieve remarkable performances in particular when pretrained on large datasets. We also observe that models trained on images generated by Stable Diffusion can occasionally detect images generated by GLIDE, but only on the MSCOCO dataset. However, the reverse is not true. Lastly, we find that incorporating the associated textual information with the images in some cases can lead to a better generalization capability, especially if textual features are closely related to visual ones. We also discovered that the type of subject depicted in the image can significantly impact performance. This work provides insights into the feasibility of detecting generated images and has implications for security and privacy concerns in real-world applications. The code to reproduce our results is available at: https://github.com/davide-coccomini/Detecting-Images-Generated-by-Diffusers.

Detecting AI-Generated Images via CLIP

Improving Interpretability and Robustness for the Detection of AI-Generated Images

Raising the Bar of AI-generated Image Detection with CLIP

Fake It Until You Break It: On the Adversarial Robustness of AI-generated Image Detectors

AIGC Image Quality Assessment Via Image-Prompt Correspondence

CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIP

Exploring the Adversarial Robustness of CLIP for AI-generated Image Detection

AI vs. AI: Can AI Detect AI-Generated Images?

AI-Generated Image Detection using a Cross-Attention Enhanced Dual-Stream Network

A Sanity Check for AI-generated Image Detection

Transfer Learning-Based Models for Comparative Evaluation for the Detection of AI-Generated Images

Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks

PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detection

Detecting Artificial Intelligence-Generated Images Via Deep Trace Representations and Interactive Feature Fusion

Enhancing Interpretability in AI-Generated Image Detection with Genetic Programming

Detection of AI-Generated Synthetic Images with a Lightweight CNN

Mixture of Low-rank Experts for Transferable AI-Generated Image Detection

Detecting images generated by diffusers

ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scale

C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detection