Abstract:Detecting and recognizing deepfakes is a pressing issue in the digital age. In this study, we first collected a dataset of pristine images and fake ones properly generated by nine different Generative Adversarial Network (GAN) architectures and four Diffusion Models (DM). The dataset contained a total of 83,000 images, with equal distribution between the real and deepfake data. Then, to address different deepfake detection and recognition tasks, we proposed a hierarchical multi-level approach. At the first level, we classified real images from AI-generated ones. At the second level, we distinguished between images generated by GANs and DMs. At the third level (composed of two additional sub-levels), we recognized the specific GAN and DM architectures used to generate the synthetic data. Experimental results demonstrated that our approach achieved more than 97% classification accuracy, outperforming existing state-of-the-art methods. The models obtained in the different levels turn out to be robust to various attacks such as JPEG compression (with different quality factor values) and resize (and others), demonstrating that the framework can be used and applied in real-world contexts (such as the analysis of multimedia data shared in the various social platforms) for support even in forensic investigations in order to counter the illicit use of these powerful and modern generative models. We are able to identify the specific GAN and DM architecture used to generate the image, which is critical in tracking down the source of the deepfake. Our hierarchical multi-level approach to deepfake detection and recognition shows promising results in identifying deepfakes allowing focus on underlying task by improving (about \(2\% \) on the average) standard multiclass flat detection systems. The proposed method has the potential to enhance the performance of deepfake detection systems, aid in the fight against the spread of fake images, and safeguard the authenticity of digital media.

Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models

Mastering Deepfake Detection: A Cutting-Edge Approach to Distinguish GAN and Diffusion-Model Images

Hierarchical Supervisions with Two-Stream Network for Deepfake Detection.

DeepFake Detection by Analyzing Convolutional Traces

Fighting Deepfake by Exposing the Convolutional Traces on Images

Detecting low-resolution deepfakes: an exploration of machine learning techniques

Fighting deepfakes by detecting GAN DCT anomalies

The Face Deepfake Detection Challenge

A Contemporary Survey on Deepfake Detection: Datasets, Algorithms, and Challenges

Investigating the Evolving Landscape of Deepfake Technology: Generative AI's Role in it's Generation and Detection

Detecting fake images by identifying potential texture difference

Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection

Diffusion Deepfake

Incremental learning for the detection and classification of GAN-generated images

Deepfake Media Forensics: State of the Art and Challenges Ahead

Unmasking DeepFakes with simple Features

Deep fake video/image detection using deep learning

MaskGAN: A Facial Fusion Algorithm for Deepfake Image Detection

Image forgery detection: a survey of recent deep-learning approaches

D$^3$: Scaling Up Deepfake Detection by Learning from Discrepancy

Deepfake Detection System Using Deep Neural Networks