Abstract:Recent advances in generative models and the availability of large-scale benchmarks have made deepfake video generation and manipulation easier. Nowadays, the number of new hyper-realistic deepfake videos used for negative purposes is dramatically increasing, thus creating the need for effective deepfake detection methods. Although many existing deepfake detection approaches, particularly CNN-based methods, show promising results, they suffer from several drawbacks. In general, poor generalization results have been obtained under unseen/new deepfake generation methods. The crucial reason for the above defect is that CNN-based methods focus on the local spatial artifacts, which are unique for every manipulation method. Therefore, it is hard to learn the general forgery traces of different manipulation methods without considering the dependencies that extend beyond the local receptive field. To address this problem, this paper proposes a framework that combines aper proposes a framework that combines with Vision Transformer (ViT) to improve detection accuracy and enhance generalizability. Our method, named HCiT , exploits the advantages of CNNs to extract meaningful local features, as well as the VIT’s self-attention mechanism to learn discriminative global contextual dependencies in a frame-level image explicitly. In this hybrid architecture, the high-level feature maps extracted from the CNN are fed into the ViT model that determines whether a specific video is fake or real. Experiments were performed on Faceforensics++, DeepFake Detection Challenge preview, Celeb datasets, and the results show that the proposed method significantly outperforms the state-of-the-art methods. In addition, the HCiT method shows a great capacity for generalization on datasets covering various techniques of deepfake generation. The source code is available at: https://github.com/KADDAR-Bachir/HCiT

DeepFake detection algorithm based on improved vision transformer

Deepfake Detection Scheme Based on Vision Transformer and Distillation

Deepfake Video Detection Using Convolutional Vision Transformer

DFDT: An End-to-End DeepFake Detection Framework Using Vision Transformer

Hybrid Transformer Network for Deepfake Detection

Deep Convolutional Pooling Transformer for Deepfake Detection

Combining EfficientNet and Vision Transformers for Video Deepfake Detection

FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detection

Deepfake detection using convolutional vision transformers and convolutional neural networks

Cross-Forgery Analysis of Vision Transformers and CNNs for Deepfake Image Detection

Transformer-based cascade networks with spatial and channel reconstruction convolution for deepfake detection

An efficient deepfake video detection using robust deep learning

Real-Time Advanced Computational Intelligence for Deep Fake Video Detection

Deepfake Detection Using Spatiotemporal Transformer

Deepfake Detection with Deep Learning: Convolutional Neural Networks versus Transformers

Adt: anti-deepfake transformer

DeepFake detection method based on multi-scale interactive dual-stream network

Multi-feature fusion based face forgery detection with local and global characteristics

A Performance Enhancement of Deepfake Video Detection through the use of a Hybrid CNN Deep Learning Model

FakeTransformer: Exposing Face Forgery From Spatial-Temporal Representation Modeled By Facial Pixel Variations

Deepfake Video Detection with Spatiotemporal Dropout Transformer