Abstract:The rapid development and widespread dissemination of deepfake techniques has caused increased concern.The malicious application of deepfake techniques also poses a potential threat to the society.Therefore, how to detect deepfake content has become a popular research topic.Most of the previous deepfake detection algorithms focused on capturing subtle forgery traces at pixel level and have achieved some results.However, most of the deepfake algorithms ignore the lighting information before and after generation, resulting in some lighting inconsistency between the original face and the forged face, which provided the possibility of using lighting inconsistency to detect deepfake.A corresponding algorithm was designed from two perspectives: introducing lighting inconsistency information and designing a network structure module for a specific task.For the introduction of lighting task, a new network structure was derived by designing the corresponding channel fusion method to provide more lighting inconsistency information to the network feature extraction layer.In order to ensure the portability of the network structure, the process of feature channel fusion was placed before the network extraction information, so that the proposed method can be fully planted to common deepfake detection networks.For the design of the network structure, a deepfake detection method was proposed for lighting inconsistency based on patch-similarity from two perspectives: network structure and loss function design.For the network structure, based on the characteristic of inconsistency between the forged image tampering region and the background region, the extracted features were chunked in the network feature layer and the feature layer similarity matrix was obtained by comparing the patch-wise cosine similarity to make the network focus more on the lighting inconsistency.On this basis, based on the feature layer similarity matching scheme, an independent ground truth and loss function was designed for this task in a targeted manner by comparing the input image with the untampered image of this image for patch-wise authenticity.It is demonstrated experimentally that the accuracy of the proposed method is significantly improved for deepfake detection compared with the baseline method.

Deepfake Detection Via Inter-Frame Inconsistency Recomposition and Enhancement

Hierarchical Supervisions with Two-Stream Network for Deepfake Detection.

Dynamic Inconsistency-aware DeepFake Video Detection

Unearthing Common Inconsistency for Generalisable Deepfake Detection

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

Deepfake Detection Method Based on Patch-Wise Lighting Inconsistency

Delving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection

FInfer: Frame Inference-Based Deepfake Detection for High-Visual-Quality Videos

Learning a Deep Dual-Level Network for Robust DeepFake Detection

DeepFake detection method based on multi-scale interactive dual-stream network

Exploiting Complementary Dynamic Incoherence for DeepFake Video Detection

LIDeepDet: Deepfake Detection via Image Decomposition and Advanced Lighting Information Analysis

Interactive Two-Stream Network Across Modalities for Deepfake Detection

Dynamic Difference Learning with Spatio-temporal Correlation for Deepfake Video Detection

Multi-feature fusion based face forgery detection with local and global characteristics

Capturing the Lighting Inconsistency for Deepfake Detection.

Preserving manipulated and synthetic Deepfake detection through face texture naturalness

Deepfake detection: Enhancing performance with spatiotemporal texture and deep learning feature fusion

Multi-attentional Deepfake Detection

Noise-aware progressive multi-scale deepfake detection

Improving Deepfake Detection Generalization by Invariant Risk Minimization