Abstract:As the remarkable development of facial manipulation technologies is accompanied by severe security concerns, face forgery detection has become a recent research hotspot. Most existing detection methods train a binary classifier under global supervision to judge real or fake. However, advanced manipulations only perform small-scale tampering, posing challenges to comprehensively capture subtle and local forgery artifacts, especially in high compression settings and cross-dataset scenarios. To address such limitations, we propose a novel framework named Multi-modal Contrastive Classification by Locally Correlated Representations(MC-LCR), for effective face forgery detection. Instead of specific appearance features, our MC-LCR aims to amplify implicit local discrepancies between authentic and forged faces from both spatial and frequency domains. Specifically, we design the shallow style representation block that measures the pairwise correlation of shallow feature maps, which encodes local style information to extract more discriminative features in the spatial domain. Moreover, we make a key observation that subtle forgery artifacts can be further exposed in the patch-wise phase and amplitude spectrum and exhibit different clues. According to the complementarity of amplitude and phase information, we develop a patch-wise amplitude and phase dual attention module to capture locally correlated inconsistencies with each other in the frequency domain. Besides the above two modules, we further introduce the collaboration of supervised contrastive loss with cross-entropy loss. It helps the network learn more discriminative and generalized representations. Through extensive experiments and comprehensive studies, we achieve state-of-the-art performance and demonstrate the robustness and generalization of our method.

Contrast Enhancement Forensics Based on Modified Convolutional Neural Network

Contrast Enhancement For Image With Incomplete Beta Transform And Wavelet Neural Network

Dual-Domain Fusion Convolutional Neural Network for Contrast Enhancement Forensics

Robust Contrast Enhancement Forensics Using Pixel and Histogram Domain CNNs

Contrast Enhancement-Based Forensics in Digital Images

Contrast Enhancement Estimation for Digital Image Forensics

Low-Light Image Enhancement Based on Deep Convolutional Neural Network

Exposing image forgery through the detection of contrast enhancement

Image Processing Operations Identification via Convolutional Neural Network

A multi-purpose image forensic method using densely connected convolutional neural networks

Detecting Colorized Images via Convolutional Neural Networks: Toward High Accuracy and Good Generalization

Enhancement Algorithm for Color Images Based on Improved FC-MSPCNN

Coarse-to-fine spatial-channel-boundary attention network for image copy-move forgery detection

High dynamic range image forensics using cnn

Detection of Computer Graphics Using Attention-Based Dual-Branch Convolutional Neural Network from Fused Color Components

CECL-Net: Contrastive Learning and Edge-Reconstruction-Driven Complementary Learning Network for Image Forgery Localization

SharpenNet: Detecting Anti-Forensics USM Sharpening Adversarial Examples Based on ConvNeXt

Contrast Modification Forensics Algorithm Based on Merged Weight Histogram of Run Length

MC-LCR: Multimodal contrastive classification by locally correlated representations for effective face forgery detection

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

Llcnn: A Convolutional Neural Network For Low-Light Image Enhancement