FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces

Run Wang,Felix Juefei-Xu,Lei Ma,Xiaofei Xie,Yihao Huang,Jian Wang,Yang Liu

DOI: https://doi.org/10.48550/arXiv.1909.06122

2020-07-16

Abstract:In recent years, generative adversarial networks (GANs) and its variants have achieved unprecedented success in image synthesis. They are widely adopted in synthesizing facial images which brings potential security concerns to humans as the fakes spread and fuel the misinformation. However, robust detectors of these AI-synthesized fake faces are still in their infancy and are not ready to fully tackle this emerging challenge. In this work, we propose a novel approach, named FakeSpotter, based on monitoring neuron behaviors to spot AI-synthesized fake faces. The studies on neuron coverage and interactions have successfully shown that they can be served as testing criteria for deep learning systems, especially under the settings of being exposed to adversarial attacks. Here, we conjecture that monitoring neuron behavior can also serve as an asset in detecting fake faces since layer-by-layer neuron activation patterns may capture more subtle features that are important for the fake detector. Experimental results on detecting four types of fake faces synthesized with the state-of-the-art GANs and evading four perturbation attacks show the effectiveness and robustness of our approach.

Cryptography and Security,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: With the rapid development of Generative Adversarial Networks (GANs) and their variants in the field of image synthesis, especially the synthesis of facial images, these techniques bring potential security risks. AI - synthesized fake faces can not only deceive the human eye, but may also be misused to create false information, violate privacy and commit identity fraud. However, the existing methods for detecting these AI - synthesized fake faces are not yet mature and robust enough to fully meet this emerging challenge.

Specifically, this paper proposes a new method - **FakeSpotter**, which detects AI - synthesized fake faces by monitoring the neuron behavior in the deep face recognition system. The author believes that the layer - by - layer neuron activation pattern can capture more subtle features, thus effectively distinguishing between real and fake facial images.

### Main problem summary:
1. **Security and privacy issues**: AI - synthesized fake faces may be used to create false information, violate privacy and commit identity fraud.
2. **Deficiencies of existing detection methods**: Current detection methods are not yet mature, and it is difficult to effectively deal with multiple types of fake faces, and they are not robust enough against perturbation attacks (such as noise, blurring, etc.).
3. **Need for new methods**: A more robust and effective detection method is required to identify AI - synthesized fake faces, especially when facing different types of fake faces and perturbation attacks.

### Core contributions of the paper:
- Propose a new method based on neuron behavior monitoring - **FakeSpotter** for detecting AI - synthesized fake faces.
- Verify the effectiveness of this method in detecting four typical types of fake faces (overall synthesis, attribute editing, expression manipulation, DeepFake) through experiments, and demonstrate its robustness against four common perturbation attacks (compression, scaling, adding noise, blurring).
- Provide a higher detection accuracy and a lower false positive rate than existing methods (such as AutoGAN).

### Formula representation:
- **Calculation formula of Neuron Coverage (MNC)**:
\[
\xi_l=\frac{\sum_{n\in N, t\in T}\delta(n, t)}{|N|\cdot|T|}
\]
where \( N \) represents the set of neurons in the \( l \) - th layer, \( |N| \) is the total number of neurons in this layer, \( T \) is the set of training inputs, \( |T| \) is the number of training inputs, and \( \delta(n, t) \) calculates the output value of neuron \( n \) under input \( t \).

- **Definition of Neuron Coverage Criterion (MNC)**:
\[
MNC(l, t)=\left|\{n\mid\forall n\in l, \delta(n, t)>\xi_l\}\right|
\]
where \( t \) represents the input, \( n \) is the neuron in the \( l \) - th layer, \( \delta \) is the function for calculating the neuron output value, and \( \xi_l \) is the threshold of the \( l \) - th layer calculated according to formula (1).

Through this method, FakeSpotter can detect AI - synthesized fake faces more effectively and show stronger robustness when facing different types of perturbation attacks.