Abstract:Although the recent advancement in generative models brings diverse advantages to society, it can also be abused with malicious purposes, such as fraud, defamation, and fake news. To prevent such cases, vigorous research is conducted to distinguish the generated images from the real images, but challenges still remain to distinguish the unseen generated images outside of the training settings. Such limitations occur due to data dependency arising from the model's overfitting issue to the training data generated by specific GANs. To overcome this issue, we adopt a self-supervised scheme to propose a novel framework. Our proposed method is composed of the artificial fingerprint generator reconstructing the high-quality artificial fingerprints of GAN images for detailed analysis, and the GAN detector distinguishing GAN images by learning the reconstructed artificial fingerprints. To improve the generalization of the artificial fingerprint generator, we build multiple autoencoders with different numbers of upconvolution layers. With numerous ablation studies, the robust generalization of our method is validated by outperforming the generalization of the previous state-of-the-art algorithms, even without utilizing the GAN images of the training dataset.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: How to improve the generalization ability of GAN detectors to recognize images generated by unknown or unseen GAN models without relying on image data generated by specific Generative Adversarial Networks (GANs). Current GAN detection methods are often over - fitted to the training data, resulting in a decline in performance when facing new GAN models or categories. To solve this problem, the paper proposes a self - supervised framework, which consists of an artificial fingerprint generator and a GAN detector, aiming to enhance the generalization ability of the detector by reconstructing high - quality artificial fingerprints, so that it can effectively distinguish between real images and GAN - generated images, even if these GAN models have not appeared during the training process. Specifically, the paper solves the above problems through the following points: 1. **Self - supervised learning scheme**: In order to overcome the data - dependence problem of existing GAN detectors, the paper adopts a self - supervised learning scheme. This method allows the model to be trained only with real images without any GAN - generated images, thereby improving the generalization ability of the model. 2. **Artificial fingerprint generator**: The paper designs an artificial fingerprint generator containing multiple auto - encoders. These auto - encoders have different numbers of up - sampling layers and can effectively reconstruct the artificial fingerprints in images generated by different GAN models. This design enables the generator to produce diverse features related to multiple GAN models, enhancing the robustness of the detector. 3. **GAN detector**: Based on the images reconstructed by the artificial fingerprint generator, the GAN detector is trained to distinguish between real images and generated images. By using the mixup algorithm, the detector can learn a wider range of feature combinations, further improving its generalization performance. Through these innovations, the method proposed in the paper achieves high - precision detection of unseen GAN models and categories without using any GAN - generated images, significantly outperforming existing GAN detection techniques. This provides strong technical support for preventing GAN - generated images from being maliciously exploited.

Self-supervised GAN Detector

No One Can Escape: A General Approach to Detect Tampered and Generated Image

T-GD: Transferable GAN-generated Images Detection Framework

Towards Robust GAN-generated Image Detection: a Multi-view Completion Representation

Learning to Disentangle GAN Fingerprint for Fake Image Attribution

Misleading Deep-Fake Detection with GAN Fingerprints

General GAN-generated image detection by data augmentation in fingerprint domain

Detecting GAN generated errors

Towards Discovery and Attribution of Open-world GAN Generated Images

ExS-GAN: Synthesizing Anti-Forensics Images via Extra Supervised GAN

Efficient GAN-based method for cyber-intrusion detection

Deep Learning Based One-Class Detection System for Fake Faces Generated by GAN Network

FD-GAN: Generalizable and Robust Forgery Detection via Generative Adversarial Networks

Fingerprinting Image-to-Image Generative Adversarial Networks

Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints

AI vs. AI: Can AI Detect AI-Generated Images?

Detecting GAN-generated Images by Orthogonal Training of Multiple CNNs

Distant Pedestrian Detection in the Wild using Single Shot Detector with Deep Convolutional Generative Adversarial Networks

Let Real Images be as a Judger, Spotting Fake Images Synthesized with Generative Models

Detection, Attribution and Localization of GAN Generated Images

Estimation of Fractal Dimension and Detection of Fake Finger-Vein Images for Finger-Vein Recognition