Detecting Generated Images by Real Images Only

Xiuli Bi,Bo Liu,Fan Yang,Bin Xiao,Weisheng Li,Gao Huang,Pamela C. Cosman

2023-11-02

Abstract:As deep learning technology continues to evolve, the images yielded by generative models are becoming more and more realistic, triggering people to question the authenticity of images. Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This learning paradigm will result in efficiency and generalization issues, making detection methods always lag behind generation methods. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace. As a result, images from different generative models can be detected, solving some long-existing problems in the field. Experimental results show that although our method was trained only by real images and uses 99.9\% less training data than other deep learning-based methods, it can compete with state-of-the-art methods and shows excellent performance in detecting emerging generative models with high inference efficiency. Moreover, the proposed method shows robustness against various post-processing. These advantages allow the method to be used in real-world scenarios.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper aims to address the problem of detecting generated images, specifically how to distinguish between real images and those generated by models such as Generative Adversarial Networks (GANs), flow models, and diffusion models. Existing methods mostly rely on specific visual artifacts of generated images or learn discriminative features from a large number of real and generated images. These methods face efficiency and generalization issues when dealing with new types of generative models.

This paper proposes a new perspective, detecting generated images starting from real images. By identifying commonalities in real images and mapping them to a dense subspace in the feature space, generated images are projected outside this subspace regardless of the type of generative model. This approach can detect images generated by different models and has high inference efficiency. Experimental results show that although this method is trained using only real images and requires far less data than other deep learning methods, it can still compete with state-of-the-art methods, performing excellently in detecting emerging generative models and being robust to various post-processing operations. Therefore, this method can be applied in real-world scenarios.