ImagiNet: A Multi-Content Dataset for Generalizable Synthetic Image Detection via Contrastive Learning

Delyan Boychev,Radostin Cholakov

2024-07-29

Abstract:Generative models, such as diffusion models (DMs), variational autoencoders (VAEs), and generative adversarial networks (GANs), produce images with a level of authenticity that makes them nearly indistinguishable from real photos and artwork. While this capability is beneficial for many industries, the difficulty of identifying synthetic images leaves online media platforms vulnerable to impersonation and misinformation attempts. To support the development of defensive methods, we introduce ImagiNet, a high-resolution and balanced dataset for synthetic image detection, designed to mitigate potential biases in existing resources. It contains 200K examples, spanning four content categories: photos, paintings, faces, and uncategorized. Synthetic images are produced with open-source and proprietary generators, whereas real counterparts of the same content type are collected from public datasets. The structure of ImagiNet allows for a two-track evaluation system: i) classification as real or synthetic and ii) identification of the generative model. To establish a baseline, we train a ResNet-50 model using a self-supervised contrastive objective (SelfCon) for each track. The model demonstrates state-of-the-art performance and high inference speed across established benchmarks, achieving an AUC of up to 0.99 and balanced accuracy ranging from 86% to 95%, even under social network conditions that involve compression and resizing. Our data and code are available at <a class="link-external link-https" href="https://github.com/delyan-boychev/imaginet" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The paper mainly addresses two core issues:

1. **Generalization ability of synthetic image detection**: With the development of generative models (such as diffusion models, variational autoencoders, and generative adversarial networks), the images they produce are becoming increasingly difficult to distinguish from real photos and artworks. This has led to an increased risk of identity theft and misinformation on online media platforms. To support the development of defensive methods, the authors introduce a new dataset called ImagiNet, which aims to improve the generalization ability of synthetic image detection models by including high-resolution images of various content categories (photos, paintings, faces, and other uncategorized content) and mitigating potential biases in existing resources.

2. **Choice of training techniques**: Previous research has used standard classification training methods for the task of synthetic image detection, but these methods face issues such as overfitting, lack of reliability, or bias towards different types of content when encountering new types of generators. Therefore, the authors propose a contrastive learning-based training technique—Self-Contrastive Learning (SelfCon)—to improve the model's performance in detecting synthetic images generated by unknown generators.

In short, the paper aims to enhance the generalization ability and detection accuracy of synthetic image detection models by constructing a diverse and balanced synthetic image dataset, ImagiNet, and adopting an efficient contrastive learning method.