Abstract:In the last few years, generative models have shown their powerful capabilities in synthesizing realistic images in both quality and diversity (i.e., facial images, and natural subjects). Unfortunately, the artifact patterns in fake images synthesized by different generative models are inconsistent, leading to the failure of previous research that relied on spotting subtle differences between real and fake. In our preliminary experiments, we find that the artifacts in fake images always change with the development of the generative model, while natural images exhibit stable statistical properties. In this paper, we employ natural traces shared only by real images as an additional predictive target in the detector. Specifically, the natural traces are learned from the wild real images and we introduce extended supervised contrastive learning to bring them closer to real images and further away from fake ones. This motivates the detector to make decisions based on the proximity of images to the natural traces. To conduct a comprehensive experiment, we built a high-quality and diverse dataset that includes generative models comprising 6 GAN and 6 diffusion models, to evaluate the effectiveness in generalizing unknown forgery techniques and robustness in surviving different transformations. Experimental results show that our proposed method gives 96.1% mAP significantly outperforms the baselines. Extensive experiments conducted on the widely recognized platform Midjourney reveal that our proposed method achieves an accuracy exceeding 78.4%, underscoring its practicality for real-world application deployment. The source code and partial self-built dataset are available in supplementary material.

Unveiling Universal Forensics of Diffusion Models with Adversarial Perturbations

StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model

On the detection of synthetic images generated by diffusion models

Exposing Fake Images Generated by Text-to-image Diffusion Models

Perturbing Attention Gives You More Bang for the Buck: Subtle Imaging Perturbations That Efficiently Fool Customized Diffusion Models

Data Forensics in Diffusion Models: A Systematic Analysis of Membership Privacy

Adversarial Examples for Preventing Diffusion Models from Malicious Image Edition

Community Forensics: Using Thousands of Generators to Train Fake Image Detectors

DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models

Mist: Towards Improved Adversarial Examples for Diffusion Models

Diffusion-Generated Fake Face Detection by Exploring Wavelet Domain Forgery Clues.

Diffusion Facial Forgery Detection

Perception Matters: Exploring Imperceptible and Transferable Anti-forensics for GAN-generated Fake Face Imagery Detection

Adv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion Model

On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detection

Let Real Images be as a Judger, Spotting Fake Images Synthesized with Generative Models

From Trojan Horses to Castle Walls: Unveiling Bilateral Data Poisoning Effects in Diffusion Models

Adversarial Examples are Misaligned in Diffusion Model Manifolds

Diffusion to Confusion: Naturalistic Adversarial Patch Generation Based on Diffusion Model for Object Detector

DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protection

Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey