Abstract:The recent advances in diffusion models (DMs) have revolutionized the generation of realistic and complex images. However, these models also introduce potential safety hazards, such as producing harmful content and infringing data copyrights. Despite the development of safety-driven unlearning techniques to counteract these challenges, doubts about their efficacy persist. To tackle this issue, we introduce an evaluation framework that leverages adversarial prompts to discern the trustworthiness of these safety-driven DMs after they have undergone the process of unlearning harmful concepts. Specifically, we investigated the adversarial robustness of DMs, assessed by adversarial prompts, when eliminating unwanted concepts, styles, and objects. We develop an effective and efficient adversarial prompt generation approach for DMs, termed UnlearnDiffAtk. This method capitalizes on the intrinsic classification abilities of DMs to simplify the creation of adversarial prompts, thereby eliminating the need for auxiliary classification or diffusion models. Through extensive benchmarking, we evaluate the robustness of widely-used safety-driven unlearned DMs (i.e., DMs after unlearning undesirable concepts, styles, or objects) across a variety of tasks. Our results demonstrate the effectiveness and efficiency merits of UnlearnDiffAtk over the state-of-the-art adversarial prompt generation method and reveal the lack of robustness of current safetydriven unlearning techniques when applied to DMs. Codes are available at <a class="link-external link-https" href="https://github.com/OPTML-Group/Diffusion-MU-Attack" rel="external noopener nofollow">this https URL</a>. WARNING: There exist AI generations that may be offensive in nature.

Intriguing Properties of Diffusion Models: An Empirical Study of the Natural Attack Capability in Text-to-Image Generative Models

Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey

Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitation

Pixel Is Not A Barrier: An Effective Evasion Attack for Pixel-Domain Diffusion Models

Adv-BDPM: Adversarial Attack Based on Boundary Diffusion Probability Model.

Diffusion to Confusion: Naturalistic Adversarial Patch Generation Based on Diffusion Model for Object Detector

How to Backdoor Diffusion Models?

Natural Adversarial Patch Generation Method Based on Latent Diffusion Model

Diffusion Models for Imperceptible and Transferable Adversarial Attack

Exposing the Fake: Effective Diffusion-Generated Images Detection

To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now

Revealing Vulnerabilities in Stable Diffusion via Targeted Attacks

Evaluating the Robustness of Text-to-image Diffusion Models against Real-world Attacks

The Uncanny Valley: A Comprehensive Analysis of Diffusion Models

Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey

Perturbing Attention Gives You More Bang for the Buck: Subtle Imaging Perturbations That Efficiently Fool Customized Diffusion Models

AdvDenoise: Fast Generation Framework of Universal and Robust Adversarial Patches Using Denoise

Defending Text-to-image Diffusion Models: Surprising Efficacy of Textual Perturbations Against Backdoor Attacks

DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models

Invisible Backdoor Attacks on Diffusion Models

StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model