Abstract:Diffusion models for text-to-image (T2I) synthesis, such as Stable Diffusion (SD), have recently demonstrated exceptional capabilities for generating high-quality content. However, this progress has raised several concerns of potential misuse, particularly in creating copyrighted, prohibited, and restricted content, or NSFW (not safe for work) images. While efforts have been made to mitigate such problems, either by implementing a safety filter at the evaluation stage or by fine-tuning models to eliminate undesirable concepts or styles, the effectiveness of these safety measures in dealing with a wide range of prompts remains largely unexplored. In this work, we aim to investigate these safety mechanisms by proposing one novel concept retrieval algorithm for evaluation. We introduce Ring-A-Bell, a model-agnostic red-teaming tool for T2I diffusion models, where the whole evaluation can be prepared in advance without prior knowledge of the target model. Specifically, Ring-A-Bell first performs concept extraction to obtain holistic representations for sensitive and inappropriate concepts. Subsequently, by leveraging the extracted concept, Ring-A-Bell automatically identifies problematic prompts for diffusion models with the corresponding generation of inappropriate content, allowing the user to assess the reliability of deployed safety mechanisms. Finally, we empirically validate our method by testing online services such as Midjourney and various methods of concept removal. Our results show that Ring-A-Bell, by manipulating safe prompting benchmarks, can transform prompts that were originally regarded as safe to evade existing safety mechanisms, thus revealing the defects of the so-called safety mechanisms which could practically lead to the generation of harmful contents. Our codes are available at <a class="link-external link-https" href="https://github.com/chiayi-hsu/Ring-A-Bell" rel="external noopener nofollow">this https URL</a>.

Removing Undesirable Concepts in Text-to-Image Diffusion Models with Learnable Prompts

Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation

Ablating Concepts in Text-to-Image Diffusion Models

Erasing Concepts from Diffusion Models

EIUP: A Training-Free Approach to Erase Non-Compliant Concepts Conditioned on Implicit Unsafe Prompts

All but One: Surgical Concept Erasing with Model Preservation in Text-to-Image Diffusion Models

Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models

Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Models

Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers

Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient

Pruning for Robust Concept Erasing in Diffusion Models

ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning

Continuous Concepts Removal in Text-to-image Diffusion Models

Probing Unlearned Diffusion Models: A Transferable Adversarial Attack Perspective

Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?

Implicit Concept Removal of Diffusion Models

Erasing Concepts from Text-to-Image Diffusion Models with Few-shot Unlearning

Erasing Undesirable Influence in Diffusion Models

Unstable Unlearning: The Hidden Risk of Concept Resurgence in Diffusion Models

Unlearning or Concealment? A Critical Analysis and Evaluation Metrics for Unlearning in Diffusion Models