Abstract:Recent advances in diffusion models have significantly enhanced their ability to generate high-quality images and videos, but they have also increased the risk of producing unsafe content. Existing unlearning/editing-based methods for safe generation remove harmful concepts from models but face several challenges: (1) They cannot instantly remove harmful concepts without training. (2) Their safe generation capabilities depend on collected training data. (3) They alter model weights, risking degradation in quality for content unrelated to toxic concepts. To address these, we propose SAFREE, a novel, training-free approach for safe T2I and T2V, that does not alter the model's weights. Specifically, we detect a subspace corresponding to a set of toxic concepts in the text embedding space and steer prompt embeddings away from this subspace, thereby filtering out harmful content while preserving intended semantics. To balance the trade-off between filtering toxicity and preserving safe concepts, SAFREE incorporates a novel self-validating filtering mechanism that dynamically adjusts the denoising steps when applying the filtered embeddings. Additionally, we incorporate adaptive re-attention mechanisms within the diffusion latent space to selectively diminish the influence of features related to toxic concepts at the pixel level. In the end, SAFREE ensures coherent safety checking, preserving the fidelity, quality, and safety of the output. SAFREE achieves SOTA performance in suppressing unsafe content in T2I generation compared to training-free baselines and effectively filters targeted concepts while maintaining high-quality images. It also shows competitive results against training-based methods. We extend SAFREE to various T2I backbones and T2V tasks, showcasing its flexibility and generalization. SAFREE provides a robust and adaptable safeguard for ensuring safe visual generation.

SafetyDPO: Scalable Safety Alignment for Text-to-Image Generation

Direct Unlearning Optimization for Robust and Safe Text-to-Image Models

Scalable Ranked Preference Optimization for Text-to-Image Generation

Latent Guard: a Safety Framework for Text-to-image Generation

Safeguarding Text-to-Image Generation via Inference-Time Prompt-Noise Optimization

Universal Prompt Optimizer for Safe Text-to-Image Generation

SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation

Safety Alignment Backfires: Preventing the Re-emergence of Suppressed Concepts in Fine-tuned Text-to-Image Diffusion Models

SteerDiff: Steering towards Safe Text-to-Image Diffusion Models

GuardT2I: Defending Text-to-Image Models from Adversarial Prompts

Harm Amplification in Text-to-Image Models

ART: Automatic Red-teaming for Text-to-Image Models to Protect Benign Users

Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation

SEE-DPO: Self Entropy Enhanced Direct Preference Optimization

Knowledge-Driven Generative Adversarial Network for Text-to-Image Synthesis

Safe to Serve: Aligning Instruction-Tuned Models for Safety and Helpfulness

SePPO: Semi-Policy Preference Optimization for Diffusion Alignment

SafeGen: Mitigating Sexually Explicit Content Generation in Text-to-Image Models

Safety Without Semantic Disruptions: Editing-free Safe Image Generation via Context-preserving Dual Latent Reconstruction

UPAM: Unified Prompt Attack in Text-to-Image Generation Models Against Both Textual Filters and Visual Checkers

T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models