Abstract:With the rise of Foundation models, Text-to-Image models, as one of its important branches, have been increasingly applied. While focusing on the impressive generation capabilities of these models, it is also crucial to pay attention to the robustness of the models against attacks. In this paper, we shift our focus towards studying the vulnerability of Text-to-Image (T2I) models. To this end, we propose a black-box attack method and demonstrate that T2I models are susceptible to adversarial text attacks. Specifically, this method can disrupt T2I models by making subtle modifications to the model’s input (i.e., prompt) without accessing the model parameters, resulting in the generation of incorrect images. It is worth mentioning that we discovered the ability to switch different types of tokenizers within this black-box framework to handle text, furthermore, this attack framework can be applied to target different versions of T2I models. The experiments indicate that the images generated through adversarial text exhibit noticeable errors. We also employ CLIP score, a metric used to evaluate the similarity between images and image descriptions, to assess the results. The findings demonstrate a significant decrease in the visual-textual similarity after the model is subjected to attacks. Additionally, we have identified a specific type of error that T2I models tend to make when facing attacks – when confronted with unrecognizable text, the model often interprets it as human-related content. This paper not only highlights the vulnerability of T2I models to adversarial text attacks but also further discusses potential methods that could enhance the robustness of these attack techniques. This provides a valuable reference for future research directions in this field.

Defending Text-to-image Diffusion Models: Surprising Efficacy of Textual Perturbations Against Backdoor Attacks

Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoning

Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey

T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models

Evaluating the Robustness of Text-to-image Diffusion Models against Real-world Attacks

EvilEdit: Backdooring Text-to-Image Diffusion Models in One Second

Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Models

The Art of Deception: Black-box Attack Against Text-to-Image Diffusion Model

Invisible Backdoor Attacks on Diffusion Models

Revealing Vulnerabilities in Stable Diffusion via Targeted Attacks

DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing

Combinational Backdoor Attack against Customized Text-to-Image Models

Backdooring Bias into Text-to-Image Models

TrojanEdit: Backdooring Text-Based Image Editing Models

DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models

Targeted Attack Improves Protection against Unauthorized Diffusion Customization

Exploiting Watermark-Based Defense Mechanisms in Text-to-Image Diffusion Models for Unauthorized Data Usage

The Stronger the Diffusion Model, the Easier the Backdoor: Data Poisoning to Induce Copyright Breaches Without Adjusting Finetuning Pipeline

TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors

Perturbing Attention Gives You More Bang for the Buck: Subtle Imaging Perturbations That Efficiently Fool Customized Diffusion Models