Abstract:With the rise of Foundation models, Text-to-Image models, as one of its important branches, have been increasingly applied. While focusing on the impressive generation capabilities of these models, it is also crucial to pay attention to the robustness of the models against attacks. In this paper, we shift our focus towards studying the vulnerability of Text-to-Image (T2I) models. To this end, we propose a black-box attack method and demonstrate that T2I models are susceptible to adversarial text attacks. Specifically, this method can disrupt T2I models by making subtle modifications to the model’s input (i.e., prompt) without accessing the model parameters, resulting in the generation of incorrect images. It is worth mentioning that we discovered the ability to switch different types of tokenizers within this black-box framework to handle text, furthermore, this attack framework can be applied to target different versions of T2I models. The experiments indicate that the images generated through adversarial text exhibit noticeable errors. We also employ CLIP score, a metric used to evaluate the similarity between images and image descriptions, to assess the results. The findings demonstrate a significant decrease in the visual-textual similarity after the model is subjected to attacks. Additionally, we have identified a specific type of error that T2I models tend to make when facing attacks – when confronted with unrecognizable text, the model often interprets it as human-related content. This paper not only highlights the vulnerability of T2I models to adversarial text attacks but also further discusses potential methods that could enhance the robustness of these attack techniques. This provides a valuable reference for future research directions in this field.

HTS-Attack: Heuristic Token Search for Jailbreaking Text-to-Image Models

Perception-guided Jailbreak against Text-to-Image Models

Jailbreaking Prompt Attack: A Controllable Adversarial Attack against Diffusion Models

Multimodal Pragmatic Jailbreak on Text-to-image Models

The Art of Deception: Black-box Attack Against Text-to-Image Diffusion Model

Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step

Automatic Jailbreaking of the Text-to-Image Generative AI Systems

UPAM: Unified Prompt Attack in Text-to-Image Generation Models Against Both Textual Filters and Visual Checkers

Asymmetric Bias in Text-to-Image Generation with Adversarial Attacks

Jailbreaking Text-to-Image Models with LLM-Based Agents

Divide-and-Conquer Attack: Harnessing the Power of LLM to Bypass Safety Filters of Text-to-Image Models

T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models

One Prompt to Verify Your Models: Black-Box Text-to-Image Models Verification via Non-Transferable Adversarial Attacks

EvilEdit: Backdooring Text-to-Image Diffusion Models in One Second

GuardT2I: Defending Text-to-Image Models from Adversarial Prompts

Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation

Combinational Backdoor Attack against Customized Text-to-Image Models

Adversarial Attacks on Parts of Speech: An Empirical Study in Text-to-Image Generation

Antelope: Potent and Concealed Jailbreak Attack Strategy

IDEATOR: Jailbreaking Large Vision-Language Models Using Themselves

ImgTrojan: Jailbreaking Vision-Language Models with ONE Image