Abstract:Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based attacks, image editing-based attacks, and latent space-based attacks. However, the adversarial examples crafted by these methods often lack sufficient semantic information, making it challenging for humans to understand the failure modes of deep learning models under natural conditions. To address this limitation, we propose a natural language induced adversarial image attack method. The core idea is to leverage a text-to-image model to generate adversarial images given input prompts, which are maliciously constructed to lead to misclassification for a target model. To adopt commercial text-to-image models for synthesizing more natural adversarial images, we propose an adaptive genetic algorithm (GA) for optimizing discrete adversarial prompts without requiring gradients and an adaptive word space reduction method for improving query efficiency. We further used CLIP to maintain the semantic consistency of the generated images. In our experiments, we found that some high-frequency semantic information such as "foggy", "humid", "stretching", etc. can easily cause classifier errors. This adversarial semantic information exists not only in generated images but also in photos captured in the real world. We also found that some adversarial semantic information can be transferred to unknown classification tasks. Furthermore, our attack method can transfer to different text-to-image models (e.g., Midjourney, DALL-E 3, etc.) and image classifiers. Our code is available at: <a class="link-external link-https" href="https://github.com/zxp555/Natural-Language-Induced-Adversarial-Images" rel="external noopener nofollow">this https URL</a>.

Generate Adversarial Examples Combined with Image Entropy Distribution

The core structure of the lipopolysaccharide from the causative agent of plague, Yersinia pestis.

Generating Adversarial Examples with Adversarial Networks

Generating adversarial examples with elastic-net regularized boundary equilibrium generative adversarial network

Improved Forward-Backward Propagation To Generate Adversarial Examples

SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editing

Principal Component Adversarial Example

Are You Confident That You Have Successfully Generated Adversarial Examples?

An efficient adversarial example generation algorithm based on an accelerated gradient iterative fast gradient

Compound Adversarial Examples in Deep Neural Networks

Adversarial Examples for Semantic Segmentation and Object Detection

DCVAE-adv: A Universal Adversarial Example Generation Method for White and Black Box Attacks

Adversarial Examples Detection Beyond Image Space.

Natural Language Induced Adversarial Images

Any Target Can be Offense: Adversarial Example Generation via Generalized Latent Infection

Hlr: Generating Adversarial Examples By High-Level Representations

Adversarial Examples in Deep Learning: Characterization and Divergence

Adversarial examples: attacks and defenses in the physical world

A General Framework for Adversarial Examples with Objectives

Searching for the Essence of Adversarial Perturbations