Abstract:Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based attacks, image editing-based attacks, and latent space-based attacks. However, the adversarial examples crafted by these methods often lack sufficient semantic information, making it challenging for humans to understand the failure modes of deep learning models under natural conditions. To address this limitation, we propose a natural language induced adversarial image attack method. The core idea is to leverage a text-to-image model to generate adversarial images given input prompts, which are maliciously constructed to lead to misclassification for a target model. To adopt commercial text-to-image models for synthesizing more natural adversarial images, we propose an adaptive genetic algorithm (GA) for optimizing discrete adversarial prompts without requiring gradients and an adaptive word space reduction method for improving query efficiency. We further used CLIP to maintain the semantic consistency of the generated images. In our experiments, we found that some high-frequency semantic information such as "foggy", "humid", "stretching", etc. can easily cause classifier errors. This adversarial semantic information exists not only in generated images but also in photos captured in the real world. We also found that some adversarial semantic information can be transferred to unknown classification tasks. Furthermore, our attack method can transfer to different text-to-image models (e.g., Midjourney, DALL-E 3, etc.) and image classifiers. Our code is available at: <a class="link-external link-https" href="https://github.com/zxp555/Natural-Language-Induced-Adversarial-Images" rel="external noopener nofollow">this https URL</a>.

Adversarial Attack Against Images Classification based on Generative Adversarial Networks

No One Can Escape: A General Approach to Detect Tampered and Generated Image

Defense-GAN: Protecting Classifiers Against Adversarial Attacks Using Generative Models

GAN-based Classifier Protection Against Adversarial Attacks

GAN Generate Adversarial Examples to Fool Deep Networks.

Undermining Image and Text Classification Algorithms Using Adversarial Attacks

Generating Adversarial Examples with Adversarial Networks

Adversarial Attack on Fake-Faces Detectors under White and Black Box Scenarios

A Direct Approach to Robust Deep Learning Using Adversarial Networks

Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Network

Natural Language Induced Adversarial Images

Generative Adversarial Networks: A Survey on Attack and Defense Perspective

Black-Box Attack Against GAN-Generated Image Detector with Contrastive Perturbation

Exploring Adversarial Fake Images on Face Manifold

Classifiers Protected Against Attacks by Fusion of Multi-Branch Perturbed GAN

An Adversarial Sample Defense Method Based on Multi-Scale GAN

Synthesizing Unrestricted False Positive Adversarial Objects Using Generative Models

Enhanced DNNs for malware classification with GAN-based adversarial training

Adversarial Attacks for Multi Target Image Translation Networks

Unsupervised Adversarial Attacks on Deep Feature-based Retrieval with GAN

Generative Adversarial Attacks Against Deep-Learning-Based Camera Model Identification