Abstract:Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based attacks, image editing-based attacks, and latent space-based attacks. However, the adversarial examples crafted by these methods often lack sufficient semantic information, making it challenging for humans to understand the failure modes of deep learning models under natural conditions. To address this limitation, we propose a natural language induced adversarial image attack method. The core idea is to leverage a text-to-image model to generate adversarial images given input prompts, which are maliciously constructed to lead to misclassification for a target model. To adopt commercial text-to-image models for synthesizing more natural adversarial images, we propose an adaptive genetic algorithm (GA) for optimizing discrete adversarial prompts without requiring gradients and an adaptive word space reduction method for improving query efficiency. We further used CLIP to maintain the semantic consistency of the generated images. In our experiments, we found that some high-frequency semantic information such as "foggy", "humid", "stretching", etc. can easily cause classifier errors. This adversarial semantic information exists not only in generated images but also in photos captured in the real world. We also found that some adversarial semantic information can be transferred to unknown classification tasks. Furthermore, our attack method can transfer to different text-to-image models (e.g., Midjourney, DALL-E 3, etc.) and image classifiers. Our code is available at: <a class="link-external link-https" href="https://github.com/zxp555/Natural-Language-Induced-Adversarial-Images" rel="external noopener nofollow">this https URL</a>.

Methods and devices for evaluating performances of image identification model and image identification model attack method, and medium

IMAGE PROCESSING METHOD AND DEVICE, ELECTRONIC APPARATUS AND STORAGE MEDIUM

Researches on Performance Evaluation of Biometric Authentication Systems

Method and device for determining image features, storage medium and processor

Detecting Adversarial Samples for Deep Learning Models: A Comparative Study

Controllable Evaluation and Generation of Physical Adversarial Patch on Face Recognition

A Compact Methodology To Understand, Evaluate, And Predict The Performance Of Automatic Target Recognition

New Performance Evaluation Models for Character Detection in Images

Image-Level Adaptive Adversarial Ranking for Person Re-Identification

Digital Thermal Infrared Detector Attack Via Free Velocity and Rollback Mutation

Targeted Black-Box Adversarial Attack Method for Image Classification Models.

Natural Language Induced Adversarial Images

A Universal Targeted Attack Method against Image Classification

Modeling Electromagnetic Signal Injection Attacks on Camera-based Smart Systems: Applications and Mitigation

Deep Image Destruction: Vulnerability of Deep Image-to-Image Models against Adversarial Attacks

Image classification method and device and computer readable medium

Performance Evaluation of Adversarial Attacks: Discrepancies and Solutions

An Illumination Modulation-Based Adversarial Attack Against Automated Face Recognition System.

Attack as Defense: Run-time Backdoor Implantation for Image Content Protection

Adversarial Metric Attack and Defense for Person Re-Identification

Image classification adversarial attack with improved resizing transformation and ensemble models