Abstract:Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial attacks, even in a black-box scenario. However, most of the existing black-box attack algorithms need to make a huge amount of queries to perform attacks, which is not practical in the real world. We note one of the main reasons for the massive queries is that the adversarial example is required to be visually similar to the original image, but in many cases, how adversarial examples look like does not matter much. It inspires us to introduce a new attack called input-free attack, under which an adversary can choose an arbitrary image to start with and is allowed to add perceptible perturbations on it. Following this approach, we propose two techniques to significantly reduce the query complexity. First, we initialize an adversarial example with a gray color image on which every pixel has roughly the same importance for the target model. Then we shrink the dimension of the attack space by perturbing a small region and tiling it to cover the input image. To make our algorithm more effective, we stabilize a projected gradient ascent algorithm with momentum, and also propose a heuristic approach for region size selection. Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial attacks, even in a black-box scenario. However, most of the existing black-box attack algorithms need to make a huge amount of queries to perform attacks, which is not practical in the real world. We note one of the main reasons for the massive queries is that the adversarial example is required to be visually similar to the original image, but in many cases, how adversarial examples look like does not matter much. It inspires us to introduce a new attack called input-free attack, under which an adversary can choose an arbitrary image to start with and is allowed to add perceptible perturbations on it. Following this approach, we propose two techniques to significantly reduce the query complexity. First, we initialize an adversarial example with a gray color image on which every pixel has roughly the same importance for the target model. Then we shrink the dimension of the attack space by perturbing a small region and tiling it to cover the input image. To make our algorithm more effective, we stabilize a projected gradient ascent algorithm with momentum, and also propose a heuristic approach for region size selection. Through extensive experiments, we show that with only 1,701 queries on average, we can perturb a gray image to any target class of ImageNet with a 100% success rate on InceptionV3. Besides, our algorithm has successfully defeated two real-world systems, the Clarifai food detection API and the Baidu Animal Identification API.

Schmidt: Image Augmentation for Black-Box Adversarial Attack

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Improving Query Efficiency of Black-box Adversarial Attack

An Effective Way to Boost Black-Box Adversarial Attack.

An Evolutionary-Based Black-Box Attack to Deep Neural Network Classifiers.

Image classification adversarial attack with improved resizing transformation and ensemble models

Art-Attack: Black-Box Adversarial Attack via Evolutionary Art

Detecting Adversarial Examples Through Image Transformation

Boosting Targeted Black-Box Attacks Via Ensemble Substitute Training and Linear Augmentation

Detecting Adversarial Image Examples in Deep Neural Networks with Adaptive Noise Reduction

ABCAttack: A Gradient-Free Optimization Black-Box Attack for Fooling Deep Image Classifiers

Mitigating Adversarial Attacks for Deep Neural Networks by Input Deformation and Augmentation

Black-box Adversarial Attacks with Limited Queries and Information

Sensitive Region-Aware Black-Box Adversarial Attacks.

Minimizing Adversarial Training Samples for Robust Image Classifiers: Analysis and Adversarial Example Generator Design

Towards Query Efficient Black-box Attacks

On the Effectiveness of Adversarial Training in Defending against Adversarial Example Attacks for Image Classification

Targeted Black-Box Adversarial Attack Method for Image Classification Models.

A CMA-ES-Based Adversarial Attack on Black-Box Deep Neural Networks

Patch-Wise Attack for Fooling Deep Neural Network

Defense against adversarial attacks based on color space transformation