Abstract:Deep Learning (DL) is rapidly maturing to the point that it can be used in safety- and security-crucial applications. However, adversarial samples, which are undetectable to the human eye, pose a serious threat that can cause the model to misbehave and compromise the performance of such applications. Addressing the robustness of DL models has become crucial to understanding and defending against adversarial attacks. In this study, we perform comprehensive experiments to examine the effect of adversarial attacks and defenses on various model architectures across well-known datasets. Our research focuses on black-box attacks such as SimBA, HopSkipJump, MGAAttack, and boundary attacks, as well as preprocessor-based defensive mechanisms, including bits squeezing, median smoothing, and JPEG filter. Experimenting with various models, our results demonstrate that the level of noise needed for the attack increases as the number of layers increases. Moreover, the attack success rate decreases as the number of layers increases. This indicates that model complexity and robustness have a significant relationship. Investigating the diversity and robustness relationship, our experiments with diverse models show that having a large number of parameters does not imply higher robustness. Our experiments extend to show the effects of the training dataset on model robustness. Using various datasets such as ImageNet-1000, CIFAR-100, and CIFAR-10 are used to evaluate the black-box attacks. Considering the multiple dimensions of our analysis, e.g., model complexity and training dataset, we examined the behavior of black-box attacks when models apply defenses. Our results show that applying defense strategies can significantly reduce attack effectiveness. This research provides in-depth analysis and insight into the robustness of DL models against various attacks, and defenses.

Enhancing Black-Box Attacks With Self-Supervised Features and Luminance-Aware Visual Model

Demons Hidden in the Light: Unrestricted Adversarial Illumination Attacks

Towards Efficient Data Free Blackbox Adversarial Attack

Improving Query Efficiency of Black-box Adversarial Attack

Attention‐guided transformation‐invariant attack for black‐box adversarial examples

Towards Lightweight Black-Box Attacks against Deep Neural Networks

Perception Improvement for Free: Exploring Imperceptible Black-box Adversarial Attacks on Image Classification

Data-Free Adversarial Perturbations for Practical Black-Box Attack

Promoting Adversarial Transferability via Dual-Sampling Variance Aggregation and Feature Heterogeneity Attacks

Feature-Guided Black-Box Safety Testing of Deep Neural Networks

From Attack to Defense: Insights into Deep Learning Security Measures in Black-Box Settings

Enhancing the Adversarial Transferability with Channel Decomposition

Defense against adversarial attacks based on color space transformation

Adversarial Examples Versus Cloud-based Detectors: A Black-box Empirical Study

Object-Aware Transfer-Based Black-Box Adversarial Attack on Object Detector.

Improving Adversarial Transferability by Stable Diffusion

Image classification adversarial attack with improved resizing transformation and ensemble models

Enhancing the transferability of adversarial samples with random noise techniques

SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Images

Admix: Enhancing the Transferability of Adversarial Attacks

Practical Black-Box Attacks against Deep Learning Systems using Adversarial Examples