Abstract:Recent works demonstrated that imperceptible perturbations to input data, known as adversarial examples, can mislead neural networks' output. Moreover, the same adversarial sample can be transferable and used to fool different neural models. Such vulnerabilities impede the use of neural networks in mission-critical tasks. To the best of our knowledge, this is the first paper that evaluates the robustness of emerging CNN- and transformer-inspired image classifier models such as SpinalNet and Compact Convolutional Transformer (CCT) against popular white- and black-box adversarial attacks imported from the Adversarial Robustness Toolbox (ART). In addition, the adversarial transferability of the generated samples across given models was studied. The tests were carried out on the CIFAR-10 dataset, and the obtained results show that the level of susceptibility of SpinalNet against the same attacks is similar to that of the traditional VGG model, whereas CCT demonstrates better generalization and robustness. The results of this work can be used as a reference for further studies, such as the development of new attacks and defense mechanisms.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to evaluate the robustness and transferability of different image - classification neural - network models against adversarial attacks. Specifically, the paper studies the robustness of emerging CNN (Convolutional Neural Network) and Transformer - based image - classifier models (such as SpinalNet and Compact Convolutional Transformer, CCT) when facing popular white - box and black - box adversarial attacks from the Adversarial Robustness Toolbox (ART), and explores the transferability of these adversarial samples among different models. Through tests on the CIFAR - 10 dataset, the paper aims to provide references for subsequent research, such as developing new attack and defense mechanisms. ### Main contributions of the paper: 1. **Evaluated the robustness of SpinalNet and CCT models against popular targeted and non - targeted attacks**. 2. **Evaluated the transferability of non - targeted attacks among VGG, SpinalNet and CCT models**. ### Main findings: - **The SpinalNet model is slightly more robust than its corresponding VGG model in some cases**, but overall, the two react similarly to all applied attacks. - **The CCT - 7/3×1 model shows higher robustness in most cases**, especially in detecting simple adversarial samples (such as FGSM and PixelAttack). - **The C&W ℓ2 attack shows a high sensitivity to the CCT model**, resulting in an accuracy drop of up to 40.7%, while the SpinalNet and VGG models perform similarly to the C&W ℓin f attack in this regard. ### Conclusion: The research results show that different types of neural - network models exhibit different robustness when facing adversarial attacks. The CCT model shows stronger robustness under certain attacks, which provides a valuable reference for the development of future defense mechanisms. At the same time, the research also emphasizes the transferability of adversarial samples, which is of great significance for designing more secure neural - network systems.

Robustness and Transferability of Adversarial Attacks on Different Image Classification Neural Networks

On the Robustness of Vision Transformers to Adversarial Examples

Demystifying the Transferability of Adversarial Attacks in Computer Networks

Unscrambling the Rectification of Adversarial Attacks Transferability across Computer Networks

Exploring Transferable and Robust Adversarial Perturbation Generation Across Network Hierarchy

Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networks

Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attacks

Towards Robustifying Image Classifiers against the Perils of Adversarial Attacks on Artificial Intelligence Systems

The Efficacy of Transformer-based Adversarial Attacks in Security Domains

On the Transferability of Adversarial Examples Against CNN-Based Image Forensics

Channel-augmented Joint Transformation for Transferable Adversarial Attacks

Towards Transferable Adversarial Attacks on Image and Video Transformers

Robust Attack with Adaptive Compress Adversarial Perturbations

Improving Transferability of Adversarial Examples With Input Diversity

Reveal of Vision Transformers Robustness against Adversarial Attacks

Towards Robustness against Unsuspicious Adversarial Examples

Robust Convolutional Neural Networks Against Adversarial Attacks on Medical Images

Not So Robust After All: Evaluating the Robustness of Deep Neural Networks to Unseen Adversarial Attacks

On the Adversarial Robustness of Vision Transformers

A Survey on Transferability of Adversarial Examples across Deep Neural Networks