Abstract:Achieving robustness against adversarial attacks while maintaining high accuracy remains a critical challenge in neural networks. Parameter quantization is one of the main approaches used to compress deep neural networks to have less inference time and less storage memory size. However, quantization causes severe degradation in accuracy and consequently in model robustness. This work investigates the efficacy of stochastic quantization to enhance robustness and accuracy. Noise injection during quantization is explored to understand the impact of noise types and magnitudes on model performance. A comprehensive comparison between different applying scenarios for stochastic quantization and different noise types and magnitudes was implemented in this paper. Compared to the baseline deterministic quantization, chaotic quantization achieves a comparable accuracy, however, it achieves up to a 43% increase in accuracy against various attack scenarios. This highlights stochastic quantization as a promising defence mechanism. In addition, there is a crucial role played by the choice of noise type and magnitude in stochastic quantization. Lorenz and Henon noise distributions in stochastic quantization outperform traditional uniform and Gaussian noise in defending against attacks. A transferability analysis was discussed to understand the generalizability and effectiveness of the proposed stochastic quantization techniques. A cross-validation definition was newly evaluated in this scope to analyze the model's stability and robustness against attacks. The study outperformed a quantization network technique and improved the model's robustness and stability against adversarial attacks using chaotic quantization instead of deterministic quantization or even instead of stochastic quantization using traditional noise.

Chaotic neural network quantization and its robustness against adversarial attacks

Fooling Neural Network Interpretations - Adversarial Noise to Attack Images.

Improving the Robustness of Quantized Deep Neural Networks to White-Box Attacks using Stochastic Quantization and Information-Theoretic Ensemble Training

A Layer-wise Adversarial-aware Quantization Optimization for Improving Robustness

Defensive Quantization: When Efficiency Meets Robustness

RobustMQ: Benchmarking Robustness of Quantized Models

Benchmarking the Robustness of Quantized Models

Robustness-aware 2-bit quantization with real-time performance for neural network

Exploring the Robustness and Transferability of Patch-Based Adversarial Attacks in Quantized Neural Networks

Improving the Adversarial Robustness of Quantized Neural Networks Via Exploiting the Feature Diversity

SPFQ: A Stochastic Algorithm and Its Error Analysis for Neural Network Quantization

Designing Robust Quantum Neural Networks: Exploring Expressibility, Entanglement, and Control Rotation Gate Selection for Enhanced Quantum Models

AdvQuNN: A Methodology for Analyzing the Adversarial Robustness of Quanvolutional Neural Networks

RobQuNNs: A Methodology for Robust Quanvolutional Neural Networks against Adversarial Attacks

Double-Win Quant: Aggressively Winning Robustness of Quantized Deep Neural Networks Via Random Precision Training and Inference

Improving Robustness Against Adversarial Attacks with Deeply Quantized Neural Networks

Investigating the Impact of Quantization on Adversarial Robustness

Error-Silenced Quantization: Bridging Robustness and Compactness

Quantum Neural Networks under Depolarization Noise: Exploring White-Box Attacks and Defenses

Quantization Aware Attack: Enhancing Transferable Adversarial Attacks by Model Quantization

Quantum Adversarial Attacks: Developing Quantum FGSM Algorithm