Abstract:Achieving robustness against adversarial attacks while maintaining high accuracy remains a critical challenge in neural networks. Parameter quantization is one of the main approaches used to compress deep neural networks to have less inference time and less storage memory size. However, quantization causes severe degradation in accuracy and consequently in model robustness. This work investigates the efficacy of stochastic quantization to enhance robustness and accuracy. Noise injection during quantization is explored to understand the impact of noise types and magnitudes on model performance. A comprehensive comparison between different applying scenarios for stochastic quantization and different noise types and magnitudes was implemented in this paper. Compared to the baseline deterministic quantization, chaotic quantization achieves a comparable accuracy, however, it achieves up to a 43% increase in accuracy against various attack scenarios. This highlights stochastic quantization as a promising defence mechanism. In addition, there is a crucial role played by the choice of noise type and magnitude in stochastic quantization. Lorenz and Henon noise distributions in stochastic quantization outperform traditional uniform and Gaussian noise in defending against attacks. A transferability analysis was discussed to understand the generalizability and effectiveness of the proposed stochastic quantization techniques. A cross-validation definition was newly evaluated in this scope to analyze the model's stability and robustness against attacks. The study outperformed a quantization network technique and improved the model's robustness and stability against adversarial attacks using chaotic quantization instead of deterministic quantization or even instead of stochastic quantization using traditional noise.

Improving the Adversarial Robustness of Quantized Neural Networks Via Exploiting the Feature Diversity

Defensive Quantization: When Efficiency Meets Robustness

Optimizing Quantized Neural Networks in a Weak Curvature Manifold

Double-Win Quant: Aggressively Winning Robustness of Quantized Deep Neural Networks Via Random Precision Training and Inference

A Layer-wise Adversarial-aware Quantization Optimization for Improving Robustness

Propagating Asymptotic-Estimated Gradients for Low Bitwidth Quantized Neural Networks

Improving the Robustness of Quantized Deep Neural Networks to White-Box Attacks using Stochastic Quantization and Information-Theoretic Ensemble Training

Exploring the Robustness and Transferability of Patch-Based Adversarial Attacks in Quantized Neural Networks

Investigating the Impact of Quantization on Adversarial Robustness

Quantization Aware Attack: Enhancing Transferable Adversarial Attacks by Model Quantization

Benchmarking the Robustness of Quantized Models

RobustMQ: Benchmarking Robustness of Quantized Models

Error-Silenced Quantization: Bridging Robustness and Compactness

Towards robust neural networks via orthogonal diversity

Improving Robustness Against Adversarial Attacks with Deeply Quantized Neural Networks

AdvQuNN: A Methodology for Analyzing the Adversarial Robustness of Quanvolutional Neural Networks

RobQuNNs: A Methodology for Robust Quanvolutional Neural Networks against Adversarial Attacks

Chaotic neural network quantization and its robustness against adversarial attacks

Zero-shot Adversarial Quantization

An Integrated Approach to Produce Robust Models with High Efficiency