Abstract:Deep neural network (DNN) accelerators overcome the power and memory walls for executing neural-net models locally on edge-computing devices to support sophisticated AI applications. The advocacy of “model once, run optimized anywhere” paradigm introduces potential new security threat to edge intelligence that is methodologically different from the well-known adversarial examples. Existing adversarial examples modify the input samples presented to an AI application either digitally or physically to cause a misclassification. Nevertheless, these input-based perturbations are not robust or surreptitious on multi-view target. To generate a good adversarial example for misclassifying a real-world target of variational viewing angle, lighting and distance, a decent number of target’s samples are required to extract the rare anomalies that can cross the decision boundary. The feasible perturbations are substantial and visually perceptible. In this paper, we propose a new glitch injection attack on DNN accelerator that is capable of misclassifying a target under variational viewpoints. The glitches injected into the computation clock signal induce transitory but disruptive errors in the intermediate results of the multiply-and-accumulate (MAC) operations. The attack pattern for each target of interest consists of sparse instantaneous glitches, which can be derived from just one sample of the target. Two modes of attack patterns are derived, and their effectiveness are demonstrated on four representative ImageNet models implemented on the Deep-learning Processing Unit (DPU) of FPGA edge and its DNN development toolchain. The attack success rates are evaluated on 118 objects in 61 diverse sensing conditions, including 25 viewing angles (−60° to 60°), 24 illumination directions and 12 color temperatures. In the covert mode, the success rates of our attack exceed existing stealthy adversarial examples by more than 16.3%, with only two glitches injected into ten thousands to a million cycles for one complete inference. In the robust mode, the attack success rates on all four DNNs are more than 96.2% with an average glitch intensity of 1.4% and a maximum glitch intensity of 10.2%.

Using Undervolting as an On-Device Defense Against Adversarial Machine Learning Attacks

Stealthy and Robust Glitch Injection Attack on Deep Learning Accelerator for Target with Variational Viewpoint.

Imperceptible Misclassification Attack on Deep Learning Accelerator by Glitch Injection

HASI: Hardware-Accelerated Stochastic Inference, A Defense Against Adversarial Machine Learning Attacks

A Deep Investigation on Stealthy DVFS Fault Injection Attacks at DNN Hardware Accelerators

Attacking Deep Learning AI Hardware with Universal Adversarial Perturbation

Shavette: Low Power Neural Network Acceleration via Algorithm-level Error Detection and Undervolting

Mitigating Adversarial Attacks for Deep Neural Networks by Input Deformation and Augmentation

DSE-Based Hardware Trojan Attack for Neural Network Accelerators on FPGAs.

Super-Efficient Super Resolution for Fast Adversarial Defense at the Edge

Fooling AI with AI: an Accelerator for Adversarial Attacks on Deep Learning Visual Classification.

DNN-Defender: A Victim-Focused In-DRAM Defense Mechanism for Taming Adversarial Weight Attack on DNNs

When Not to Classify: Anomaly Detection of Attacks (ADA) on DNN Classifiers at Test Time

Stealthy Attack on Algorithmic-Protected DNNs via Smart Bit Flipping

DNN-Defender: An in-DRAM Deep Neural Network Defense Mechanism for Adversarial Weight Attack

Towards Robustifying Image Classifiers against the Perils of Adversarial Attacks on Artificial Intelligence Systems

The Inherent Adversarial Robustness of Analog In-Memory Computing

Tailoring Adversarial Attacks on Deep Neural Networks for Targeted Class Manipulation Using DeepFool Algorithm

Detecting Adversarial Image Examples in Deep Neural Networks with Adaptive Noise Reduction

Threats of Adversarial Attacks in DNN-Based Modulation Recognition

Hardware Accelerator for Adversarial Attacks on Deep Learning Neural Networks