Abstract:The rapid proliferation of the Internet of Things (IoT) and the dramatic resurgence of artificial intelligence (AI) based application workloads have led to immense interest in performing inference on energy-constrained edge devices. Approximate computing (a design paradigm that trades off a small degradation in application quality for disproportionate energy savings) is a promising technique to enable energy-efficient inference at the edge. This paper introduces the concept of an approximate edge inference system ( AxIS ) and proposes a systematic methodology to perform joint approximations between different subsystems in a deep neural network (DNN)-based edge inference system, leading to significant energy benefits compared to approximating individual subsystems in isolation. We use a smart camera system that executes various DNN-based image classification and object detection applications to illustrate how the sensor, memory, compute, and communication subsystems can all be approximated synergistically. We demonstrate our proposed methodology using two variants of a smart camera system: (a) Cam Edge , where the DNN is executed locally on the edge device, and (b) Cam Cloud , where the edge device sends the captured image to a remote cloud server that executes the DNN. We have prototyped such an approximate inference system using an Intel Stratix IV GX-based Terasic TR4-230 FPGA development board. Experimental results obtained using six large DNNs and four compact DNNs running image classification applications demonstrate significant energy savings (≈ 1.6 ×–4.7 × for large DNNs and ≈ 1.5 ×–3.6 × for small DNNs) for minimal (< \(1\% \) ) loss in application-level quality. Furthermore, results using four object detection DNNs exhibit energy savings of ≈ 1.5 ×–5.2 × for similar quality loss. Compared to approximating a single subsystem in isolation, AxIS achieves 1.05 ×–3.25 × gains in energy savings for image classification and 1.35 ×–4.2 × gains for object detection on average, for minimal ( \(\lt 1\% \) ) application-level quality loss.

INEAD: Intermediate Node Evaluation-Based Attack Detection for Secure Approximate Computing Systems

Adversarial Attacks and Mitigation for Anomaly Detectors of Cyber-Physical Systems

INA: Incremental Network Approximation Algorithm for Limited Precision Deep Neural Networks

Valid false data injection attacks under approximated power flow model in power distribution systems

A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in Clustering and ANN Learning

Feature Attention Distillation Defense for Backdoor Attack in Artificial Neural Network-Based Electricity Theft Detection

On the (In)security of Approximate Computing Synthesis

ADEPOS: A Novel Approximate Computing Framework for Anomaly Detection Systems and its Implementation in 65nm CMOS

Exploiting Significance of Computations for Energy-Constrained Approximate Computing

Energy-Efficient Approximate Edge Inference Systems

Improved Stealthy False Data Injection Attacks in Networked Control Systems

SecONN: An Optical Neural Network Framework with Concurrent Detection of Thermal Fault Injection Attacks

AxTrain

Analysis of Power-Oriented Fault Injection Attacks on Spiking Neural Networks

APPRAISER: DNN Fault Resilience Analysis Employing Approximation Errors

Efficient Computations of a Security Index for False Data Attacks in Power Networks

Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey

A Novel Approach for Fast and Accurate Mean Error Distance Computation in Approximate Adders

Artificial neural networks for online error detection

Training Neural Networks for Execution on Approximate Hardware

AppGNN: Approximation-Aware Functional Reverse Engineering using Graph Neural Networks