Abstract:The state-of-the-art approaches employ approximate computing to reduce the energy consumption of DNN hardware. Approximate DNNs then require extensive retraining afterwards to recover from the accuracy loss caused by the use of approximate operations. However, retraining of complex DNNs does not scale well. In this paper, we demonstrate that efficient approximations can be introduced into the computational path of DNN accelerators while retraining can completely be avoided. ALWANN provides highly optimized implementations of DNNs for custom low-power accelerators in which the number of computing units is lower than the number of DNN layers. First, a fully trained DNN is converted to operate with 8-bit weights and 8-bit multipliers in convolutional layers. A suitable approximate multiplier is then selected for each computing element from a library of approximate multipliers in such a way that (i) one approximate multiplier serves several layers, and (ii) the overall classification error and energy consumption are minimized. The optimizations including the multiplier selection problem are solved by means of a multiobjective optimization NSGA-II algorithm. In order to completely avoid the computationally expensive retraining of DNN, which is usually employed to improve the classification accuracy, we propose a simple weight updating scheme that compensates the inaccuracy introduced by employing approximate multipliers. The proposed approach is evaluated for two architectures of DNN accelerators with approximate multipliers from the open-source "EvoApprox" library. We report that the proposed approach saves 30% of energy needed for multiplication in convolutional layers of ResNet-50 while the accuracy is degraded by only 0.6%. The proposed technique and approximate layers are available as an open-source extension of TensorFlow at <a class="link-external link-https" href="https://github.com/ehw-fit/tf-approximate" rel="external noopener nofollow">this https URL</a>.

Concrete: A Per-layer Configurable Framework for Evaluating DNN with Approximate Operators

Optimally Approximated and Unbiased Floating-Point Multiplier with Runtime Configurability

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

Condense: A Framework for Device and Frequency Adaptive Neural Network Models on the Edge.

ApproxDNNFlow: an Evaluation and Exploration Framework for DNNs with Approximate Multipliers

INA: Incremental Network Approximation Algorithm for Limited Precision Deep Neural Networks

Efficient Approximate Floating-Point Multiplier With Runtime Reconfigurable Frequency and Precision

Special Session: Approximation and Fault Resiliency of DNN Accelerators

ApproxTrain: Fast Simulation of Approximate Multipliers for DNN Training and Inference

A comprehensive exploration of approximate DNN models with a novel floating-point simulation framework

ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining

Energy-efficient DNN Inference on Approximate Accelerators Through Formal Property Exploration

PAM: A Piecewise-Linearly-Approximated Floating-Point Multiplier with Unbiasedness and Configurability

Ax-BxP: Approximate Blocked Computation for Precision-Reconfigurable Deep Neural Network Acceleration

Training Neural Networks for Execution on Approximate Hardware

Approximate Logic Synthesis in the Loop for Designing Low-Power Neural Network Accelerator.

Evaluating Data Resilience in CNNs from an Approximate Memory Perspective.

Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey

Neural Approximating Architecture Targeting Multiple Application Domains

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Approximate Arithmetic Circuits: A Survey, Characterization, and Recent Applications