Abstract:The state-of-the-art approaches employ approximate computing to reduce the energy consumption of DNN hardware. Approximate DNNs then require extensive retraining afterwards to recover from the accuracy loss caused by the use of approximate operations. However, retraining of complex DNNs does not scale well. In this paper, we demonstrate that efficient approximations can be introduced into the computational path of DNN accelerators while retraining can completely be avoided. ALWANN provides highly optimized implementations of DNNs for custom low-power accelerators in which the number of computing units is lower than the number of DNN layers. First, a fully trained DNN is converted to operate with 8-bit weights and 8-bit multipliers in convolutional layers. A suitable approximate multiplier is then selected for each computing element from a library of approximate multipliers in such a way that (i) one approximate multiplier serves several layers, and (ii) the overall classification error and energy consumption are minimized. The optimizations including the multiplier selection problem are solved by means of a multiobjective optimization NSGA-II algorithm. In order to completely avoid the computationally expensive retraining of DNN, which is usually employed to improve the classification accuracy, we propose a simple weight updating scheme that compensates the inaccuracy introduced by employing approximate multipliers. The proposed approach is evaluated for two architectures of DNN accelerators with approximate multipliers from the open-source "EvoApprox" library. We report that the proposed approach saves 30% of energy needed for multiplication in convolutional layers of ResNet-50 while the accuracy is degraded by only 0.6%. The proposed technique and approximate layers are available as an open-source extension of TensorFlow at <a class="link-external link-https" href="https://github.com/ehw-fit/tf-approximate" rel="external noopener nofollow">this https URL</a>.

LRADNN: High-throughput and energy-efficient Deep Neural Network accelerator using Low Rank Approximation.

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

SparseNN: an Energy-Efficient Neural Network Accelerator Exploiting Input and Output Sparsity

A Low-Power Accelerator for Deep Neural Networks with Enlarged Near-Zero Sparsity

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

A Data-Driven Asynchronous Neural Network Accelerator

An Energy-Efficient Spiking Neural Network Accelerator Based on Spatio-Temporal Redundancy Reduction

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

RNNAccel: A Fusion Recurrent Neural Network Accelerator for Edge Intelligence

A Small-Footprint Accelerator for Large-Scale Neural Networks

LayCO: Achieving Least Lossy Accuracy for Most Efficient RRAM-Based Deep Neural Network Accelerator via Layer-Centric Co-Optimization

ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

An Efficient Hardware Architecture for DNN Training by Exploiting Triple Sparsity

LHC: A Low-Power Heterogeneous Computing Method on Neural Network Accelerator

RRAM-DNN: an RRAM and Model-Compression Empowered All-Weights-On-Chip DNN Accelerator

An Energy-Efficient Near-Data Processing Accelerator for DNNs that Optimizes Data Accesses

THETA: A High-Efficiency Training Accelerator for DNNs with Triple-Side Sparsity Exploration

Design of High Performance RNN Accelerator Based on Network Compression

A Power-Efficient Accelerator Based on FPGAs for LSTM Network