Abstract:As a primary computation unit, a processing element (PE) is key to the energy efficiency of a convolutional neural network (CNN) accelerator. Taking advantage of the inherent error tolerance of CNNs, approximate computing with high hardware efficiency has been considered for implementing the computation units of CNN accelerators. However, individual approximate designs such as multipliers and adders can only achieve limited accuracy and hardware improvements. In this paper, an approximate PE is dedicatedly devised for CNN accelerators by synergistically considering the data representation, multiplication and accumulation. An approximate data format is defined for the weights using stochastic rounding. This data format enables a simple implementation of multiplication by using small lookup tables, an adder and a shifter. Two approximate accumulators are further proposed for the product accumulation in the PE. Compared with the exact 8-bit fixed-point design, the proposed PE saves more than 29% and 20% in power-delay product for 3 × 3 and 5 × 5 sum of products, respectively. Also, compared with the PEs consisting of state-of-the-art approximate multipliers, the proposed design shows significantly smaller error bias with lower hardware overhead. Moreover, the application of the approximate PEs in CNN accelerators is analyzed by implementing a multi-task CNN for face detection and alignment. We conclude that 1) an approximate PE is more effective for face detection than for alignment, 2) an approximate PE with high statistically-measured accuracy does not necessarily result in good quality in face detection, and 3) properly increasing the number of PEs in a CNN accelerator can improve its power and energy efficiency.

PPBAM:A Preprocessing-based Power-Efficient Approximate Multiplier Design for CNN

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

High Quality Multiplier Design Based on Improved Circuits

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

Approximate Processing Element Design and Analysis for the Implementation of CNN Accelerators

An Energy-Efficient Multiplier Using Hybrid Approximate Logic Synthesis for Mixed-Quantization CNNs

Subtractor-Based CNN Inference Accelerator

A Low-Power Sparse Convolutional Neural Network Accelerator with Pre-Encoding Radix-4 Booth Multiplier

An energy efficient radix-4 Booth encoding parallel multiplier design

A Low-Power Processing Element Based on Asynchronous Data-Driven Bit-Serial Multiplier for CNNs

A Precision-Scalable Energy-Efficient Convolutional Neural Network Accelerator.

A CGP-based Efficient Approximate Multiplier with Error Compensation

Timing Error Tolerant CNN Accelerator with Layer-Wise Approximate Multiplication

A New Approximate Multiplier Design for Digital Signal Processing

Work-in-Process: Error-Compensation-Based Energy-Efficient MAC Unit for CNNs

Permutation-Based Approximate Multiplier with High Accuracy.

Mutual Error Compensation Based Area and Power Efficient Approximate Multiplier

HEAM: High-Efficiency Approximate Multiplier Optimization for Deep Neural Networks

Compressors Evolution Based High Speed and Energy Efficient Approximate Signed Multiplier

Adaptable Approximate Multiplier Design Based on Input Distribution and Polarity