Abstract:As a primary computation unit, a processing element (PE) is key to the energy efficiency of a convolutional neural network (CNN) accelerator. Taking advantage of the inherent error tolerance of CNNs, approximate computing with high hardware efficiency has been considered for implementing the computation units of CNN accelerators. However, individual approximate designs such as multipliers and adders can only achieve limited accuracy and hardware improvements. In this paper, an approximate PE is dedicatedly devised for CNN accelerators by synergistically considering the data representation, multiplication and accumulation. An approximate data format is defined for the weights using stochastic rounding. This data format enables a simple implementation of multiplication by using small lookup tables, an adder and a shifter. Two approximate accumulators are further proposed for the product accumulation in the PE. Compared with the exact 8-bit fixed-point design, the proposed PE saves more than 29% and 20% in power-delay product for 3 × 3 and 5 × 5 sum of products, respectively. Also, compared with the PEs consisting of state-of-the-art approximate multipliers, the proposed design shows significantly smaller error bias with lower hardware overhead. Moreover, the application of the approximate PEs in CNN accelerators is analyzed by implementing a multi-task CNN for face detection and alignment. We conclude that 1) an approximate PE is more effective for face detection than for alignment, 2) an approximate PE with high statistically-measured accuracy does not necessarily result in good quality in face detection, and 3) properly increasing the number of PEs in a CNN accelerator can improve its power and energy efficiency.

Mutual Error Compensation Based Area and Power Efficient Approximate Multiplier

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

Optimally Approximated and Unbiased Floating-Point Multiplier with Runtime Configurability

A Hardware- and Accuracy-Efficient Approximate Multiplier with Error Compensation for Neural Network and Image Processing Applications

Permutation-Based Approximate Multiplier with High Accuracy.

HEAM: High-Efficiency Approximate Multiplier Optimization for Deep Neural Networks

LMM: A Fixed-Point Linear Mapping Based Approximate Multiplier for IoT

Low Error-Rate Approximate Multiplier Design for DNNs with Hardware-Driven Co-Optimization

Adaptable Approximate Multiplier Design Based on Input Distribution and Polarity

An Optimized Compression Strategy for Compressor-Based Approximate Multiplier

Efficient Approximate Floating-Point Multiplier With Runtime Reconfigurable Frequency and Precision

PAM: A Piecewise-Linearly-Approximated Floating-Point Multiplier with Unbiasedness and Configurability

AMG: Automated Efficient Approximate Multiplier Generator for FPGAs via Bayesian Optimization

Hardware-accuracy trade-offs for error-resilient applications using an ultra-efficient hybrid approximate multiplier

Approximate Processing Element Design and Analysis for the Implementation of CNN Accelerators

An Efficient Approximate Multiplier with Encoded Partial Products and Inexact Counter for Joint Photographic Experts Group Compression

Characterizing Approximate Adders and Multipliers Optimized under Different Design Constraints

PPBAM:A Preprocessing-based Power-Efficient Approximate Multiplier Design for CNN

Multiplier-less Artificial Neurons Exploiting Error Resiliency for Energy-Efficient Neural Computing