Abstract:Due to less memory requirement, low computation overhead and negligible accuracy degradation, deep neural networks with binary/ternary weights (BTNNs) have been widely employed on low-power mobile and Internet of Things (IoT) devices with limited storage capacity. Some hardware implementations have been proposed to accelerate the inference of BTNNs by utilizing the multiplication-free feature. However, some implicit characteristics in BTNN convolution, such as high arithmetic complexity and numerous redundant operations, are never considered. In this paper, we propose four optimization techniques to fully exploit these features. First, a feature-integral-based convolution (FIBC) method is proposed to reduce the arithmetic complexity of convolutional layers. Second, a kernel-transformation-feature-reconstruction (KTFR) convolution method is presented to remove redundant operations in BTNN convolution. Third, a hierarchical load-balancing mechanism (HLBM) is designed to eliminate zero value computation and improve resource utilization. Finally, a joint optimization approach for convolutional layers is proposed to search optimal calculation pattern for each layer. Based on the proposed four techniques, we design a reconfigurable processor in a 28-nm CMOS technology to accelerate the inferences of BTNNs. The four proposed techniques improve energy efficiency by 2.07 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> , 1.65 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> , 1.25 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> , and 2.24 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> for BTNNs respectively, compared with the baseline implementation which disables the proposed techniques. Benchmarked with binary-weight AlexNet, the processor achieves an energy efficiency of 19.9 TOPS/W at 200 MHz and 0.9 V.

A Reconfigurable Approximate Computing Architecture with Dual-VDD for Low-Power Binarized Weight Network Deployment

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

Composite Spintronic Accuracy-Configurable Adder For Low Power Digital Signal Processing

Multistage Latency Adders Architecture Employing Approximate Computing

High-accuracy Low-power Reconfigurable Architectures for Decomposition-based Approximate Lookup Table

LSAC: A Low-Power Adder Tree for Digital Computing-in-Memory by Sparsity and Approximate Circuits Co-Design

A Hardware/Software Co-Design Methodology for Adaptive Approximate Computing in Clustering and ANN Learning

Efficient Approximate Floating-Point Multiplier With Runtime Reconfigurable Frequency and Precision

Area- and Power-Efficient Reconfigurable Architecture for Multifunction Evaluation

Design of Approximate Radix-4 Booth Multipliers for Error-Tolerant Computing

An Energy-Efficient Reconfigurable Processor for Binary-and Ternary-Weight Neural Networks With Flexible Data Bit Width

A New Approximate Adder with Low Relative Error and Correct Sign Calculation

A Review, Classification, and Comparative Evaluation of Approximate Arithmetic Circuits

Reconfigurable Multifunction Computing Unit Using an Universal Piecewise Linear Method

RARA: Dataflow Based Error Compensation Methods with Runtime Accuracy-Reconfigurable Adder

Double-Shift: A Low-Power DNN Weights Storage and Access Framework Based on Approximate Decomposition and Quantization

AX-DBN: An Approximate Computing Framework for the Design of Low-Power Discriminative Deep Belief Networks

Design of Majority Logic-Based Approximate Booth Multipliers for Error-Tolerant Applications

A 3-8Bit Reconfigurable Hybrid ADC Architecture with Successive-approximation and Single-slope Stages for Computing in Memory.