Abstract:Binary weight convolutional neural networks (BCNNs) can achieve near state-of-the-art classification accuracy and have far less computation complexity compared with traditional CNNs using high-precision weights. Due to their binary weights, BCNNs are well suited for vision-based Internet-of-Things systems being sensitive to power consumption. BCNNs make it possible to achieve very high throughput with moderate power dissipation. In this paper, an energy-efficient architecture for BCNNs is proposed. It fully exploits the binary weights and other hardware-friendly characteristics of BCNNs. A judicious processing schedule is proposed so that off-chip I/O access is minimized and activations are maximally reused. To significantly reduce the critical path delay, we introduce optimized compressor trees and approximate binary multipliers with two novel compensation schemes. The latter is able to save significant hardware resource, and almost no computation accuracy is compromised. Taking advantage of error resiliency of BCNNs, an innovative approximate adder is developed, which significantly reduces the silicon area and data path delay. Thorough error analysis and extensive experimental results on several data sets show that the approximate adders in the data path cause negligible accuracy loss. Moreover, algorithmic transformations for certain layers of BCNNs and a memory-efficient quantization scheme are incorporated to further reduce the energy cost and on-chip storage requirement. Finally, the proposed BCNN hardware architecture is implemented with the SMIC 130-nm technology. The postlayout results demonstrate that our design can achieve an energy efficiency over 2.0TOp/s/W when scaled to 65 nm, which is more than two times better than the prior art.

An Energy-Efficient Systolic Pipeline Architecture for Binary Convolutional Neural Network.

An Energy-Efficient Architecture for Binary Weight Convolutional Neural Networks

Energy-Efficient Architecture for FPGA-based Deep Convolutional Neural Networks with Binary Weights

A Fully Pipelined Hardware Architecture for Convolutional Neural Network with Low Memory Usage and DRAM Bandwidth

An Energy-Efficient Bagged Binary Neural Network Accelerator

An Efficient Kernel Transformation Architecture for Binary- and Ternary-Weight Neural Network Inference.

Binary Convolutional Neural Network on RRAM.

A High Efficient Architecture for Convolution Neural Network Accelerator

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A Low-Power Hardware Architecture for Real-Time CNN Computing

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

Low-Power Computing Unit based on Heterogeneous Approximate Structure for Binary Convolutional Neural Network

A Fully Onchip Binarized Convolutional Neural Network FPGA Impelmentation with Accurate Inference.

A High-Performance Pixel-Level Fully Pipelined Hardware Accelerator for Neural Networks

A High-Efficiency FPGA-Based Accelerator for Binarized Neural Network

A Precision-Scalable Energy-Efficient Convolutional Neural Network Accelerator.

An Energy-Efficient Convolutional Neural Network Processor Architecture Based on a Systolic Array

Layer-Wise Mixed-Modes CNN Processing Architecture With Double-Stationary Dataflow and Dimension-Reshape Strategy

Efficient Hardware Architectures for Deep Convolutional Neural Network

Efficient Binary 3D Convolutional Neural Network and Hardware Accelerator.