Abstract:Convolutional neural networks (CNNs) have found extensive applications in practice. However, weight/activation's sparsity and different data precision requirements across layers lead to a large amount of redundant computations. In this paper, we propose an efficient architecture for CNNs, named Folded Precision-Adjustable Processor (FPAP), to skip those unnecessary computations with ease. Computations are folded in the following two aspects to achieve efficient computing. On one hand, the dominant multiply-and-add (MAC) operations are performed bit-serially based on a bit-pair encoding algorithm so that the FPAP can adapt to different numerical precisions without using multipliers with long data width. On the other hand, a 1-D convolution is undertaken by a multi-tap transposed finite impulse response (FIR) filter, which is folded into one tap so that computations involving zero activations and weights can be easily skipped. Equipped with the precision-adjustable MAC unit and the folded FIR filter structure, a well-designed array architecture, consisting of many identical processing elements is developed, which is scalable for different throughput requirements and highly flexible for different numerical precisions. Besides, a novel genetic algorithm based kernel reallocation scheme is introduced to mitigate the load imbalance issue. Our synthesis results demonstrate that the proposed FPAP can significantly reduce the logic complexity and the critical path over the corresponding unfolded design, which only delivers slightly higher throughput when processing sparse and compact models. Our experiments also show that FPAP can scale its energy efficiency from 1.01TOP/s/W to 6.26TOP/s/W under 90nm CMOS technology when different data precisions are used.

Eadnet: Efficient Architecture for Decomposed Convolutional Neural Networks

EWS: an Energy-Efficient CNN Accelerator with Enhanced Weight Stationary Dataflow

ADS-CNN: Adaptive Dataflow Scheduling for lightweight CNN accelerator on FPGAs

Communication Minimized Model-Architecture Co-design for Efficient Convolution Acceleration

A Reconfigurable Spatial Architecture for Energy-Efficient Inception Neural Networks

A Power-Efficient Accelerator for Convolutional Neural Networks

Bandwidth Efficient Architectures for Convolutional Neural Network

An Efficient FPGA-based Depthwise Separable Convolutional Neural Network Accelerator with Hardware Pruning.

UACT: A Unified Energy-efficient Computing Architecture for CNN and TCNN.

A High Efficient Architecture for Convolution Neural Network Accelerator

A Low-Power Hardware Architecture for Real-Time CNN Computing

Efficient Hardware Architectures for Deep Convolutional Neural Network

LACS: A High-Computational-Efficiency Accelerator for CNNs

Exploration of Balanced Design in Resource-Constrained Edge Device for Efficient CNNs

An Efficient Accelerator for Multiple Convolutions From the Sparsity Perspective

Energy-Efficient Architecture for FPGA-based Deep Convolutional Neural Networks with Binary Weights

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

FPAP: A Folded Architecture for Efficient Computing of Convolutional Neural Networks

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A Novel Low-Communication Energy-Efficient Reconfigurable CNN Acceleration Architecture