Abstract:Field programmable gate array (FPGA) is widely considered as a promising platform for convolutional neural network (CNN) acceleration. However, the large numbers of parameters of CNNs cause heavy computing and memory burdens for FPGA-based CNN implementation. To solve this problem, this paper proposes an optimized compression strategy, and realizes an accelerator based on FPGA for CNNs. Firstly, a reversed-pruning strategy is proposed which reduces the number of parameters of AlexNet by a factor of 13× without accuracy loss on the ImageNet dataset. Peak-pruning is further introduced to achieve better compressibility. Moreover, quantization gives another 4× with negligible loss of accuracy. Secondly, an efficient storage technique, which aims for the reduction of the whole overhead cache of the convolutional layer and the fully connected layer, is presented respectively. Finally, the effectiveness of the proposed strategy is verified by an accelerator implemented on a Xilinx ZCU104 evaluation board. By improving existing pruning techniques and the storage format of sparse data, we significantly reduce the size of AlexNet by 28×, from 243 MB to 8.7 MB. In addition, the overall performance of our accelerator achieves 9.73 fps for the compressed AlexNet. Compared with the central processing unit (CPU) and graphics processing unit (GPU) platforms, our implementation achieves 182.3× and 1.1× improvements in latency and throughput, respectively, on the convolutional (CONV) layers of AlexNet, with an 822.0× and 15.8× improvement for energy efficiency, separately. This novel compression strategy provides a reference for other neural network applications, including CNNs, long short-term memory (LSTM), and recurrent neural networks (RNNs).

A High Energy Efficiency and Low Resource Consumption FPGA Accelerator for Convolutional Neural Network

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A High-Performance Hardware Accelerator for Sparse Convolutional Neural Network on FPGA

Energy-Efficient And High-Throughput Fpga-Based Accelerator For Convolutional Neural Networks

FPGA-based Accelerator for Convolutional Neural Network

A Power-Efficient and High Performance FPGA Accelerator for Convolutional Neural Networks: Work-in-progress.

A High Performance FPGA-based Accelerator for Large-Scale Convolutional Neural Networks

Throughput-Optimized FPGA Accelerator for Deep Convolutional Neural Networks

An Efficient Convolutional Neural Network Accelerator on FPGA

An FPGA-based Accelerator Implementation for Deep Convolutional Neural Networks

A High-Performance Accelerator for Large-Scale Convolutional Neural Networks

High Energy Efficiency FPGA-Based Accelerator for Convolutional Neural Networks Using Weight Combination

Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks

A FPGA-based Hardware Accelerator for Multiple Convolutional Neural Networks

An Efficient Sparse CNNs Accelerator on FPGA

Design and Implementation of a FPGA-based Accelerator for Convolutional Neural Networks

Design of FPGA Accelerator Architecture for Convolutional Neural Network

An FPGA-Based CNN Accelerator Integrating Depthwise Separable Convolution

A High-performance Hardware Accelerator Using a Fusion Approach of Convolution and Pooling

Optimized Compression for Implementing Convolutional Neural Networks on FPGA

An Efficient Hardware Accelerator for Structured Sparse Convolutional Neural Networks on FPGAs