Abstract:OpenCL FPGA has recently gained great popularity with emerging needs for workload acceleration such as Convolutional Neural Network (CNN), which is the most popular deep learning architecture in the domain of computer vision. While OpenCL enhances the code portability and programmability of FPGA, it comes at the expense of performance. The key challenge is to optimize the OpenCL kernels to efficiently utilize the flexible hardware resources in FPGA. Simply optimizing the OpenCL kernel code through various compiler options turns out insufficient to achieve desirable performance for both compute-intensive and data-intensive workloads such as convolutional neural networks. In this paper, we first propose an analytical performance model and apply it to perform an in-depth analysis on the resource requirement of CNN classifier kernels and available resources on modern FPGAs. We identify that the key performance bottleneck is the on-chip memory bandwidth. We propose a new kernel design to effectively address such bandwidth limitation and to provide an optimal balance between computation, on-chip, and off-chip memory access. As a case study, we further apply these techniques to design a CNN accelerator based on the VGG model. Finally, we evaluate the performance of our CNN accelerator using an Altera Arria 10 GX1150 board. We achieve 866 Gop/s floating point performance at 370MHz working frequency and 1.79 Top/s 16-bit fixed-point performance at 385MHz. To the best of our knowledge, our implementation achieves the best power efficiency and performance density compared to existing work.

Optimizing Convolutional Neural Network on FPGA under Heterogeneous Computing Framework with OpenCL

Design of FPGA-Based Accelerator for Convolutional Neural Network under Heterogeneous Computing Framework with OpenCL

Heterogeneous Computing for CNN

Exploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs

A Scalable FPGA Accelerator for Convolutional Neural Networks.

Optimization of Convolution Neural Network Algorithm Based on FPGA

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Heterogeneous FPGA-Based Cost-Optimal Design for Timing-Constrained CNNs

A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks

Caffeinated FPGAs: FPGA Framework For Convolutional Neural Networks

A Self-adaptation Method of Fitting Convolutional Neural Network into FPGA: Abstract Only).

Throughput-Optimized Opencl-Based Fpga Accelerator For Large-Scale Convolutional Neural Networks

PipeCNN: An OpenCL-Based FPGA Accelerator for Large-Scale Convolution Neuron Networks

A Memory-Optimized and Energy-Efficient CNN Acceleration Architecture Based on FPGA.

Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network

A GPU-Outperforming FPGA Accelerator Architecture for Binary Convolutional Neural Networks

Improving CNN Performance on FPGA Clusters Through Topology Exploration

UniCNN: A Pipelined Accelerator Towards Uniformed Computing for CNNs

Scalable FPGA-Based Convolutional Neural Network Accelerator for Embedded Systems

Implementation of Convolutional Neural Network with Co-design of High-Level Synthesis and Verilog HDL

Energy-Efficient And High-Throughput Fpga-Based Accelerator For Convolutional Neural Networks