Abstract:Convolutional neural network (CNN) has been widely employed for image recognition because it can achieve high accuracy by emulating behavior of optic nerves in living creatures. Recently, rapid growth of modern applications based on deep learning algorithms has further improved research and implementations. Especially, various accelerators for deep CNN have been proposed based on FPGA platform because it has advantages of high performance, reconfigurability, and fast development round, etc. Although current FPGA accelerators have demonstrated better performance over generic processors, the accelerator design space has not been well exploited. One critical problem is that the computation throughput may not well match the memory bandwidth provided an FPGA platform. Consequently, existing approaches cannot achieve best performance due to under-utilization of either logic resource or memory bandwidth. At the same time, the increasing complexity and scalability of deep learning applications aggravate this problem. In order to overcome this problem, we propose an analytical design scheme using the roofline model. For any solution of a CNN design, we quantitatively analyze its computing throughput and required memory bandwidth using various optimization techniques, such as loop tiling and transformation. Then, with the help of rooine model, we can identify the solution with best performance and lowest FPGA resource requirement. As a case study, we implement a CNN accelerator on a VC707 FPGA board and compare it to previous approaches. Our implementation achieves a peak performance of 61.62 GFLOPS under 100MHz working frequency, which outperform previous approaches significantly.

Design of FPGA Accelerator Architecture for Convolutional Neural Network

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

FPGA-based Accelerator for Convolutional Neural Network

Design and Implementation of a FPGA-based Accelerator for Convolutional Neural Networks

FPGA deep learning acceleration based on convolutional neural network

Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks

A High Energy Efficiency and Low Resource Consumption FPGA Accelerator for Convolutional Neural Network

Throughput-Optimized FPGA Accelerator for Deep Convolutional Neural Networks

Toward Full-Stack Acceleration of Deep Convolutional Neural Networks on FPGAs

A High Performance FPGA-based Accelerator for Large-Scale Convolutional Neural Networks

Design of FPGA-Based Accelerator for Convolutional Neural Network under Heterogeneous Computing Framework with OpenCL

An FPGA-Based CNN Accelerator Integrating Depthwise Separable Convolution

A FPGA-based Hardware Accelerator for Multiple Convolutional Neural Networks

An Efficient Convolutional Neural Network Accelerator on FPGA

CaFPGA: an Automatic Generation Model for CNN Accelerator.

FPGA-based Design for Convolution Neural Network

FPGA Accelerator for CNN: an Exploration of the Kernel Structured Sparsity and Hybrid Arithmetic Computation

A Power-Efficient and High Performance FPGA Accelerator for Convolutional Neural Networks: Work-in-progress.

WPU: A FPGA-based Scalable, Efficient and Software/Hardware Co-design Deep Neural Network Inference Acceleration Processor

A High-Performance Accelerator for Large-Scale Convolutional Neural Networks

An Efficient Design Flow for Accelerating Complicated-connected CNNs on a Multi-FPGA Platform.