Abstract:Convolutional Neural Networks (CNNs) have a major impact on our society because of the numerous services they provide. On the other hand, they require considerable computing power. To satisfy these requirements, it is possible to use graphic processing units (GPUs). However, high power consumption and limited external IOs constrain their usability and suitability in industrial and mission-critical scenarios. Recently, the number of researches that utilize FPGAs to implement CNNs are increasing rapidly. This is due to the lower power consumption and easy reconfigurability offered by these platforms. Because of the research efforts put into topics such as architecture, synthesis and optimization, some new challenges are arising to integrate such hardware solutions to high-level machine learning software libraries. This paper introduces an integrated framework (CNN2Gate) that supports compilation of a CNN model for an FPGA target. CNN2Gate exploits the OpenCL synthesis workflow for FPGAs offered by commercial vendors. CNN2Gate is capable of parsing CNN models from several popular high-level machine learning libraries such as Keras, Pytorch, Caffe2 etc. CNN2Gate extracts computation flow of layers, in addition to weights and biases and applies a "given" fixed-point quantization. Furthermore, it writes this information in the proper format for OpenCL synthesis tools that are then used to build and run the project on FPGA. CNN2Gate performs design-space exploration using a reinforcement learning agent and fits the design on different FPGAs with limited logic resources automatically. This paper reports results of automatic synthesis and design-space exploration of AlexNet and VGG-16 on various Intel FPGA platforms. CNN2Gate achieves a latency of 205 ms for VGG-16 and 18 ms for AlexNet on the FPGA.

Tactics to Directly Map CNN Graphs on Embedded FPGAs

Hardware Automated Dataflow Deployment of CNNs

CNN2Gate: Toward Designing a General Framework for Implementation of Convolutional Neural Networks on FPGA

fpgaHART: A toolflow for throughput-oriented acceleration of 3D CNNs for HAR onto FPGAs

Accelerating CNN inference on FPGAs: A Survey

Toward Full-Stack Acceleration of Deep Convolutional Neural Networks on FPGAs

Deploying deep learning networks based advanced techniques for image processing on FPGA platform

Automated Systolic Array Architecture Synthesis for High Throughput CNN Inference on FPGAs.

A Holistic Approach for Optimizing DSP Block Utilization of a CNN implementation on FPGA

DYNAMAP: Dynamic Algorithm Mapping Framework for Low Latency CNN Inference

PipeCNN: An OpenCL-Based FPGA Accelerator for Large-Scale Convolution Neuron Networks

FP-DNN: an Automated Framework for Mapping Deep Neural Networks Onto FPGAs with RTL-HLS Hybrid Templates

Automatic Compilation of Diverse CNNs Onto High-Performance FPGA Accelerators

Design of Convolutional Neural Network Based on FPGA

A FPGA-based Accelerator of Convolutional Neural Network for Face Feature Extraction

FPGA-Based High-Throughput CNN Hardware Accelerator With High Computing Resource Utilization Ratio

HPIPE: Heterogeneous Layer-Pipelined and Sparse-Aware CNN Inference for FPGAs

HARDWARE ACCELERATOR: IMPLEMENTATION OF CNN ON FPGA FOR DIGIT RECOGNITION

Optimization for Efficient Hardware Implementation of CNN on FPGA

A Design Methodology for Efficient Implementation of Deconvolutional Neural Networks on an FPGA

Communication-Aware and Resource-Efficient NoC-Based Architecture for CNN Acceleration