Abstract:Convolutional neural networks (CNNs) are rapidly evolving and being applied to a broad range of applications. Given a specific application, an increasing challenge is to search the appropriate CNN algorithm and efficiently map it to the target hardware. The FPGA-based accelerator has the advantage of reconfigurability and flexibility, and has achieved highperformance and low-power. Without a general compiler to automate the implementation, however, significant efforts and expertise are still required to customize the design for each CNN model. In this work, we present an RTL-level CNN compiler that automatically generates customized FPGA hardware for the inference tasks of various CNNs, in order to enable high-level fast prototyping of CNNs from software to FPGA and still keep the benefits of low-level hardware optimization. First, a generalpurpose library of RTL modules is developed to model different operations at each layer. The implementation of each module is optimized at the RTL level. Given a CNN algorithm, its structure is abstracted to a directed acyclic graph (DAG) and then complied with RTL modules in the library. The integration and dataflow of physical modules are predefined in the top-level system template and reconfigured during compilation. The runtime control of layer-by-layer sequential computation is managed by the proposed execution schedule so that even highly irregular and complex network topology, e.g. ResNet, can be compiled. The proposed methodology is demonstrated with end-to-end FPGA implementations of various CNN algorithms (e.g. NiN, VGG-16, ResNet-50, and ResNet-152) on two standalone Intel FPGAs, Stratix V and Arria 10. The performance and overhead of the automated compilation are evaluated. The compiled FPGA accelerators exhibit superior performance compared to state-ofthe- art automation-based works by >2x for various CNNs.

Automatic Modulation Recognition: An FPGA Implementation

Low-precision deep-learning-based automatic modulation recognition system

Implementation of Deep Learning-based Automatic Modulation Classifier on FPGA SDR Platform

Modulation Recognition Using an FPGA-based Convolutional Neural Network

HLS-Based FPGA Implementation of Convolutional Deep Belief Network for Signal Modulation Recognition

AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers

Scalable and Modularized RTL Compilation of Convolutional Neural Networks Onto FPGA

Adaptive design and implementation of automatic modulation recognition accelerator

Quantization-Based Optimization Algorithm for Hardware Implementation of Convolution Neural Networks

Deploying deep learning networks based advanced techniques for image processing on FPGA platform

Design and Implementation of a Real-Time Low-Latency Automatic Modulation Classifier

HARDWARE ACCELERATOR: IMPLEMENTATION OF CNN ON FPGA FOR DIGIT RECOGNITION

FPGA-Based Hybrid-Type Implementation of Quantized Neural Networks for Remote Sensing Applications

Automatic Modulation Classification: A Deep Learning Enabled Approach

An Automatic Rtl Compiler For High-Throughput Fpga Implementation Of Diverse Deep Convolutional Neural Networks

A hardware-friendly logarithmic quantization method for CNNs and FPGA implementation

Automated flow for compressing convolution neural networks for efficient edge-computation with FPGA

FPGA Implementation of Quantized Convolutional Neural Networks.

An Efficient FPGA-Based Implementation for Quantized Remote Sensing Image Scene Classification Network

A Real-time P-SFA hardware implementation of Deep Neural Networks using FPGA

Deep Learning-Based Automatic Modulation Classification Using Robust CNN Architecture for Cognitive Radio Networks