Abstract:Exploding development of convolutional neural network (CNN) benefits greatly from the hardware-based acceleration to maintain low latency and high utilization of resources. To enhance the processing efficiency of CNN algorithms, Field Programming Gate Array (FPGA)-based accelerators are designed with increased hardware resources to achieve high parallelism and throughput. However, there exist bottlenecks when more processing elements (PEs) in the form of PE clusters are introduced, including 1) the under-utilization of FPGA's fixed hardware resources, which leads to the effective and peak performance mismatch; and 2) the limited clock frequency caused by the sophisticated routing and complex placement. In this paper, a 2-level hierarchical Network-on-Chip (NoC)-based CNN accelerator is proposed. In the upper level, a mesh-based NoC that interconnects multiple PE clusters is introduced. Such a design not only provides increased flexibility to balance different data communication models for better PE utilization and energy efficiency but also enables globally asynchronous, locally synchronous (GALS) architecture for better timing closure. At the lower level, local PEs are organized into a 3D-tiled PE cluster aiming to maximize the data reuse exploiting inherent dataflow of the convolution networks. Implementation and experiments on Xilinx ZU9EG FPGA for 4 benchmark CNN models: ResNet50, ResNet34, VGG16, and Darknet19 show that our work operates at a frequency of 300 MHz and delivers an effective throughput of 0.998 TOPS, 1.022 TOPS, 1.024 TOPS, and 1.026 TOPS. This result corresponds to 92.85%, 95.1%, 95.25%, and 95.46% PE utilization. Compared with the related FPGA-based de

A 16.41 TOPS/W CNN Accelerator with Event-Based Layer Fusion for Real-Time Inference

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

High Throughput CNN Accelerator Design Based on FPGA

An Asynchronous Energy-Efficient CNN Accelerator with Reconfigurable Architecture.

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

A High-performance Inference Accelerator Exploiting Patterned Sparsity in CNNs

A Low-Power Hardware Architecture for Real-Time CNN Computing

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs

A Reconfigurable Accelerator for Sparse Convolutional Neural Networks.

A Power-Efficient Accelerator for Convolutional Neural Networks

High-Performance FPGA-Based CNN Accelerator with Block-Floating-Point Arithmetic.

Toward Full-Stack Acceleration of Deep Convolutional Neural Networks on FPGAs

An Efficient CNN Inference Accelerator Based on Intra- and Inter-Channel Feature Map Compression

FPGA-Based High-Throughput CNN Hardware Accelerator With High Computing Resource Utilization Ratio

A flexible FPGA accelerator for convolutional neural networks

A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks

Communication-Aware and Resource-Efficient NoC-Based Architecture for CNN Acceleration

UniCNN: A Pipelined Accelerator Towards Uniformed Computing for CNNs

A High Performance FPGA-based Accelerator for Large-Scale Convolutional Neural Networks