Abstract:Exploding development of convolutional neural network (CNN) benefits greatly from the hardware-based acceleration to maintain low latency and high utilization of resources. To enhance the processing efficiency of CNN algorithms, Field Programming Gate Array (FPGA)-based accelerators are designed with increased hardware resources to achieve high parallelism and throughput. However, there exist bottlenecks when more processing elements (PEs) in the form of PE clusters are introduced, including 1) the under-utilization of FPGA's fixed hardware resources, which leads to the effective and peak performance mismatch; and 2) the limited clock frequency caused by the sophisticated routing and complex placement. In this paper, a 2-level hierarchical Network-on-Chip (NoC)-based CNN accelerator is proposed. In the upper level, a mesh-based NoC that interconnects multiple PE clusters is introduced. Such a design not only provides increased flexibility to balance different data communication models for better PE utilization and energy efficiency but also enables globally asynchronous, locally synchronous (GALS) architecture for better timing closure. At the lower level, local PEs are organized into a 3D-tiled PE cluster aiming to maximize the data reuse exploiting inherent dataflow of the convolution networks. Implementation and experiments on Xilinx ZU9EG FPGA for 4 benchmark CNN models: ResNet50, ResNet34, VGG16, and Darknet19 show that our work operates at a frequency of 300 MHz and delivers an effective throughput of 0.998 TOPS, 1.022 TOPS, 1.024 TOPS, and 1.026 TOPS. This result corresponds to 92.85%, 95.1%, 95.25%, and 95.46% PE utilization. Compared with the related FPGA-based de

IECA: An In-Execution Configuration CNN Accelerator With 30.55 GOPS/mm² Area Efficiency

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

A High Efficient Architecture for Convolution Neural Network Accelerator

An Area-Efficient CNN Accelerator Supporting Global Average Pooling with Arbitrary Shapes

A Flexible and Energy-Efficient Convolutional Neural Network Acceleration with Dedicated ISA and Accelerator

A Reconfigurable Accelerator for Sparse Convolutional Neural Networks.

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

Efficient Hardware Architectures for Deep Convolutional Neural Network

An Efficient CNN Inference Accelerator Based on Intra- and Inter-Channel Feature Map Compression

An Efficient Accelerator for Multiple Convolutions From the Sparsity Perspective

High-Performance FPGA-Based CNN Accelerator with Block-Floating-Point Arithmetic.

Communication-Aware and Resource-Efficient NoC-Based Architecture for CNN Acceleration

FPGA-Based High-Throughput CNN Hardware Accelerator With High Computing Resource Utilization Ratio

A 16.41 TOPS/W CNN Accelerator with Event-Based Layer Fusion for Real-Time Inference

A Parallel Loading Based Accelerator for Convolution Neural Network

A Reconfigurable Spatial Architecture for Energy-Efficient Inception Neural Networks

A flexible FPGA accelerator for convolutional neural networks

An Asynchronous Energy-Efficient CNN Accelerator with Reconfigurable Architecture.

An Enhanced Data Cache with In-Cache Processing Units for Convolutional Neural Network Accelerators