Abstract:FPGA accelerators for lightweight neural convolutional networks (LWCNNs) have recently attracted significant attention. Most existing LWCNN accelerators focus on single-Computing-Engine (CE) architecture with local optimization. However, these designs typically suffer from high on-chip/off-chip memory overhead and low computational efficiency due to their layer-by-layer dataflow and unified resource mapping mechanisms. To tackle these issues, a novel multi-CE-based accelerator with balanced dataflow is proposed to efficiently accelerate LWCNN through memory-oriented and computing-oriented optimizations. Firstly, a streaming architecture with hybrid CEs is designed to minimize off-chip memory access while maintaining a low cost of on-chip buffer size. Secondly, a balanced dataflow strategy is introduced for streaming architectures to enhance computational efficiency by improving efficient resource mapping and mitigating data congestion. Furthermore, a resource-aware memory and parallelism allocation methodology is proposed, based on a performance model, to achieve better performance and scalability. The proposed accelerator is evaluated on Xilinx ZC706 platform using MobileNetV2 and <a class="link-external link-http" href="http://ShuffleNetV2.Implementation" rel="external noopener nofollow">this http URL</a> results demonstrate that the proposed accelerator can save up to 68.3% of on-chip memory size with reduced off-chip memory access compared to the reference design. It achieves an impressive performance of up to 2092.4 FPS and a state-of-the-art MAC efficiency of up to 94.58%, while maintaining a high DSP utilization of 95%, thus significantly outperforming current LWCNN accelerators.

Design of Efficient CNN Accelerator Based on Zynq Platform.

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

Power Efficient Tiny Yolo CNN Using Reduced Hardware Resources Based on Booth Multiplier and WALLACE Tree Adders

High-Speed CNN Accelerator SoC Design Based on a Flexible Diagonal Cyclic Array

Hardware-Efficient Template-Based Deep CNNs Accelerator Design

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

A High-Throughput FPGA Accelerator for Lightweight CNNs With Balanced Dataflow

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A Lightweight Detection Method for Remote Sensing Images and Its Energy-Efficient Accelerator on Edge Devices

A FPGA-based Hardware Accelerator for Multiple Convolutional Neural Networks

Efficient Hardware Architectures for Deep Convolutional Neural Network

Exploring Hardware Friendly Bottleneck Architecture In Cnn For Embedded Computing Systems

An Efficient Sparse CNNs Accelerator on FPGA

Smilodon: an Efficient Accelerator for Low Bit-Width CNNs with Task Partitioning

A High-Performance Systolic Array Accelerator Dedicated for CNN.

Communication-Aware and Resource-Efficient NoC-Based Architecture for CNN Acceleration

A High-Performance Pixel-Level Fully Pipelined Hardware Accelerator for Neural Networks

A Power-Efficient Accelerator for Convolutional Neural Networks

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks