Abstract:FPGA accelerators for lightweight neural convolutional networks (LWCNNs) have recently attracted significant attention. Most existing LWCNN accelerators focus on single-Computing-Engine (CE) architecture with local optimization. However, these designs typically suffer from high on-chip/off-chip memory overhead and low computational efficiency due to their layer-by-layer dataflow and unified resource mapping mechanisms. To tackle these issues, a novel multi-CE-based accelerator with balanced dataflow is proposed to efficiently accelerate LWCNN through memory-oriented and computing-oriented optimizations. Firstly, a streaming architecture with hybrid CEs is designed to minimize off-chip memory access while maintaining a low cost of on-chip buffer size. Secondly, a balanced dataflow strategy is introduced for streaming architectures to enhance computational efficiency by improving efficient resource mapping and mitigating data congestion. Furthermore, a resource-aware memory and parallelism allocation methodology is proposed, based on a performance model, to achieve better performance and scalability. The proposed accelerator is evaluated on Xilinx ZC706 platform using MobileNetV2 and <a class="link-external link-http" href="http://ShuffleNetV2.Implementation" rel="external noopener nofollow">this http URL</a> results demonstrate that the proposed accelerator can save up to 68.3% of on-chip memory size with reduced off-chip memory access compared to the reference design. It achieves an impressive performance of up to 2092.4 FPS and a state-of-the-art MAC efficiency of up to 94.58%, while maintaining a high DSP utilization of 95%, thus significantly outperforming current LWCNN accelerators.

Smilodon: an Efficient Accelerator for Low Bit-Width CNNs with Task Partitioning

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs

Power Efficient Tiny Yolo CNN Using Reduced Hardware Resources Based on Booth Multiplier and WALLACE Tree Adders

An Efficient Sparse CNNs Accelerator on FPGA

A High-Performance Systolic Array Accelerator Dedicated for CNN.

High-Performance FPGA-Based CNN Accelerator with Block-Floating-Point Arithmetic.

Accelerating Low Bit-Width Convolutional Neural Networks with Embedded FPGA.

An Efficient Accelerator for Multiple Convolutions From the Sparsity Perspective

Efficient Hardware Architectures for Deep Convolutional Neural Network

High-Speed CNN Accelerator SoC Design Based on a Flexible Diagonal Cyclic Array

An FPGA-Based Accelerator Enabling Efficient Support for CNNs with Arbitrary Kernel Sizes

Energy-Efficient And High-Throughput Fpga-Based Accelerator For Convolutional Neural Networks

An FPGA-Based CNN Accelerator Integrating Depthwise Separable Convolution

A High Performance FPGA-based Accelerator for Large-Scale Convolutional Neural Networks

A High-Throughput FPGA Accelerator for Lightweight CNNs With Balanced Dataflow

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

Maximizing CNN Accelerator Efficiency Through Resource Partitioning

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks