Abstract:In recent years, a variety of accelerators on FPGAs have been proposed to speed up the convolutional neural network (CNN) in many domain-specific application fields. Besides, some optimization algorithms, such as fast algorithms and network sparsity, have greatly reduced the theoretical computational workload of CNN inference. There are currently a few accelerators on FPGAs that support both the fast Winograd algorithm (WinoA) and network sparsity to minimize the amount of computation. However, on the one hand, these architectures feed data into processing elements (PEs) in units of blocks, some boundary losses caused by sparse irregularities cannot be avoided. On the other hand, these works have not discussed the design space exploration under the sparse condition. In this article, we propose a novel accelerator called WINONN. We fully discuss the challenges faced by supporting WinoA, weight sparsity, and activation sparsity simultaneously. To minimize the online encoding overhead caused by activation sparsity, an efficient encoding format called multibit mask (MBM) is proposed. To handle the irregularities of sparse data, we proposed a novel Scatter-Compute-Gather method in hardware design, combined with a freely sliding buffer to achieve fine-grained data loading to minimize the boundary waste. Finally, we combine a theoretical analysis and experimental method to explore the design space, allowing WINONN to get the best performance on a specific FPGA. Our high scalability design enables us to deploy sparse Winograd accelerators on very small embedded FPGAs, which is not supported in previous works. The experimental results on VGG16 show that we achieve the highest digital signal processing unit (DSP) efficiency and highest energy efficiency compared with the state-of-the-art sparse architectures.

WinoNN: Optimizing FPGA-Based Convolutional Neural Network Accelerators Using Sparse Winograd Algorithm

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Winols: A Large-Tiling Sparse Winograd CNN Accelerator on FPGAs

WinoCNN: Kernel Sharing Winograd Systolic Array for Efficient Convolutional Neural Network Acceleration on FPGAs

Spwa: An Efficient Sparse Winograd Convolutional Neural Networks Accelerator On Fpgas

Work-in-Progress: WinoNN: Optimising FPGA-based Neural Network Accelerators Using Fast Winograd Algorithm

BISWSRBS: A Winograd-based CNN Accelerator with a Fine-grained Regular Sparsity Pattern and Mixed Precision Quantization

A Winograd-Based CNN Accelerator with a Fine-Grained Regular Sparsity Pattern

An Operation-Minimized FPGA Accelerator Design by Dynamically Exploiting Sparsity in CNN Winograd Transform

WRA-SS: A High-Performance Accelerator Integrating Winograd with Structured Sparsity for Convolutional Neural Networks

A High-efficiency FPGA-based Accelerator for Convolutional Neural Networks using Winograd Algorithm

Sparse Winograd Convolutional neural networks on small-scale systolic arrays

FPGA Accelerator for CNN: an Exploration of the Kernel Structured Sparsity and Hybrid Arithmetic Computation

An Efficient Accelerator for Sparse Convolutional Neural Networks

An Efficient and Flexible Accelerator Design for Sparse Convolutional Neural Networks

A Low-Latency Sparse-Winograd Accelerator For Convolutional Neural Networks

An Efficient Hardware Accelerator for Sparse Convolutional Neural Networks on FPGAs

A Reconfigurable Accelerator for Sparse Convolutional Neural Networks.

An Efficient Sparse CNNs Accelerator on FPGA

An Efficient FPGA Accelerator Optimized for High Throughput Sparse CNN Inference.

An Efficient Hardware Accelerator for Structured Sparse Convolutional Neural Networks on FPGAs