Abstract:The Winograd algorithm reduces the computational complexity of convolutional neural networks (CNNs) by minimizing the number of multiplications required for convolutions, making it particularly suitable for resource-constrained edge devices. Concurrently, most edge hardware accelerators utilize 8-bit integer arithmetic to enhance energy efficiency and reduce inference latency, requiring the quantization of CNNs before deployment. Combining Winograd-based convolution with quantization offers the potential for both performance acceleration and reduced energy consumption. However, prior research has identified significant challenges in this combination, particularly due to numerical instability and substantial accuracy degradation caused by the transformations required in the Winograd domain, making the two techniques incompatible on edge hardware. In this work, we describe our latest training scheme, which addresses these challenges, enabling the successful integration of Winograd-accelerated convolution with low-precision quantization while maintaining high task-related accuracy. Our approach mitigates the numerical instability typically introduced during the transformation, ensuring compatibility between the two techniques. Additionally, we extend our work by presenting a custom-optimized CUDA implementation of quantized Winograd convolution for NVIDIA edge GPUs. This implementation takes full advantage of the proposed training scheme, achieving both high computational efficiency and accuracy, making it a compelling solution for edge-based AI applications. Our training approach enables significant MAC reduction with minimal impact on prediction quality. Furthermore, our hardware results demonstrate up to a 3.4× latency reduction for specific layers, and a 1.44× overall reduction in latency for the entire DeepLabV3 model, compared to the standard implementation.

3D-NWA: A Nested-Winograd Accelerator for 3D CNNs

3D-VNPU: A Flexible Accelerator for 2D/3D CNNs on FPGA.

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

FWUA : A Flexible Winograd-Based Uniform Accelerator for 1D/2D/3D CNNs

Winols: A Large-Tiling Sparse Winograd CNN Accelerator on FPGAs

A High-efficiency FPGA-based Accelerator for Convolutional Neural Networks using Winograd Algorithm

WinoCNN: Kernel Sharing Winograd Systolic Array for Efficient Convolutional Neural Network Acceleration on FPGAs

High Performance Implementation of 3D Convolutional Neural Networks on a GPU

Dimension Fusion: Dimension-level Dynamically Composable Accelerator for Convolutional Neural Networks

BISWSRBS: A Winograd-based CNN Accelerator with a Fine-grained Regular Sparsity Pattern and Mixed Precision Quantization

WinoNN: Optimizing FPGA-Based Convolutional Neural Network Accelerators Using Sparse Winograd Algorithm

Spwa: An Efficient Sparse Winograd Convolutional Neural Networks Accelerator On Fpgas

Accelerating Large Kernel Convolutions with Nested Winograd Transformation.pdf

End-to-End Deployment of Winograd-Based DNNs on Edge GPU

3D CNN Acceleration on FPGA using Hardware-Aware Pruning

A Winograd-Based CNN Accelerator with a Fine-Grained Regular Sparsity Pattern

Low-Rank Winograd Transformation for 3D Convolutional Neural Networks

Instruction driven cross-layer CNN accelerator with winograd transformation on FPGA

A Novel Low-Communication Energy-Efficient Reconfigurable CNN Acceleration Architecture

Towards Design Space Exploration and Optimization of Fast Algorithms for Convolutional Neural Networks (CNNs) on FPGAs

Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs