Abstract:A neural network accelerated optimization method for FPGA hardware platform is proposed. The method realizes the optimized deployment of neural network algorithms for FPGA hardware platforms from three aspects: computational speed, flexible transplantation, and development methods. Replacing multiplication based on Mitchell algorithm not only breaks through the speed bottleneck of neural network hardware acceleration caused by long multiplication period, but also makes the parallel acceleration of neural network algorithm get rid of the dependence on the number of hardware multipliers in FPGA, which can give full play to the advantages of FPGA parallel acceleration and maximize the computing speed. Based on the configurable strategy of neural network parameters, the number of network layers and nodes within layers can be adjusted according to different logical resource of FPGA, improving the flexibility of neural network transplantation. The adoption of HLS development method overcomes the shortcomings of RTL method in designing complex neural network algorithms, such as high difficulty in development and long development cycle. Using the Cyclone V SE 5CSEBA6U23I7 FPGA as the target device, a parameter configurable BP neural network was designed based on the proposed method. The usage of logical resources such as ALUT, Flip-Flop, RAM, and DSP were 39.6%, 40%, 56.9%, and 18.3% of the pre-optimized ones, respectively. The feasibility of the proposed method was verified using MNIST digital recognition and facial recognition as application scenarios. Compare to pre-optimization, the test time of MNIST number recognition is reduced to 67.58%, and the success rate was lost 0.195%. The test time for facial recognition applications was reduced to 69.571%, and the success rate of combining LDA algorithm was lost within 4%.

Work-in-Progress: WinoNN: Optimising FPGA-based Neural Network Accelerators Using Fast Winograd Algorithm

WinoNN: Optimizing FPGA-Based Convolutional Neural Network Accelerators Using Sparse Winograd Algorithm

WinoCNN: Kernel Sharing Winograd Systolic Array for Efficient Convolutional Neural Network Acceleration on FPGAs

A High-efficiency FPGA-based Accelerator for Convolutional Neural Networks using Winograd Algorithm

An OpenCL-Based FPGA Accelerator with the Winograd’s Minimal Filtering Algorithm for Convolution Neuron Networks

Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs

A High Performance FPGA-based Accelerator for MobileNet

BISWSRBS: A Winograd-based CNN Accelerator with a Fine-grained Regular Sparsity Pattern and Mixed Precision Quantization

An FPGA-Based Reconfigurable CNN Training Accelerator Using Decomposable Winograd

Instruction driven cross-layer CNN accelerator with winograd transformation on FPGA

WinTA: an Efficient Reconfigurable CNN Training Accelerator with Decomposition Winograd

A neural network accelerated optimization method for FPGA

Winols: A Large-Tiling Sparse Winograd CNN Accelerator on FPGAs

Spwa: An Efficient Sparse Winograd Convolutional Neural Networks Accelerator On Fpgas

Exploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs

A Reconfigurable DNN Training Accelerator on FPGA

WRA-MF: A Bit-Level Convolutional-Weight-Decomposition Approach to Improve Parallel Computing Efficiency for Winograd-Based CNN Acceleration

A Winograd-Based CNN Accelerator with a Fine-Grained Regular Sparsity Pattern

Sparse Winograd Convolutional neural networks on small-scale systolic arrays

An Operation-Minimized FPGA Accelerator Design by Dynamically Exploiting Sparsity in CNN Winograd Transform

HAO: Hardware-aware neural Architecture Optimization for Efficient Inference