Abstract:Summary Convolutional neural networks (CNNs) have shown remarkable advantages in a wide range of domains at the expense of huge parameters and computations. Modern CNNs still tend to be more complex and larger to achieve better inference accuracy. However, the complex and large structures of CNNs could slow down the inference speed. Recently, Compressing the convolutional weights to be sparse by pruning the unimportant parameters has been demonstrated as an efficient way to reduce the computations of CNNs. On the other hand, field‐programmable gate arrays (FPGAs) have been a popular hardware platform to accelerate CNN inference. In this paper, we propose an algorithm/hardware co‐optimized method for accelerating CNN inference on FPGAs. For the algorithm, we take advantage of unstructured and structured parameter sparsifying methods to achieve high sparsity and keep the regularity of convolutional weights. Correspondingly, hardware‐friendly index representations of sparse convolutional weights are proposed. For the hardware architecture, we propose row‐wise input‐stationary dataflow, which is tightly coupled with the algorithm. A row‐wise computing engine (RConv Engine) is proposed, which is based on the dataflow. Inside the RConv Engine, the scalar‐vector structure is applied to implement the basic processing elements (PEs). To flexibly calculate the feature map with various sizes, the PEs are organized in a 2D structure with two work modes. The experimental results demonstrate that our co‐optimized method implements high sparsity of convolutional weights, and the computing engine achieves high computation efficiency. Compared with other accelerators, our co‐optimized method implements a 10.9× speedup on FPS at most with the highest sparsity of convolutional weights and negligible accuracy loss.

An Optimization Method of WebP Images Lossy Compression Algorithm for FPGAs.

An OpenCLTM Implementation of WebP Accelerator on FPGAs.

HybriDC: A Resource-Efficient CPU-FPGA Heterogeneous Acceleration System for Lossless Data Compression

An algorithm/hardware co‐optimized method to accelerate CNNs with compressed convolutional weights on FPGA

An Image Histogram Equalization Acceleration Method for Field-Programmable Gate Arrays Based on a Two-Dimensional Configurable Pipeline

Adaptive Pipeline Hardware Architecture Design and Implementation for Image Lossless Compression/Decompression Based on JPEG-LS

Research and Implementation of FPGA Image Compression Parallel Algorithm Based on CCSDS

Spwa: An Efficient Sparse Winograd Convolutional Neural Networks Accelerator On Fpgas

Multi-core Lossless Compression System for High-speed Data and Its FPGA Implementation

Streaming Sorting Network Based BWT Acceleration on FPGA for Lossless Compression.

A neural network accelerated optimization method for FPGA

Custom Network Quantization Method for Lightweight CNN Acceleration on FPGAs

Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks

An Efficient CNN Accelerator for Pattern-Compressed Sparse Neural Networks on FPGA

WPU: A FPGA-based Scalable, Efficient and Software/Hardware Co-design Deep Neural Network Inference Acceleration Processor

Leveraging Seed Generation for Efficient Hardware Acceleration of Lossless Compression of Remotely Sensed Hyperspectral Images

UH-JLS: A Parallel Ultra-High Throughput JPEG-LS Encoding Architecture for Lossless Image Compression

Design optimization for high-performance computing using FPGA

A High-efficiency FPGA-based Accelerator for Convolutional Neural Networks using Winograd Algorithm

FPGA Acceleration of Zstd Compression Algorithm

Design of FPGA-Based Accelerator for Convolutional Neural Network under Heterogeneous Computing Framework with OpenCL