Abstract:Deep convolutional neural networks (CNN) have achieved remarkable performance with the cost of huge computation. As the CNN model becomes more complex and deeper, compressing CNN to sparse by pruning the redundant connection in networks has emerged as an attractive approach to reduce the amount of computation and memory requirement. In recent years, FPGAs have been demonstrated to be an effective hardware platform to accelerate CNN inference. However, most existing FPGA architectures focus on dense CNN models. The architecture designed for dense CNN models are inefficient when executing sparse models as most of the arithmetic operations involve addition and multiplication with zero operands. On the other hand, recent sparse FPGA accelerators only focus on FC layers. In this work, we aim to develop an FPGA accelerator for sparse CNNs. To efficiently deal with the irregular connection in the sparse convolutional layer, we propose a weight-oriented dataflow that processes each weight individually. Then we design an FPGA architecture which can handle input-weight connection and weight-output connection efficiently. For input-weight connection, we design a tile look-up table to eliminate the runtime indexing match of compressed weights. Moreover, we develop a weight layout to enable high on-chip memory access. To cooperate with the weight layout, a channel multiplexer is inserted to locate the address which can ensure no data access conflict. Experiments demonstrate that our accelerator can achieve 223.4-309.0 GOP/s for the modern CNNs on Xilinx ZCU102, which provides a 3.6x-12.9x speedup over previous dense CNN FPGA accelerators.

A Fine-Grained Parallel Snappy Decompressor for FPGAs Using a Relaxed Execution Model

Work-in-Progress: A High-Bandwidth Snappy Decompressor in Reconfigurable Logic

Refine and Recycle: A Method to Increase Decompression Parallelism.

An Efficient High-Throughput LZ77-Based Decompressor in Reconfigurable Logic

Using Data Compression For Optimizing Fpga-Based Convolutional Neural Network Accelerators

A Compression Method for Inverted Index and Its FPGA-based Decompression Solution.

FPGA Acceleration of Zstd Compression Algorithm

FPGA-Accelerated Compactions for LSM-based Key-Value Store.

A self-aware data compression system on FPGA in Hadoop

MetaZip: a high-throughput and efficient accelerator for DEFLATE

Spwa: An Efficient Sparse Winograd Convolutional Neural Networks Accelerator On Fpgas

High-Efficiency Compressor Trees for Latest AMD FPGAs

Novel hardware architecture of sparse recovery based on FPGAs

Lossless Compression Decoders for Bitstreams and Software Binaries Based on High-Level Synthesis.

Exploiting Stable Data Dependency in Stream Processing Acceleration on FPGAs

Design Principles for Packet Deparsers on FPGAs

An Efficient Lossless Compression Method for Internet Search Data in Hardware Accelerators

UH-JLS: A Parallel Ultra-High Throughput JPEG-LS Encoding Architecture for Lossless Image Compression

FPGA bitstream compression and decompression using LZ and golomb coding (abstract only).

An Efficient Hardware Accelerator for Sparse Convolutional Neural Networks on FPGAs

Work-in-Progress: A High-performance FPGA Accelerator for Sparse Neural Networks