Abstract:Today's graphics processing unit (GPU) applications produce vast volumes of data, which are challenging to store and transfer efficiently. Thus, data compression is becoming a critical technique to mitigate the storage burden and communication cost. LZSS is the core algorithm in many widely used compressors, such as Deflate. However, existing GPU-based LZSS compressors suffer from low throughput due to the sequential nature of the LZSS algorithm. Moreover, many GPU applications produce multi-byte data (e.g., int16/int32 index, floating-point numbers), while the current LZSS compression only takes single-byte data as input. To this end, in this work, we propose GPULZ, a highly efficient LZSS compression on modern GPUs for multi-byte data. The contribution of our work is fourfold: First, we perform an in-depth analysis of existing LZ compressors for GPUs and investigate their main issues. Then, we propose two main algorithm-level optimizations. Specifically, we (1) change prefix sum from one pass to two passes and fuse multiple kernels to reduce data movement between shared memory and global memory, and (2) optimize existing pattern-matching approach for multi-byte symbols to reduce computation complexity and explore longer repeated patterns. Third, we perform architectural performance optimizations, such as maximizing shared memory utilization by adapting data partitions to different GPU architectures. Finally, we evaluate GPULZ on six datasets of various types with NVIDIA A100 and A4000 GPUs. Results show that GPULZ achieves up to 272.1X speedup on A4000 and up to 1.4X higher compression ratio compared to state-of-the-art solutions.

Fpga Bitstream Compression and Decompression Based on Lz77 Algorithm and Bmc Technique

FPGA bitstream compression and decompression using LZ and golomb coding (abstract only).

Strategy for compression of medical image in real time with bit-plane runlength coding

FPGA Acceleration of Zstd Compression Algorithm

Lossless Compression Decoders for Bitstreams and Software Binaries Based on High-Level Synthesis.

Multi-core Lossless Compression System for High-speed Data and Its FPGA Implementation

Listless Zerotree Entropy Coding Algorithm and Its FPGA Implementation

Bit Stream Compression Using Self-Adaptive Efdr Coding

An Efficient High-Throughput LZ77-Based Decompressor in Reconfigurable Logic

Refine and Recycle: A Method to Increase Decompression Parallelism.

Streaming Sorting Network Based BWT Acceleration on FPGA for Lossless Compression.

The High-speed General Design of Pulse Compression Based on FPGA

Adaptive Pipeline Hardware Architecture Design and Implementation for Image Lossless Compression/Decompression Based on JPEG-LS

MetaZip: a high-throughput and efficient accelerator for DEFLATE

A Hardware Implementation of Real Time Lossless Data Compression and Decompression Circuits

A self-aware data compression system on FPGA in Hadoop

FPGA-Accelerated Compactions for LSM-based Key-Value Store.

GPULZ: Optimizing LZSS Lossless Compression for Multi-byte Data on Modern GPUs

An Optimization Method of WebP Images Lossy Compression Algorithm for FPGAs.

FPGA Configuration Compression Algorithm

FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs