Abstract:The advent of massive datasets (and the consequent design of high-performing distributed storage systems) have reignited the interest of the scientific and engineering community towards the design of lossless data compressors which achieve effective compression ratio and very efficient decompression speed. Lempel-Ziv's LZ77 algorithm is the de facto choice in this scenario because of its decompression speed and its flexibility in trading decompression speed versus compressed-space efficiency. Each of the existing implementations offers a trade-off between space occupancy and decompression speed, so software engineers have to content themselves by picking the one which comes closer to the requirements of the application in their hands. Starting from these premises, and for the first time in the literature, we address in this paper the problem of trading optimally, and in a principled way, the consumption of these two resources by introducing the Bicriteria LZ77-Parsing problem, which formalizes in a principled way what data-compressors have traditionally approached by means of heuristics. The goal is to determine an LZ77 parsing which minimizes the space occupancy in bits of the compressed file, provided that the decompression time is bounded by a fixed amount (or vice-versa). This way, the software engineer can set its space (or time) requirements and then derive the LZ77 parsing which optimizes the decompression speed (or the space occupancy, respectively). We solve this problem efficiently in O(n log^2 n) time and optimal linear space within a small, additive approximation, by proving and deploying some specific structural properties of the weighted graph derived from the possible LZ77-parsings of the input file. The preliminary set of experiments shows that our novel proposal dominates all the highly engineered competitors, hence offering a win-win situation in theory&practice.

A Universal 4D Model for Double-Efficient Lossless Data Compressions

LBS: Loss-aware Bit Sharing for Automatic Model Compression

Bicriteria data compression

Zero-Error Distributed Function Compression for Binary Arithmetic Sum

SDC Resilient Error-bounded Lossy Compressor

Lossless Compression Decoders for Bitstreams and Software Binaries Based on High-Level Synthesis.

A Fast and Efficient Near-Lossless Image Compression using Zipper Transformation

A Versatile Compression Method for Floating-Point Data Stream

Lossless Compression with Probabilistic Circuits

Adaptive Encoding Strategies for Erasing-Based Lossless Floating-Point Compression

From a Lossless (~1.5:1) Compression Algorithm for Llama2 7B Weights to Variable Precision, Variable Range, Compressed Numeric Data Types for CNNs and LLMs

A universal chain code compression method

HybriDC: A Resource-Efficient CPU-FPGA Heterogeneous Acceleration System for Lossless Data Compression

DZip: Improved General-Purpose Lossless Compression Based on Novel Neural Network Modeling

A Novel Lossless Encoding Algorithm for Data Compression - Genomics Data as an Exemplar

To Compress or Not To Compress: Energy Trade-Offs and Benefits of Lossy Compressed I/O

Low-complexity and Low-Memory Entropy Coder for Image Compression.

A Unified Perspective on Parity- and Syndrome-Based Binary Data Compression Using Off-the-Shelf Turbo Codecs

Understanding is Compression

Test data compression using extended frequency-directed run length code based on compatibility

Lossless text compression by means of binary-coded ternary number representation