Abstract:Entropy coding is essential to data compression, image and video coding, etc. The Range variant of Asymmetric Numeral Systems (rANS) is a modern entropy coder, featuring superior speed and compression rate. As rANS is not designed for parallel execution, the conventional approach to parallel rANS partitions the input symbol sequence and encodes partitions with independent codecs, and more partitions bring extra overhead. This approach is found in state-of-the-art implementations such as DietGPU. It is unsuitable for content-delivery applications, as the parallelism is wasted if the decoder cannot decode all the partitions in parallel, but all the overhead is still transferred. To solve this, we propose Recoil, a parallel rANS decoding approach with decoder-adaptive scalability. We discover that a single rANS-encoded bitstream can be decoded from any arbitrary position if the intermediate states are known. After renormalization, these states also have a smaller upper bound, which can be stored efficiently. We then split the encoded bitstream using a heuristic to evenly distribute the workload, and store the intermediate states and corresponding symbol indices as metadata. The splits can then be combined simply by eliminating extra metadata entries. The main contribution of Recoil is reducing unnecessary data transfer by adaptively scaling parallelism overhead to match the decoder capability. The experiments show that Recoil decoding throughput is comparable to the conventional approach, scaling massively on CPUs and GPUs and greatly outperforming various other ANS-based codecs.

A Parallel ANS Coder with Reduced Decoding Error Diffusion.

Improved Decoding Approach of Low-Density Parity-Check Codes with Finite Precision

VLSI Decoding Design of Low-Density Parity-Check Codes Based on Circulant Matrices

Recoil: Parallel rANS Decoding with Decoder-Adaptive Scalability

Encoding and Decoding Algorithms of ANS Variants and Evaluation of Their Average Code Lengths

Parallel Decoding for Non-recursive Convolutional Codes and Its Enhancement Through Artificial Neural Networks

Interleaved entropy coders

A Parallel Serial Filtering Mixed Advanced ID Interpolation Architecture for AVS

Parallel Decoding of IRSA with Noise.

Compressed Coding, AMP-Based Decoding, and Analog Spatial Coupling

An AVS Video Decoder Design and Implementation Based on Parallel Algorithm

Novel Encoding Scheme for Folding and Interpolating ADC

A New Interleaver Design Method for Turbo Code Using Parallel Decoding

Cosine Annealing Optimized Denoising Diffusion Error Correction Codes

Coding with Asymmetric Numeral Systems

Customized Joint Blind Frame Synchronization and Decoding Methods for Analog LDPC Decoder

A Joint Source-Channel Coding Scheme Using Low-Density Parity-Check Codes and Error Resilient Arithmetic Codes

Achieving full-diversity and fast maximum likelihood decoding in asynchronous analog network coding

Interference Mitigation via Interference-Aware Successive Decoding

Sequential Decoding Algorithm of Arithmetic Code with Forbidden Symbols

A simplified variant of tabled asymmetric numeral systems with a smaller look-up table