Abstract:This work is devoted to practical joint source channel coding. Although the proposed approach has more general scope, for the sake of clarity we focus on a specific application example, namely, the transmission of digital images over noisy binary-input output-symmetric channels. The basic building blocks of most state-of the art source coders are: 1) a linear transformation; 2) scalar quantization of the transform coefficients; 3) probability modeling of the sequence of quantization indices; 4) an entropy coding stage. We identify the weakness of the conventional separated source-channel coding approach in the catastrophic behavior of the entropy coding stage. Hence, we replace this stage with linear coding, that maps directly the sequence of redundant quantizer output symbols into a channel codeword. We show that this approach does not entail any loss of optimality in the asymptotic regime of large block length. However, in the practical regime of finite block length and low decoding complexity our approach yields very significant improvements. Furthermore, our scheme allows to retain the transform, quantization and probability modeling of current state-of the art source coders, that are carefully matched to the features of specific classes of sources. In our working example, we make use of ``bit-planes'' and ``contexts'' model defined by the JPEG2000 standard and we re-interpret the underlying probability model as a sequence of conditionally Markov sources. The Markov structure allows to derive a simple successive coding and decoding scheme, where the latter is based on iterative Belief Propagation. We provide a construction example of the proposed scheme based on punctured Turbo Codes and we demonstrate the gain over a conventional separated scheme by running extensive numerical experiments on test images.

Lecture Notes on Channel Coding

Channel Coding Techniques for Wireless Communications

Variations on a Theme by Schalkwijk and Kailath

A Lego-Brick Approach to Coding for Network Communication

Analysis and application research on key issues of channel coding

Algebraic lattice codes for linear fading channels

Two Lectures on Iterative Coding and Statistical Mechanics

Learning Channel Codes from Data: Performance Guarantees in the Finite Blocklength Regime

Ultimate linear block and convolutional codes

Reinforcement Learning for Channel Coding: Learned Bit-Flipping Decoding

Low-density graph codes that are optimal for source/channel coding and binning

Generalized Automorphisms of Channel Codes: Properties, Code Design, and a Decoder

A Course on Lie algebras and Chevalley groups

A Practical Approach to Lossy Joint Source-Channel Coding

Coding for Network Coding

Finite-Length Analyses for Source and Channel Coding on Markov Chains

Linear codes invariant under a linear endomorphism

Fundamentals of Computing

Coding for Gaussian Two-Way Channels: Linear and Learning-Based Approaches

Introduction to Arithmetic Coding -- Theory and Practice

Code-based Cryptography: Lecture Notes