Abstract:We describe and analyze the joint source/channel coding properties of a class of sparse graphical codes based on compounding a low-density generator matrix (LDGM) code with a low-density parity check (LDPC) code. Our first pair of theorems establish that there exist codes from this ensemble, with all degrees remaining bounded independently of block length, that are simultaneously optimal as both source and channel codes when encoding and decoding are performed optimally. More precisely, in the context of lossy compression, we prove that finite degree constructions can achieve any pair $(R, D)$ on the rate-distortion curve of the binary symmetric source. In the context of channel coding, we prove that finite degree codes can achieve any pair $(C, p)$ on the capacity-noise curve of the binary symmetric channel. Next, we show that our compound construction has a nested structure that can be exploited to achieve the Wyner-Ziv bound for source coding with side information (SCSI), as well as the Gelfand-Pinsker bound for channel coding with side information (CCSI). Although the current results are based on optimal encoding and decoding, the proposed graphical codes have sparse structure and high girth that renders them well-suited to message-passing and other efficient decoding procedures.

On symmetric multiple description coding

A Lower Bound on the Sum Rate of Multiple Description Coding with Symmetric Distortion Constraints

On The Minimum Sum Rate Of Gaussian Multiterminal Source Coding: New Proofs

On the Sum Rate of Gaussian Multiterminal Source Coding: New Proofs and Results

Generalized Gaussian Multiterminal Source Coding: the Symmetric Case.

Rate Region of Gaussian Multiple Description Coding with Individual and Central Distortion Constraints.

Constrained Source Coding with Side Information

Distributed Source Coding with One Distortion Criterion and Correlated Messages

Multiple Descriptions in the Wyner-Ziv Setting

Distributed Source Coding, Multiple Description Coding, and Source Coding with Side Information at Decoders Using Constrained-Random Number Generators

An Approximate Coding-Rate Versus Minimum Distance Formula for Binary Codes

On the Generalization of Natural Type Selection to Multiple Description Coding

On Distributed Lossy Coding of Symmetrically Correlated Gaussian Sources

Second-Order Rate Region of Constant-Composition Codes for the Multiple-Access Channel

Distortion Bounds for Transmitting Correlated Sources with Common Part over MAC

Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory

Multiple Descriptions with Side Informations Also Known at the Encoder.

Two-Stage Diversity-Based Multiple Description Image Coding

Low-density graph codes that are optimal for source/channel coding and binning

Enhancing Two-Stage Multiple Description Scalar Quantization.