Abstract:The two most prevalent notions of common information (CI) are due to Wyner and Gács–Körner and both the notions can be stated as two different characteristic points in the lossless Gray–Wyner region. Although the information theoretic characterizations for these two CI quantities can be easily evaluated for random variables with infinite entropy (e.g., continuous random variables), their operational significance is applicable only to the lossless framework. The primary objective of this paper is to generalize these two CI notions to the lossy Gray–Wyner network, which hence extends the theoretical foundation to general sources and distortion measures. We begin by deriving a single letter characterization for the lossy generalization of Wyner's CI, defined as the minimum rate on the shared branch of the Gray–Wyner network, maintaining minimum sum transmit rate when the two decoders reconstruct the sources subject to individual distortion constraints. To demonstrate its use, we compute the CI of bivariate Gaussian random variables for the entire regime of distortions. We then similarly generalize Gács and Körner's definition to the lossy framework. The latter half of this paper focuses on studying the tradeoff between the total transmit rate and receive rate in the Gray–Wyner network. We show that this tradeoff yields a contour of points on the surface of the Gray–Wyner region, which passes through both the Wyner and Gács–Körner operating points, and thereby provides a unified framework to understand the different notions of CI. We further show that this tradeoff generalizes the two notions of CI to the excess sum transmit rate and receive rate regimes, respectively.

Computing the Rate-Distortion Function of Bivariate Gaussian Gray-Wyner Networks

The Wyner-Ziv Rate-Distortion Function of Multivariate Gaussian Sources and Its Application in Distributed Video Coding

A New Approach to Lossy Network Compression of a Tuple of Correlated Multivariate Gaussian RVs

Theory and Practice of Rate Division in Distributed Video Coding

Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory

Gray--Wyner and Mutual Information Regions for Doubly Symmetric Binary Sources and Gaussian Sources

Characterizing Generalized Rate-Distortion Performance of Video Coding: An Eigen Analysis Approach

On Distributed Lossy Coding of Symmetrically Correlated Gaussian Sources

Rate-Distortion-Perception Tradeoff for Gaussian Vector Sources

On the Computation of the Gaussian Rate-Distortion-Perception Function

Gaussian Rate-Distortion-Perception Coding and Entropy-Constrained Scalar Quantization

Indirect Rate Distortion Functions with Side Information: Structural Properties and Multivariate Gaussian Sources

Estimating the Rate-Distortion Function by Wasserstein Gradient Descent

Computation of Rate-Distortion-Perception Functions with Wasserstein Barycenter

Shannon Bounds for Quadratic Rate-Distortion Problems

Structural Properties of the Wyner–Ziv Rate Distortion Function: Applications for Multivariate Gaussian Sources

Bandwidth Compression for a Bivariate Gaussian Source with Shannon-Kotel’nikov Mappings

Rate Region of Gaussian Multiple Description Coding with Individual and Central Distortion Constraints.

GaussianSource Coding Based on P-LDPC Code

Wyner's Common Information: Generalizations and A New Lossy Source Coding Interpretation

The Lossy Common Information of Correlated Sources