Abstract:The two most prevalent notions of common information (CI) are due to Wyner and Gács–Körner and both the notions can be stated as two different characteristic points in the lossless Gray–Wyner region. Although the information theoretic characterizations for these two CI quantities can be easily evaluated for random variables with infinite entropy (e.g., continuous random variables), their operational significance is applicable only to the lossless framework. The primary objective of this paper is to generalize these two CI notions to the lossy Gray–Wyner network, which hence extends the theoretical foundation to general sources and distortion measures. We begin by deriving a single letter characterization for the lossy generalization of Wyner's CI, defined as the minimum rate on the shared branch of the Gray–Wyner network, maintaining minimum sum transmit rate when the two decoders reconstruct the sources subject to individual distortion constraints. To demonstrate its use, we compute the CI of bivariate Gaussian random variables for the entire regime of distortions. We then similarly generalize Gács and Körner's definition to the lossy framework. The latter half of this paper focuses on studying the tradeoff between the total transmit rate and receive rate in the Gray–Wyner network. We show that this tradeoff yields a contour of points on the surface of the Gray–Wyner region, which passes through both the Wyner and Gács–Körner operating points, and thereby provides a unified framework to understand the different notions of CI. We further show that this tradeoff generalizes the two notions of CI to the excess sum transmit rate and receive rate regimes, respectively.

Interference Channels With Arbitrarily Correlated Sources

Interference Channels with Correlated Receiver Side Information

Interference Channels with Common Information

Generalized Modeling and Fundamental Limits for Multiple-Access Integrated Sensing and Communication Systems

Lossless Multicast of Multiple Correlated Sources

Distortion Bounds for Transmitting Correlated Sources with Common Part over MAC

Interference Channel with State Information

On source-channel separation in networks

Distributed Source Coding with One Distortion Criterion and Correlated Messages

Secrecy Capacity of Correlated Rayleigh Fading Channels

Source and Channel Coding for Correlated Sources Over Multiuser Channels

The Lossy Common Information of Correlated Sources

Joint Source-Channel Coding on a Multiple Access Channel with Side Information

Broadcast Channel with Transmitter Noncausal Interference and Receiver Side Information.

Achievable Rate Regions for Discrete Memoryless Interference Channel with State Information

Outage Performance for Secure Communication over Correlated Fading Channels with Partial CSI

Channel-Correlation-Enabled Transmission Optimization for MISO Wiretap Channels

Beyond the Cut-Set Bound: Uncertainty Computations in Network Coding with Correlated Sources

Correlation-Based Secure Transmission for Correlated MISO Wiretap Channels

Joint Source-Channel Coding for the Multiple-Access Relay Channel

Interference Channels With Destination Cooperation