On The Sum Rate Of Multiple Description Coding With Tree-Structured Distortion Constraints

Yinfei Xu,Jun Chen,Qiao Wang

DOI: https://doi.org/10.1109/ISIT.2015.7282762

2015-01-01

Abstract:A single-letter lower bound on the sum rate of multiple description coding with tree-structured distortion constraints is established and is shown to be tight in the quadratic Gaussian case.

What problem does this paper attempt to address?

A Lower Bound on the Sum Rate of Multiple Description Coding with Symmetric Distortion Constraints

Lin Song,Shuo Shao,Jun Chen

DOI: https://doi.org/10.1109/tit.2014.2360698

IF: 2.5

2014-01-01

IEEE Transactions on Information Theory

Abstract:We derive a single-letter lower bound on the minimum sum rate of multiple description coding with symmetric distortion constraints. For the binary uniform source with the erasure distortion measure or Hamming distortion measure, this lower bound can be evaluated with the aid of certain minimax theorems. A similar minimax theorem is established in the quadratic Gaussian setting, which is further leveraged to analyze the special case where the minimum sum rate subject to two levels of distortion constraints (with the second level imposed on the complete set of descriptions) is attained; in particular, we determine the minimum achievable distortions at the intermediate levels.
On symmetric multiple description coding

Lin Song,Shuo Shao,Jun Chen

DOI: https://doi.org/10.1109/ITW.2013.6691217

2013-01-01

Abstract:We derive a single-letter lower bound on the minimum sum rate of multiple description coding with symmetric distortion constraints. For the binary uniform source with the Hamming distortion measure, this lower bound can be evaluated with the aid of a certain minimax theorem. A similar minimax theorem is established in the quadratic Gaussian setting, which is further leveraged to analyze the special case where the minimum sum rate subject to two levels of distortion constraints (with the second level imposed on the complete set of descriptions) is attained; in particular, we determine the minimum achievable distortions at the intermediate levels.
Rate Region of Gaussian Multiple Description Coding with Individual and Central Distortion Constraints.

Jun Chen,Jia Wang

DOI: https://doi.org/10.1109/tit.2009.2025540

IF: 2.5

2009-01-01

IEEE Transactions on Information Theory

Abstract:The rate region of Gaussian multiple description coding with individual and central distortion constraints is completely characterized. Specifically, a lower bound and an upper bound are derived for each supporting hyperplane of the rate region, where the lower bound is associated with a max-min game while the upper bound is associated with a min-max game; furthermore, it is shown that these two bounds coincide due to the existence of a saddle point.
On the Sum Rate of Gaussian Multiterminal Source Coding: New Proofs and Results

Jia Wang,Jun Chen,Xiaolin Wu

DOI: https://doi.org/10.1109/TIT.2010.2050960

IF: 2.5

2010-01-01

IEEE Transactions on Information Theory

Abstract:We show that the lower bound on the sum rate of the direct and indirect Gaussian multiterminal source coding problems can be derived in a unified manner by exploiting the semidefinite partial order of the distortion covariance matrices associated with the minimum mean squared error (MMSE) estimation and the so-called reduced optimal linear estimation, through which an intimate connection between t...
On The Minimum Sum Rate Of Gaussian Multiterminal Source Coding: New Proofs

Jia Wang,Jun Chen,Xiaolin Wu

DOI: https://doi.org/10.1109/ISIT.2009.5205873

2009-01-01

Abstract:We show that the minimum sum rate of the Gaussian multiterminal source coding problems can be derived in a unified manner by exploiting the semidefinite partial order of the distortion covariance matrices associated with the MMSE estimation and the so-called reduced optimal linear estimation. In contrast to the existing proofs, the new method does not rely on Shannon's entropy power inequality. Furthermore, this new method leads to a direct proof of the minimum sum rate of the Gaussian two-terminal source coding problem without coupling it to a Gaussian CEO problem.
A Rate-Distortion Analysis for Composite Sources Under Subsource-Dependent Fidelity Criteria

Jiakun Liu,H. Vincent Poor,Iickho Song,Wenyi Zhang

2024-05-20

Abstract:A composite source, consisting of multiple subsources and a memoryless switch, outputs one symbol at a time from the subsource selected by the switch. If some data should be encoded more accurately than other data from an information source, the composite source model is suitable because in this model different distortion constraints can be put on the subsources. In this context, we propose subsource-dependent fidelity criteria for composite sources and use them to formulate a rate-distortion problem. We solve the problem and obtain a single-letter expression for the rate-distortion function. Further rate-distortion analysis characterizes the performance of classify-then-compress (CTC) coding, which is frequently used in practice when subsource-dependent fidelity criteria are considered. Our analysis shows that CTC coding generally has performance loss relative to optimal coding, even if the classification is perfect. We also identify the cause of the performance loss, that is, class labels have to be reproduced in CTC coding. Last but not least, we show that the performance loss is negligible for asymptotically small distortion if CTC coding is appropriately designed and some mild conditions are satisfied.

Information Theory
An advanced rate control algorithm for multi-view video based on the quadratic R-D model

Tao Yan,Ping An,Zhaoyang Zhang,Liquan Shen,He Wang

DOI: https://doi.org/10.3772/j.issn.1002-0470.2010.05.007

2010-01-01

Abstract:Seeing that the rate control for multi-view video coding is not well studied, this paper illustrates the drawbacks of current existing rate-distortion models for video rate control and the characteristics of multi-view video coding, and then proposes a rate control algorithm for multi-view video coding based on the quadratic rate-distortion model. The proposed algorithm classifies each picture into six frame types based on the relation between disparity prediction and temporal prediction estimation and also improves the quadratic rate-distortion model. The proposed method allocates the bits and controls the rate for inter-view, frame layer, and basic unit layer based on the analysis of the previously coded information. The simulation results show that the proposed algorithm can effectively control the bit rate for multi-view video coding while keeping a high coding efficiency compared to the multi-view video coding with fixed quantization parameters.
Constrained Source Coding with Side Information

Amos Lapidoth,Andreas Malär,Michèle Wigger

DOI: https://doi.org/10.1109/TIT.2014.2314634

2013-01-22

Abstract:The source-coding problem with side information at the decoder is studied subject to a constraint that the encoder---to whom the side information is unavailable---be able to compute the decoder's reconstruction sequence to within some distortion. For discrete memoryless sources and finite single-letter distortion measures, an expression is given for the minimal description rate as a function of the joint law of the source and side information and of the allowed distortions at the encoder and at the decoder. The minimal description rate is also computed for a memoryless Gaussian source with squared-error distortion measures. A solution is also provided to a more general problem where there are more than two distortion constraints and each distortion function may be a function of three arguments: the source symbol, the encoder's reconstruction symbol, and the decoder's reconstruction symbol.

Information Theory
Enhancing Two-Stage Multiple Description Scalar Quantization.

Minglei Liu,Ce Zhu

DOI: https://doi.org/10.1109/lsp.2009.2014104

2009-01-01

IEEE Signal Processing Letters

Abstract:In this letter we consider enhancing coding performance of two-stage multiple description scalar quantization. An enhancement scheme is proposed to make the product of central and side distortions closer to the rate-distortion bound of multiple description coding under the high-resolution assumption. We show analytically that the second stage refinement information, i.e., the quantized residual errors, can be used to further reduce the side distortions apart from the central distortion, which is substantiated with a memoryless Gaussian source.
On the Role of the Refinement Layer in Multiple Description Coding and Scalable Coding

Jia Wang,Jun Chen,Lei Zhao,P. Cuff,H. Permuter

DOI: https://doi.org/10.1109/TIT.2011.2104650

IF: 2.5

2011-01-01

IEEE Transactions on Information Theory

Abstract:We clarify the relationship among several existing achievable multiple description rate-distortion regions by investigating the role of refinement layer in multiple description coding. Specifically, we show that the refinement layer in the El Gamal-Cover (EGC) scheme and the Venkataramani-Kramer-Goyal (VKG) scheme can be removed; as a consequence, the EGC region is equivalent to the EGC* region (an antecedent version of the EGC region) while the VKG region (when specialized to the 2-description case) is equivalent to the Zhang-Berger (ZB) region. Moreover, we prove that for multiple description coding with individual and hierarchical distortion constraints, the number of layers in the VKG scheme can be significantly reduced when only certain weighted sum rates are concerned. The role of refinement layer in scalable coding (a special case of multiple description coding) is also studied.
Two-Stage Diversity-Based Multiple Description Image Coding

Chunyu Lin,Yao Zhao,Ce Zhu

DOI: https://doi.org/10.1109/lsp.2008.2005044

2008-01-01

IEEE Signal Processing Letters

Abstract:In this letter, a diversity-based two-description image coding scheme is firstly presented and analyzed, for which a two-stage coding is introduced to facilitate the tuning of central/side distortion tradeoff. By subsampling the central decoded errors from the first stage to constitute the second part for each description, respectively, we show that not only the central distortion but also the side distortion can be reduced with the second stage information. We further generalize the proposed scheme to 4-description coding. Experiment results demonstrate that the proposed scheme outperforms the state-of-the-art techniques in terms of both central and side coding performance.
Rateless Stochastic Coding for Delay-constrained Semantic Communication

Cheng Peng,Rulong Wang,Yong Xiao

2024-06-28

Abstract:We consider the problem of joint source-channel coding with distortion and perception constraints from a rateless perspective, the purpose of which is to settle the balance between reliability (distortion/perception) and effectiveness (rate) of transmission over uncertain channels. We find a new finite-blocklength bound for the achievable joint source-channel code rate with the above two constraints. To achieve a superior rateless characteristic of JSCC coding, we perform multi-level optimization on various finite-blocklength codes. Based on these two, we then propose a new JSCC coding scheme called rateless stochastic coding (RSC). We experimentally demonstrate that the proposed RSC can achieve variable rates of transmission maintaining an excellent trade-off between distortion and perception.

Information Retrieval
Semantic-Aware Multi-Terminal Coding for Gaussian Mixture Sources

Yuxuan Shi,Shuo Shao,Yongpeng Wu,Jun Chen,Wenjun Zhang

2024-04-23

Abstract:A novel distributed source coding model which named semantic-aware multi-terminal (MT) source coding is proposed and investigated in the paper, where multiple agents independently encode an imperceptible semantic source, while both semantic and observations are reconstructed within their respective fidelity criteria. We start from a generalized single-letter characterization of sum rate-distortion region of this problem. Furthermore, we propose a mixed MSE-Log loss framework for this model and specifically depict the rate-distortion bounds when sources are Gaussian mixture distributed. For this case, we first present a relative tight outer bound and explore the activeness of semantic and observation distortion constraints, in which we find that good observation reconstruction will not incur too much semantic errors, but not vice versa. Moreover, we provide a practical coding scheme functioning as an achievable regime of inner bound with the performance analysis and simulation results, which verifies the feasibility of the idea "detect and compress" for Gaussian mixture sources. Our results provide theoretical instructions on the fundamental limits and can be used to guide the practical semantic-aware coding designs for multi-user scenarios.

Information Theory
Distortion Bounds for Transmitting Correlated Sources with Common Part over MAC

Lei Yu,Houqiang Li,Chang Wen Chen

DOI: https://doi.org/10.1109/allerton.2016.7852298

2016-01-01

Abstract:This paper investigates the joint source-channel coding problem of sending two correlated memoryless sources with common part over a memoryless multiple access channel (MAC). An inner bound and two outer bounds on the achievable distortion region are derived. In particular, they respectively recover the existing bounds for several special cases, such as communication without common part, lossless communication, and noiseless communication. When specialized to quadratic Gaussian communication case, the inner bound and outer bound are used to generate two new bounds. Numerical result shows that common part improves the performance of such distributed communication system.
Rate Control Algorithm for Multi-View Video Coding Based on Correlation Analysis

Tao Yan,Ping An,Liquan Shen,Qian Zhang,Zhaoyang Zhang

DOI: https://doi.org/10.1109/sopo.2009.5230177

2013-01-01

Abstract:Rate control is not a part of the current multi- view video coding (MVC) test model. We propose a rate control algorithm for MVC based on the quadratic rate- distortion model. The proposed method consists of three levels for more accurate bits rate control. Experimental results show that the proposed scheme can efficiently implement bit allocation and rate control according to coding parameters.
Many-Help-One Problem for Gaussian Sources with a Tree Structure on their Correlation

Yasutada Oohama

2024-08-29

Abstract:In this paper we consider the separate coding problem for $L+1$ correlated Gaussian memoryless sources. We deal with the case where $L$ separately encoded data of sources work as side information at the decoder for the reconstruction of the remaining source. The determination problem of the rate distortion region for this system is the so called many-help-one problem and has been known as a highly challenging problem. The author determined the rate distortion region in the case where the $L$ sources working as partial side information are conditionally independent if the remaining source we wish to reconstruct is given. This condition on the correlation is called the CI condition. In this paper we extend the author's previous result to the case where $L+1$ sources satisfy a kind of tree structure on their correlation. We call this tree structure of information sources the TS condition, which contains the CI condition as a special case. In this paper we derive an explicit outer bound of the rate distortion region when information sources satisfy the TS condition. We further derive an explicit sufficient condtion for this outer bound to be tight. In particular, we determine the sum rate part of the rate distortion region for the case where information sources satisfy the TS condition. For some class of Gaussian sources with the TS condition we derive an explicit recursive formula of this sum rate part.

Information Theory
Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory

Li Xie,Liangyan Li,Jun Chen,Zhongshan Zhang

2024-03-22

Abstract:The distortion-rate function of output-constrained lossy source coding with limited common randomness is analyzed for the special case of squared error distortion measure. An explicit expression is obtained when both source and reconstruction distributions are Gaussian. This further leads to a partial characterization of the information-theoretic limit of quadratic Gaussian rate-distortion-perception coding with the perception measure given by Kullback-Leibler divergence or squared quadratic Wasserstein distance.

Information Theory,Machine Learning
On the Generalization of Natural Type Selection to Multiple Description Coding

Yuhua Fan,Jia Wang,Jun Sun,Jun Chen

DOI: https://doi.org/10.1109/tcomm.2012.021513.110833

IF: 6.166

2013-01-01

IEEE Transactions on Communications

Abstract:Natural type selection was originally proposed by Zamir and Rose for universal single description coding. In this paper, we generalize this principle to universal multiple description coding (MDC). Two schemes based on random codebooks are proposed: one is of fixed distortion and the other is of fixed weight. Their operational sum-rate-distortion functions are derived, which coincide with the EGC (El Gamal-Cover) sum-rate bound if the parameters of the schemes are optimized. It is also shown that in both schemes the joint type of reconstruction codewords can be used to improve the rate-distortion (R-D) performance. Based on our theoretical results, a practical universal scheme is proposed by leveraging the MDC methods based on low-density generator matrix (LDGM) codes. The performance of this scheme is compared experimentally with the EGC bound, which shows its effectiveness.
Distributed Source Coding with One Distortion Criterion and Correlated Messages

Suhan Choi

2009-08-15

Abstract:In this paper, distributed (or multiterminal) source coding with one distortion criterion and correlated messages is considered. This problem can be also called ``Berger-Yeung problem with correlated messages''. It corresponds to the source coding part of the graph-based framework for transmission of a pair of correlated sources over the multiple-access channel (MAC) where one is lossless and the other is lossy. As a result, the achievable rate-distortion region for this problem is provided. It is an information-theoretic characterization of the rate of exponential growth (as a function of the number of source samples) of the size of the bipartite graphs which can represent a pair of correlated sources with satisfying one distortion criterion. A rigorous proof of the achievability and the converse part is given. It is also shown that there exists functional duality between Berger-Yeung problem with correlated messages and semi-deterministic broadcast channel with correlated messages. This means that the optimal encoder-decoder mappings for one problem become the optimal decoder-encoder mappings for the dual problem. In the duality setup, the correlation structure of the messages in the two dual problems, source distortion measure and channel cost measure are also specified.

Mathematics,Computer Science
Distributed Source Coding, Multiple Description Coding, and Source Coding with Side Information at Decoders Using Constrained-Random Number Generators

Jun Muramatsu

2024-10-10

Abstract:This paper investigates a unification of distributed source coding, multiple description coding, and source coding with side information at decoders. The equivalence between the multiple-decoder extension of distributed source coding with decoder side information and the multiple-source extension of multiple description coding with decoder side information is clarified. Their multi-letter rate-distortion region for arbitrary general correlated sources is characterized in terms of entropy functions. We construct a code based on constrained-random number generators and show its achievability.

Information Theory

On The Sum Rate Of Multiple Description Coding With Tree-Structured Distortion Constraints

A Lower Bound on the Sum Rate of Multiple Description Coding with Symmetric Distortion Constraints

On symmetric multiple description coding

Rate Region of Gaussian Multiple Description Coding with Individual and Central Distortion Constraints.

On the Sum Rate of Gaussian Multiterminal Source Coding: New Proofs and Results

On The Minimum Sum Rate Of Gaussian Multiterminal Source Coding: New Proofs

A Rate-Distortion Analysis for Composite Sources Under Subsource-Dependent Fidelity Criteria

An advanced rate control algorithm for multi-view video based on the quadratic R-D model

Constrained Source Coding with Side Information

Enhancing Two-Stage Multiple Description Scalar Quantization.

On the Role of the Refinement Layer in Multiple Description Coding and Scalable Coding

Two-Stage Diversity-Based Multiple Description Image Coding

Rateless Stochastic Coding for Delay-constrained Semantic Communication

Semantic-Aware Multi-Terminal Coding for Gaussian Mixture Sources

Distortion Bounds for Transmitting Correlated Sources with Common Part over MAC

Rate Control Algorithm for Multi-View Video Coding Based on Correlation Analysis

Many-Help-One Problem for Gaussian Sources with a Tree Structure on their Correlation

Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory

On the Generalization of Natural Type Selection to Multiple Description Coding

Distributed Source Coding with One Distortion Criterion and Correlated Messages

Distributed Source Coding, Multiple Description Coding, and Source Coding with Side Information at Decoders Using Constrained-Random Number Generators