The Study Status and Prospective of Multiple Description Coding

赵谊虹,余松煜,程国华

DOI: https://doi.org/10.3321/j.issn:1000-436x.2005.01.015

2005-01-01

Abstract:The study status of multiple description coding was analyzed in this paper. We first introduce the theory of multiple description coding, and generalize the existing construction of multiple description coding. The MDC in video is summarized.

What problem does this paper attempt to address?

Multiple Description Transform Coding: A New Design Approach

Bing Zeng,Shuyuan Zhu

DOI: https://doi.org/10.1109/icme.2007.4284857

2007-01-01

Abstract:Multiple-description coding (MDC) is an effective technique to support error prone transmission in the scenario of multiple channels. Typically, an MDC is designed in the DCT domain where a pair-wise correlating transform (PCT) or some generalized version is further applied to some DCT coefficients of each image block. Although these correlating transforms offer a freedom of compromising the overall coding quality and the redundancy, none of them can be made optimal after taking into consideration the quantization characteristics. In this paper, we present a new design approach in which we will do a novel grouping of all DCT coefficients (not necessarily pair-wise) such that the distortion measured on some specified pixels within each image block is minimized. An interesting property of this new MDC design is that, when all descriptions are received, it provides a coding quality that becomes higher than the target quality set in the corresponding single-description coding (SDC) design.
Multiple Description Coding and Its Algorithm Optimization

LIN Yan,WANG Jia

DOI: https://doi.org/10.3969/j.issn.1009-2552.2007.08.009

2007-01-01

Abstract:The paper proposes the concept of multiple description coding as one solution to improve transmission reliability and constructed quality through diversity in coding streams,introduces the key technologies in multiple description transform coding,puts emphasis on its system realization and corresponding algorithm optimization and analyses the experiment results.At last,it prospects for the current condition and the tendency of multiple description coding.
A Multiple Description Image/video Coding Method by Compressed Sensing Theory

Yifu Zhang,Shunliang Mei,Quqing Chen,Zhibo Chen

DOI: https://doi.org/10.1109/iscas.2008.4541796

2008-01-01

Abstract:Multiple description coding (MDC) has emerged as a promising approach to enhance the error resilient property for video transmission. This paper proposes a novel MDC method by incorporating a newly appeared signal recovery theory, compressed sensing (CS) theory, into image/video coding framework. The compressed sensing theory states that under certain conditions, a signal can be precisely reconstructed from only a small set of measurements. Taking this advantage, the proposed MDC method generates multiple descriptions in the frequency domain, enabling each description to recover original signals properly and the more descriptions the better quality. Experiments have demonstrated the feasibility and advantage of the proposed MDC scheme.
A comparative study of multiple description video coding in P2P: normal MDSQ versus flexible dead-zones

Shuyuan Zhu,Siu-Kei Au Yeung,Bing Zeng

DOI: https://doi.org/10.1109/ICME.2009.5202695

2009-01-01

Abstract:Multiple-description coding (MDC) encodes a source image or video into several distinct descriptions. Each description can be decoded independently and more than one description can also be decoded jointly so as to deliver a higher quality. One typical design of an MDC encoder is based on the so-called multiple description scalar quantization (MDSQ). A simple MDSQ system is to choose different step-sizes used in all involved quantizers. Another implementation is to apply flexible dead-zones in all quantizers (whereas keeping the same step-size across them). Two issues turn to be particularly important when MDC is used in video streaming applications in the P2P scenario. First, we need to consider more than two descriptions to fit the P2P reality. Second, we have to eliminate any possible drifting errors that are resulted from the use of different reference frames (in different descriptions) at the motion-compensation stage. In this paper, we introduce a DCT-domain translation to solve the mismatching problem in different reference frames. Then, we present some comparative results of the two approaches mentioned above, with detailed pros and cons for each one as well as some practical considerations.
An efficient fine grained multi-description and scalable video coding scheme

Anbang Zhao,Wensheng Wang,Huijuan Cui,Kun Tang

2006-01-01

Abstract:In this paper we propose a simple and efficient Multiple Description Coding (MDC) algorithm based on weighted signal combination. The proposed scheme adopts the standard video encoder by incorporating a pre-processing stage to generate multi-descriptions, on the other hand the decoder employs a post-processing algorithm to combine the descriptions to provide better image quality. Furthermore, a scalable codec is introduced to the MDC system which allows the system to provide multi-description and scalable capability at the same time. In addition, since the different scalable descriptions may have different qualities, the simple averaging process is not optimal. The last but not the least, the optimal weighted combination scheme of the two descriptions is derived based on their respective signal to noise ratio. Compared with the simple average combination, the proposed scheme can improve the video quality significantly, especially when the quality difference between the two descriptions becomes larger, the gain can be up to 2.38dB and 3.56dB.
Multiple Description Video Coding Using Adaptive Temporal Sub-Sampling

Huihui Bai,Yao Zhao,Ce Zhu

DOI: https://doi.org/10.1109/icme.2007.4284904

2007-01-01

Abstract:Multiple description coding (MDC) is a promising alternative for robust transmission of information over non-prioritized and unpredictable networks. Especially, MDC has emerged as an attractive approach for video applications where retransmission is unacceptable or infeasible. In this paper, an effective MD video codec is designed based on pre-and post-processing of video sequences, without any modification to the source or channel codec. Considering different motion information of inter-frame, adaptive temporal sub-sampling is employed to the original video data. As a result, adaptive redundancy can make a better tradeoff between the reconstruction quality and compression efficiency. The experimental results exhibit better performance of the proposed scheme than other schemes.
Error Concealment Algorithm for Spatial Multiple Description Coding of Video

Wei-wei Xu,Rong-xin Jiang,Yao-wu Chen

DOI: https://doi.org/10.3969/j.issn.1000-565X.2013.08.010

2013-01-01

Abstract:Video transmission in unstable networks suffers packet loss and bit error. In order to solve this problem, a low-complexity error-concealment algorithm is proposed for the spatial multiple description coding (MDC). In the algorithm, different error concealment strategies are employed to treat the regions with different features. Moreover, the texture difference of adjacent frames and the residual energy of complementary description are used to estimate the spatial and motion differences of the lost description, based on which the region of lost macro-blocks is divided and different methods are adopted to implement error concealment. Experimental results show that, as compared with the traditional MDC error concealment algorithm, the proposed algorithm achieves better subjective and objective quality of error concealment in most sequences.
Efficient Multiple Description Scalable Video Coding Scheme Based on Weighted Signal Combinations

Zhao Anbang,Wang Wensheng,Cui Huijuan,Tang Kun

DOI: https://doi.org/10.1016/s1007-0214(07)70013-5

2007-01-01

Abstract:A simple, efficient multiple description coding （MDC） algorithm was developed based on weighted signal combinations. The scheme uses the standard video encoder with a pre-processing stage to generate multiple descriptions. The decoder then uses a post-processing algorithm to combine the descriptions to provide better image quality. A scalable codec in the MDC system allows the system to provide multiple descriptions and scalability at the same time. In addition, since the different scalable descriptions may have different qualities, a simple averaging process is not optimal. An optimal weighted combination of the two de- scriptions was developed based on the signal to noise ratios. Compared with the simple average combination, the algorithm significantly improved the video quality, especially with large quality differences between the two descriptions, with gains of up to 3.56 dB.
Multiple Description Video Coding Using Joint Frame Duplication/Interpolation

Huihui Bai,Yao Zhao,Ce Zhu,Anhong Wang

2012-01-01

Abstract:Multiple description coding (MDC) is a promising alternative to combatting information loss without any retransmission. In this paper, an effective MD video codec is designed based on temporal pre- and post-processing of video sequences without modifying the actual coding process itself, which makes it compatible with the current standard source or channel codec. For ease of post-processing, motion-compensated interpolation (MCI) based on piecewise uniform motion assumption is adopted to estimate the lost frame in side decoding. Accordingly, to match the post-processing, in the pre-processing joint frame duplication/interpolation is first applied to the original video data before performing odd/even frame splitting, which attempts to make the motion variety in the generated descriptions piecewise uniformly thus achieving better side reconstructed quality based on MCI. The experimental results exhibit better performance of the proposed scheme than some other tested schemes, in both the on-off channel environment and packet loss network.
A multiple description codec based on combinatorial optimization and its application to image coding

Yuhua Fan,Jia Wang,Jun Sun,Cheng Zhi

DOI: https://doi.org/10.1109/ICIP.2010.5651628

2010-01-01

ICIP

Abstract:We propose a general N-channel MDC (Multiple Description Coding) framework which can integrate the advantages of various low-dimensional MDC schemes. Given the operational rate-distortion functions of low-dimensional codecs, we show how to optimize the proposed MDC framework. We prove that the optimization problem can be reduced to a combinatorial problem which in certain cases admits solutions. We then apply the proposed optimization algorithm to multiple description image coding. Experiment results show the effectiveness of our approach.
Tree-Structured Multiple Description Coding for Multiview Mobile TV and Camera-Phone Networks

Yongkai Huo,Lajos Hanzo

DOI: https://doi.org/10.1109/vetecf.2011.6093301

2011-01-01

Abstract:Since multiview video communications facilitate the selection of several camera views of a given scene, it may be deemed to be a promising technique for mobile television and camera-phone networks. Similar to conventional single-view video, multiview video also suffers from packet loss events imposed by network congestion. Multiple description coding (MDC) constitutes an attractive candidate solution for mitigating the packet loss events in conventional video communications. Hence it may also be deemed to be an attractive solution for multiview video. In this paper, we propose a novel tree-structured MDC (T-MDC) scheme, which can be readily implemented with the aid of arbitrary video codecs, including multiview codecs. Moreover, the proposed philosophy enables the flexible creation of a variable number of unequal importance descriptions. Finally, we will conceive a joint multiple description coding and multiview video coding (MVC) scheme. We compare two specific tree- structured MDC schemes, namely a so-called height- one complete tree-structured MDC (HOCT-MDC) and a binary tree-structured MDC (BT-MDC) scheme, which we benchmarked against simulcasting aided single description coding in the context of both single and multiview video.
Analysis and Improvement of Standard-Compatible Multiple Description Image Coding

刘晓侠,倪林

DOI: https://doi.org/10.3778/j.issn.1002-8331.2010.02.055

2010-01-01

Abstract:Multiple Description Coding(MDC)is recognized as an effective method to protect multimedia information transmitted over non-prioritized networks,subject to bit errors or packet erasures.Most of the present methods are conceived as stand-alone co-decoding algorithms.In this paper,a standard-compatible multiple description image coding algorithm is analyzed and improved,which provides a flexible redundancy insertion in order to make the system robust over erasure channels.There are different performances under certain rate through deeper analysis.Some features of JPEG2000 such as ROI are presented to combine with this algorithm in order to improve the performance of the whole system.
Multiple Description Coding with Application in Multimedia Watermarking

Minglei Liu,Ce Zhu

DOI: https://doi.org/10.4018/978-1-60566-262-6.ch026

2009-01-01

Abstract:Digital watermarking is a useful and powerful tool for multimedia security such as copyright protection, tamper proofing and assessment, broadcast monitoring, and fingerprinting. Many multimedia services are provided through wire/wireless communications, where transmission errors are present. Robustness of watermarking is a major concern during the transmission of watermarked multimedia messages. Multiple description coding (MDC) is a promising method for robust transmission of information over non-prioritized and unpredictable networks. As a source coding scheme, multiple description coding has been extensively studied and applied in audio, image, and video sources. It is also interesting to find that multiple description coding can be applied in multimedia watermarking. Recently several multiple description watermarking schemes have been developed which have exhibited some advantages. In this …
Deep Optimized Multiple Description Image Coding via Scalar Quantization Learning

Zhao Lijun,Bai Huihui,Wang Anhong,Zhao Yao

DOI: https://doi.org/10.48550/arxiv.2001.03851

2020-01-01

Abstract: In this paper, we introduce a deep multiple description coding (MDC) framework optimized by minimizing multiple description (MD) compressive loss. First, MD multi-scale-dilated encoder network generates multiple description tensors, which are discretized by scalar quantizers, while these quantized tensors are decompressed by MD cascaded-ResBlock decoder networks. To greatly reduce the total amount of artificial neural network parameters, an auto-encoder network composed of these two types of network is designed as a symmetrical parameter sharing structure. Second, this autoencoder network and a pair of scalar quantizers are simultaneously learned in an end-to-end self-supervised way. Third, considering the variation in the image spatial distribution, each scalar quantizer is accompanied by an importance-indicator map to generate MD tensors, rather than using direct quantization. Fourth, we introduce the multiple description structural similarity distance loss, which implicitly regularizes the diversified multiple description generations, to explicitly supervise multiple description diversified decoding in addition to MD reconstruction loss. Finally, we demonstrate that our MDC framework performs better than several state-of-the-art MDC approaches regarding image coding efficiency when tested on several commonly available datasets.
A Novel Multiple Description Image Coding Framework Based on the SFQ Algorithm.

Lin-Lin Tang,Zhe-Ming Lu

DOI: https://doi.org/10.1587/elex.6.1137

2009-01-01

IEICE Electronics Express

Abstract:Multiple Description Coding (MDC) is a new developed method to overcome fading in wireless communications. It enhances the robustness of information transmission over non-prioritized and unpredictable networks. A novel MDC framework for images based on the Space-Frequency Quantization (SFQ) algorithm is proposed in this paper. The redundancy is introduced through the improved zerotree quantization and the simple odd-even estimation method. In comparison with other schemes, the simulation results show the efficiency of the proposed method.
On Natural Type Selection in Universal Multiple Description Coding

Yuhua Fan,Jia Wang,Jun Sun

DOI: https://doi.org/10.1109/DCC.2011.34

2011-01-01

Abstract:In this paper, we generalize the concept of natural type selection, initially proposed by R.Zamir \emph{et.al.}, to multiple description coding. We prove results that are parallel to those of adaptive single description coding. A universal multiple description coding scheme is then proposed. The scheme codes a source vector at a time, and updates its codebooks based on the joint type of the code words reconstructed previously. Based on our theoretical results, it can be shown that the rate-distortion performance of the proposed scheme gradually improves as coding proceeds.
On the Generalization of Natural Type Selection to Multiple Description Coding

Yuhua Fan,Jia Wang,Jun Sun,Jun Chen

DOI: https://doi.org/10.1109/tcomm.2012.021513.110833

IF: 6.166

2013-01-01

IEEE Transactions on Communications

Abstract:Natural type selection was originally proposed by Zamir and Rose for universal single description coding. In this paper, we generalize this principle to universal multiple description coding (MDC). Two schemes based on random codebooks are proposed: one is of fixed distortion and the other is of fixed weight. Their operational sum-rate-distortion functions are derived, which coincide with the EGC (El Gamal-Cover) sum-rate bound if the parameters of the schemes are optimized. It is also shown that in both schemes the joint type of reconstruction codewords can be used to improve the rate-distortion (R-D) performance. Based on our theoretical results, a practical universal scheme is proposed by leveraging the MDC methods based on low-density generator matrix (LDGM) codes. The performance of this scheme is compared experimentally with the EGC bound, which shows its effectiveness.
Multiple Description Coding for Encrypted Images.

Yuan Zhang,Xinpeng Zhang,Chuan Qin,Jiang Yu

DOI: https://doi.org/10.1109/iih-msp.2015.40

2015-01-01

Abstract:This work proposes a novel Multiple Description Coding (MDC) method for encrypted images transmitted over unreliable networks. Here, a pseudorandom permutation is used to mask the original content to protect privacy. The encoder splits the encrypted data into two descriptions, and each description includes different rigid pixels and coefficients generated from orthogonal transform to the elastic pixels. An acceptable quality reconstruction can be decodable from the side decoder through iteratively updating the values of coefficients based on the spatial correlation. At the central decoder, since the more accurate rigid pixels received, the more similar predicted image can be considered as initialization. Moreover, the operation of iterative reconstruction twice to unknown pixels also makes the estimations closer to the real values. Therefore, a high quality reconstruction from multiple descriptions can be obtained at the central decoder. Comparison is made with the single description coding and the experiments result is shown that the reconstruction performance with the multiple description coding for encrypted images is significantly improved.
Multiple-Description Image Coding with Distributed Source Coding and Side Information

M Wu,A Vetro,CW Chen

DOI: https://doi.org/10.1117/12.577069

2004-01-01

Abstract:Multiple description coding (MDC) is a source coding technique that involves coding the source information into multiple descriptions. When these descriptions are transmitted over different channels in packet network or error-prone wireless environment, graceful degradation can be achieved even if part of descriptions are not received by the receiver. When MDC is applied to wavelet subband based image coding, it is possible to introduce correlation between the descriptions in each subband. In this paper, we consider using such a correlation as well as potentially error corrupted description as side information in the decoding to formulate the MDC decoding as a Wyner Ziv decoding problem. If only part of descriptions is lost, however, their correlation information is still available. Therefore, the proposed Wyner Ziv decoder can recover the description by using the correlation information and the error corrupted description as side information. High quality reconstruction can still be obtained by combining the decoded descriptions from Wyner Ziv decoder. The proposed scheme takes advantage of an efficient way to use the correlation information, thus makes the system more robust to channel error corruption. Experimental result shows that, comparing to conventional multiple description wavelet based image coding, the PSNR of the received and decoded image could be improved noticeably when coding at the same bit rate.
Multiple Description Convolutional Neural Networks for Image Compression

Lijun Zhao,Huihui Bai,Anhong Wang,Yao Zhao

DOI: https://doi.org/10.1109/tcsvt.2018.2867067

IF: 5.859

2018-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Multiple description coding (MDC) is able to stably transmit signal in un-reliable and non-prioritized networks, which has been broadly studied for several decades. However, traditional MDC does not well leverage image’s context features to generate multiple descriptions. In this paper, we propose a novel standard-compliant convolutional neural network-based MDC framework, which efficiently leverages image’s context information to compress the image. First, multiple description generator network (MDGN) is designed to produce appearance-similar yet feature-different multiple descriptions automatically according to image’s content, which are compressed by a standard codec. Second, we present multiple description reconstruction network (MDRN) including side reconstruction networks (SRNs) and central reconstruction network (CRN). When any one of two lossy descriptions is received at decoder, SRN network is used to improve the quality of this decoded lossy description by simultaneously removing compression artifact and up-sampling. Meanwhile, we utilize CRN network with two decoded descriptions as inputs for better reconstruction, if both of lossy descriptions are available. Third, multiple description virtual codec network is proposed to bridge the gap between MDGN network and MDRN network in order to train an end-to-end MDC framework. Here, two learning algorithms are provided to train our whole framework. In addition to structural dis-similarity loss function, the produced descriptions are used as opposing labels with multiple description distance loss function to regularize the training of MDGN network. These losses guarantee that the generated descriptions are structurally similar yet finely diverse. Experimental results show a great deal of objective and subjective quality measurements to validate the effectiveness of our framework.

The Study Status and Prospective of Multiple Description Coding

Multiple Description Transform Coding: A New Design Approach

Multiple Description Coding and Its Algorithm Optimization

A Multiple Description Image/video Coding Method by Compressed Sensing Theory

A comparative study of multiple description video coding in P2P: normal MDSQ versus flexible dead-zones

An efficient fine grained multi-description and scalable video coding scheme

Multiple Description Video Coding Using Adaptive Temporal Sub-Sampling

Error Concealment Algorithm for Spatial Multiple Description Coding of Video

Efficient Multiple Description Scalable Video Coding Scheme Based on Weighted Signal Combinations

Multiple Description Video Coding Using Joint Frame Duplication/Interpolation

A multiple description codec based on combinatorial optimization and its application to image coding

Tree-Structured Multiple Description Coding for Multiview Mobile TV and Camera-Phone Networks

Analysis and Improvement of Standard-Compatible Multiple Description Image Coding

Multiple Description Coding with Application in Multimedia Watermarking

Deep Optimized Multiple Description Image Coding via Scalar Quantization Learning

A Novel Multiple Description Image Coding Framework Based on the SFQ Algorithm.

On Natural Type Selection in Universal Multiple Description Coding

On the Generalization of Natural Type Selection to Multiple Description Coding

Multiple Description Coding for Encrypted Images.

Multiple-Description Image Coding with Distributed Source Coding and Side Information

Multiple Description Convolutional Neural Networks for Image Compression