Error resilient intra refresh scheme for H.26L stream

Ma Zhonghua,Yu Songyu,Zeng Zhaoping

DOI: https://doi.org/10.1049/el:20020787

2002-01-01

Abstract:Recently much attention has been focused on video streaming through IP-based networks. An error resilient RD intra macro-block refresh scheme for H.26L Internet video streaming is introduced. Various channel simulations have proved that this scheme is more effective than those currently adopted in H.26L

What problem does this paper attempt to address?

Content Based Error Resilience Coding Using Redundant Coding, Reference Frame Modification, and Mode Decision

Wei-wei Xu,Rong-xin Jiang,Xiang Tian,Yao-wu Chen

DOI: https://doi.org/10.1007/s11771-014-2416-3

2014-01-01

Abstract:Quality degradation occurs during transmission of video streaming over the error-prone network. By jointly using redundant slice, reference frame selection, and intra/inters mode decision, a content and end-to-end rate-distortion based error resilience method is proposed. Firstly, the intra/inter mode decision is implemented using macro-block (MB) refresh, and then redundant picture and reference frame selection are utilized together to realize the redundant coding. The estimated error propagation distortion and bit consumption of refresh MB are used for the mode and reference frame decision of refresh MB. Secondly, by analyzing the statistical property in the successive frames, the error propagation distortion and bit consumption are formulated as a function of temporal distance. Encoding parameters of the current frame is determined by the estimated error propagation distortion and bit consumption. Thirdly, by comparing the rate-distortion cost of different combinations, proper selection of error resilience method is performed before the encoding process of the current frame. Finally, the MB mode and bit distribution of the primary picture are analyzed for the derivation of the texture information. The motion information is subsequently incorporated for the calculation of video content complexity to implement the content based redundant coding. Experimental results demonstrate that the proposed algorithm achieves significant performance gains over the LA-RDO and HRP method when video is transmitted over error-prone channel.
An Error Resilient H.26L Mode Decision Scheme for Internet Channel

马仲华,余松煜,王兴东

DOI: https://doi.org/10.3321/j.issn:0372-2112.2003.02.038

2003-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:Based on the new-coming H.26L video compression standard, a RD optimal Macro-Block mode decision scheme for Internet error channel streaming is introduced. The scheme employs the luminance Rate Distortion (RD) optimal mode decision scheme so as to take the effects of video encoding distortion and the channel error propagation to get higher error robustness for error transmission. Experimental results under real Internet channel condition fully prove its superior adaptive error resilient capability.
An Error Robust Macro-Block Mode Decision for H.26l Stream

ZH Ma,SY Yu,ZP Zeng

DOI: https://doi.org/10.1109/icccas.2002.1180684

2002-01-01

Abstract:With the rapid development of the Internet, more and more attention is focused on IP video streaming. We introduce an RD optimal macro-block mode decision scheme for the new H.26L video stream. Based on the statistical error propagation model of the Internet and the unequal NAL packet of H.26L, our new scheme can be more error robust than those currently adopted in the H.26L test mode.
Interactive H.264/SVC Error Control Methods Design and Implementation

Yunpeng Liu,Sanyuan Zhang,Yin Zhang,Renfang Wang

DOI: https://doi.org/10.1109/iasp.2011.6109076

2011-01-01

Abstract:Aiming at the problems of the falling decoded video quality of H.264/SVC (Scalable Video Coding) in the error prone transmission network, this paper proposes real-time feedback-based interactive error control methods suitable for low bit rate transmission. These methods make full use of the inter-layer prediction of spatial layers, improves the conventional feedback-based intra macro block (MB) update and references picture selection (RPS) error resilience techniques. The methods were tested using SVC common test conditions. Simulation results show that the average Y-PSNR of decoded pictures can achieve around 1.78dB gains using the best proposed method compared with the relative methods.
A Network-Aware Error-Resilient Method Using Prioritized Intra Refresh for Wireless Video Communications

Han-jie Ma,Fan Zhou,Rong-xin Jiang,Yao-wu Chen

DOI: https://doi.org/10.1631/jzus.a0820660

2009-01-01

Abstract:We propose a novel prioritized intra refresh method for the wireless video communication. The proposed method considers the characteristics of the human visual system, the error-sensitivity of the bitstream, and the state of the time-varying wireless channel jointly. An expected perceptual distortion model was used to adjust the intra refresh rate adaptively. This model consists of the perceptual weight map based on an attention model, the bit error probability map based on bitstream size, and the dynamic channel state information (CSI). Experimental results indicate that, compared with other intra refresh methods that consider only the content of the video or the CSI, the proposed method improves the average peak signal-to-noise ratio (PSNR) of the whole frame by about 0.5 dB, and improves the average PSNR of the attention-area by about 0.8 dB.
Low-complexity frame importance modelling and resource allocation scheme for error-resilience H.264 video streaming

Gang Sun,Wei Xing,Dongming Lu

DOI: https://doi.org/10.1109/MMSP.2008.4665185

2008-01-01

Abstract:In this paper, we addressed the problem of redundancy allocation for protecting packet loss for better quality of service (QoS) in real-time H.264 video streaming. A novel error-resilient approach is proposed for the transmission of pre-encoded H.264 video stream under bandwidth constrained networks. A novel frame importance model is derived for estimating relative importance index for different H.264 video frames. Combining with the characteristics of the network, the optimal resource allocation strategy for different video frames can be determined for achieving improved error resilience. The model uses frame error propagation index (FEPI) to characterize video quality degradation caused by error propagation in different frames in a GOP when suffer from packet loss. This model can be calculated in DCT domain with the parameters extracted directly from the bitstream. Therefore, the complexity of the proposed scheme is very low and much better for real-time video transmission. Simulation results show that the proposed scheme can improve the receiver side reconstructed video quality remarkably under different channel loss patterns.
A Network-Aware Error-Resilient Video Coding Using Adaptive Intra and Reference Selection Refresh

Yiran Zhou,Weiwei Xu,Yaowu Chen

DOI: https://doi.org/10.1109/cnmt.2009.5374797

2009-01-01

Abstract:Video quality suffers significant degradation when transmitted over error-prone channel. In this paper, a novel error-resilient coding scheme based on the H.264/AVC standard is proposed to tackle this challenge. Unlike traditional schemes using single and fixed tool, both intra refresh and reference selection (RS) refresh tools are dynamically adapted with consideration of more varying factors like transmission channel's packet loss state, bitrate, and expected distortion. To form a balance between coding efficiency and error-resilient capability, an approach to compute refresh locations, refresh mode, and reference picture selection according to scenarios will be presented. Experiments prove that it outperforms traditional refresh methods in a loss-probability-varying transmission channel environment.
A H.26L Intra/inter Mode Switching Decision Scheme for Wireless Channel

C Chuan,SY Yu,LJ Cheng

DOI: https://doi.org/10.1109/iccs.2002.1183272

2002-01-01

Abstract:This paper proposes a rate-distortion (RD) based optimal macroblock (MB) intra/inter mode switching decision scheme for a H.26L video stream under wireless error channel. Based on the statistics model of error propagation, this work adopts a reduced computation RD optimal mode switching decision scheme. It can come up with a higher error robustness video stream than the conventional H.26L mode decision algorithm and multiple decoder algorithm. The experimental results under typical 3GPP/3GPP2 channel condition show that it has robust error resilient ability and good stability.
Error Resilient Coding of H.264 Using Intact Long-Term Reference Frames

Qing Zhang,,Guizhong Liu,

DOI: https://doi.org/10.1049/cp:20080284

2008-01-01

Abstract:Transmission of compressed video over packet lossy networks is a challenge task due to the well-known error propagation problem, which may substantially degrade the transmitted video quality. In this paper, we propose an error-resilient coding scheme for the newest coding standard H.264 by using intact long-term reference frames. Specifically, two reference frames are available for inter-coding, one is the immediate past frame marked as short-term reference frame, and the other is an older and error-free one marked as long-term reference frame. To mitigate error propagation, a number of macroblocks (MBs) in each inter-frame are selected to be predicted from the long-term reference frame. Compared to the widely used MB intra-refresh, the proposed scheme is equally robust but more coding efficient. Numerical simulation results verify the validity of our scheme.
Error resilient video transmission with adaptive stream-shuffling and bi-directional error concealment

Chuxiang Li,Jianhua Lu,Jun Gu,Minglei Liou

DOI: https://doi.org/10.1109/SIPS.2000.886701

2000-01-01

Abstract:This paper proposes a set of resident algorithms in conjunction with the H.263 standard to support video transmission over mobile radio channels. Specifically, an adaptive stream-shuffling scheme is proposed to mitigate the effects of burst-errors in mobile channels, while an efficient error detection and a bi-directional error concealment algorithm, which exploits the inherent correlation and the error resilient diversity of PB coding mode in an H.263 coded bit stream, are effectively incorporated. Simulations show that this set of algorithms can achieve an efficient and effective video transmission in most of wireless environments
A New Scheme for Enhancing H. 26L's Robustness in Internet Channel

傅红燕,方向忠,杨华

DOI: https://doi.org/10.3321/j.issn:1006-2467.2003.08.035

2003-01-01

Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University

Abstract:To improve the robustness of intra-coded macroblocks (MBs) in such case, a new algorithm was proposed. In the algorithm, combined with the unequal packet protection for data packets in Internet channel, some intra-coded MBs over the encoder, according to an appropriate judgement scheme, are allowed to include motion vectors so as to substantially enhance the performance of the temporal error concealments over the decoder. The simulation results demonstrate that this proposed method substantially improves the H.26L's packet loss resilience.
A New Error Robustness Scheme Based on Uep for H.264 Streaming over Internet

H Yang,S Yang,SY Yu

IF: 1.019

2005-01-01

Chinese Journal of Electronics

Abstract:Due to the H.264 features in data partitioning and packing schemes, when the H.264 video stream is transmitted over packet-switched networks, intracoded macroblocks are much more susceptible to packet loss than inter-coded macroblocks, and the loss of intra-coded macroblocks causes serious error propagation. In order to improve the robustness of intra-coded macroblocks, a new algorithm combined with unequal error protection for packets over Internet channel is proposed here. In this algorithm, according to an appropriate judgment scheme' some intra-coded macroblocks in the encoder are allowed to include motion vectors so as to substantially enhance the performance of temporal error concealments in the decoder. The simulation results demonstrate that this proposed method substantially improves the H.264's packet loss resilience.
Studies of Error Resilient Technologies for H.263 Video Coder

贾志科,崔慧娟,唐昆

DOI: https://doi.org/10.3321/j.issn:1000-0054.2001.04.045

2001-01-01

Abstract:An interactive error resilient scheme is proposed to improve theperformance of H.263 video coder in error prone channels without losing compatibility. The robust H.263 video coder uses resynchronization flags insertion, error detection, localization and concealment in the decoder, and dynamic programming mode selection based on error tracking in the encoder. A novel decoding information feedback method is described which utilizes the H.263 video bit stream but does not modify its syntax. This error resilient scheme does not modify the syntax standard of the H.263 bit stream to keep its compatibility. Simulation results demonstrate that this error resilient H.263 coder provides good video quality in rate limited noisy channels.
Unequal Forced-Intra-refresh for Robust Video Streaming

Liu Hao,Zhang Wen-jun,Yang Xiao-kang

DOI: https://doi.org/10.1631/jzus.2006.a1695

2006-01-01

Journal of Zhejiang University SCIENCE A

Abstract:For video streaming over lossy channels, intra refresh can mitigate the error-propagation effect caused by packet losses. Besides some intra-mode macroblocks (MBs) generated by the “Lagrangian rate-distortion” or “Sum of absolute difference” mode decision, the encoder or transcoder possibly needs to increase some “forced” intra-mode MBs for robust video streaming. Based on the error-propagation analysis in a group of pictures (GOP), we propose an unequal Forced-Intra-Refresh (FIR) scheme to improve packet loss resilience of video streaming. According to a GOP-level error-propagation model, the proposed unequal FIR scheme can optimally increase the unequal number of forced intra-mode MBs for different frames in a GOP. Simulation results showed that the proposed scheme can effectively enhance the robustness of video streaming under different channel conditions, and achieve about 0.1∼0.9 dB gains over the average FIR scheme in H.264/AVC tools.
Distortion Modeling And Error Robust Coding Scheme For H.26l Video

Chuan Chen,Songyu Yu,Lianji Cheng

IF: 1.019

2004-01-01

Chinese Journal of Electronics

Abstract:Transmission of hybrid-coded video including motion compensation and spatial prediction over error prone channel results in the well-known problem of error propagation because of the drift in reference frames between encoder and decoder. The prediction loop propagates errors and causes substantial degradation in video quality. Especially in H.26L video, both intra and inter prediction strategies are used to improve compression efficiency, however, they make error propagation more serious. This work proposes distortion models for H.26L video to optimally estimate the overall distortion of decoder frame reconstruction due to quantization, error propagation, and error concealment. Based on these statistical distortion models, our error robust coding scheme only integrates the distinct distortion between intra and inter macroblocks into a rate-distortion based framework to select suitable coding mode for each macroblock, and so, the cost in computation complexity is modest. Simulations under typical 3GPP/3GPP2 channel and Internet channel conditions have shown that our proposed scheme achieves much better performance than those currently used in H.26L. The error propagation estimation and effect at high fractural pixel-level prediction have also been tested. All the results have demonstrated that our proposed scheme achieves a good balance between compression efficiency and error robustness for H.26L video, at the cost of modest additional complexity.
A Self-Adaptive Temporal and Spatial Combined Error Resiliency Scheme Based on H.264/AVC

Jing Chen,Shimei Su,Jiankui Zhou,Lei Cao,Xiaoshe Dong

2010-01-01

Abstract:Real-time transmission of video data in wireless network environments is a challenging task, as it have higher bit error rate and packet loss ratio. An Self-Adaptive Temporal and Spatial combined Error Resiliency(SATSER) scheme based on H.264/AVC is proposed in the paper to improve the quality of the rebuilt video pictures in decoder side. Combining the spatial error resiliency method with the temporal one, a new scheme is proposed to conceal an erroneous block according to its encoded mode. The spatial error resiliency scheme exploits the directional interpolation which subdivides the block by the number and the direction of edges going through the erroneous block to recover it. The temporal error resiliency scheme adopts the weighted neighboring Boundary Matching Algorithm to recover the erroneous block. Experiments show that the proposed error resiliency scheme can restrain the diffusion of erroneous block and improve the quality of the rebuilt image.
Error-resilient video coding of H.264/AVC based on network-adaptive intra refresh and reference selection refresh

Yiran Zhou,Yaowu Chen

DOI: https://doi.org/10.1117/1.3467462

IF: 1.3

2010-01-01

Optical Engineering

Abstract:Video quality suffers significant degradation when transmitted over error-prone channels. We propose a novel error-resilient coding scheme based on the H.264/advanced video coding (AVC) standard to tackle this challenge. Compared to the traditional schemes that often employ a single and fixed tool, both intra refresh and reference selection refresh tools are dynamically used. The refresh locations, modes, and reference distances are determined according to the channel's state, the bit rate, and the expected distortion. A refresh allocation optimization mechanism for temporal and spatial terms is further developed under the approach, and the information from the distortion calculations is utilized to save computation time. Results indicate that the proposed scheme outperforms traditional refresh schemes in a loss-rate-varying transmission environment, and improves both subjective and objective qualities. (C) 2010 Society of Photo-Optical Instrumentation Engineers. [DOI: 10.1117/1.3467462]
An H. 26L Mode Decision Scheme over Wireless Channel

陈川,余松煜,熊红凯

DOI: https://doi.org/10.3321/j.issn:1006-2467.2003.08.038

2003-01-01

Abstract:This paper proposed a rate-distortion(RD) based optimal macroblock(MB) intra/inter-mode decision scheme for H.26L video stream over wireless channel. Based on the statistics model of error propagation, this work adopts a reduced complexity mode selecting scheme. It can come up with more error robust video stream than the conventional H.26L mode decision algorithm with a modest computational complexity. The simulation results under typical 3GPP/3GPP2 channel condition demonstrate that the proposed scheme can achieve a good balance between compression efficiency and error robustness.
A New Error Resilience Method for FGS Video Enhancement Bit-Stream.

Ran Ma,Zhao-yang Zhang,Ping An

DOI: https://doi.org/10.1117/12.665406

2006-01-01

Abstract:Video streaming over the Internet usually encounters with bandwidth variations and packet losses, which impacted badly on the reconstructed video quality. Fine Granularity Scalability (FGS) can well provide bit-rate adaptability to different bandwidth conditions over the Internet, due to its fine granular and error resilience. However, the effective solution of packet losses is Multiple Description Coding (MDC), but a great deal of redundancy information is brought up. For an FGS video bit-stream, the base layer is usually very small and of high importance, error-free transmission could be achieved through classical error resilience technique. As a result, the overall streaming quality is mostly dependent on the enhancement layer. Moreover, it is worthy of note that the different bit-planes are of different importance, which are suitable to unequal protection (UEP) strategy. So, a new joint MDC and UEP method is proposed to protect the enhancement layer in this paper. In the proposed method, the MDC encoder/decoder is embedded into the normal enhancement layer encoder/decoder. By considering of the unequal protection of bit-plane and the redundancy of MDC, the two most significant bit-planes adopt the MDC-based strategy. While, the remaining bit-planes only encoded by normal enhancement layer coding system. Experimental results are demonstrated to testify the efficiency of our proposed method.
Error resilient scalability for video bit-stream over heterogeneous packet loss networks

Dong Zhang,Yi Guo,Houqiang Li,Chang Wen Chen

DOI: https://doi.org/10.1109/ISCAS.2010.5537585

2010-01-01

Abstract:Robust transmission of compressed video bit-streams over heterogeneous packet loss network is one of the key challenges in the contemporary video communication system. Recent researches have focused on enhancing error resilience of bit-stream through the deployment of transcoder between wired and wireless networks. However, the conventional error resilient algorithms (e.g., Intra refresh) through cascading decoding and encoding processes usually have high degree of complexity. We introduce in this paper a completely new concept of error resilient scalability. We develop an extremely low complexity scheme based on redundant pictures information. In this scheme, redundant picture information is generated at the encoder and can be applied at media gateway to determine the redundant quantity of bit-stream according to the packet loss rate of access network. By transmitting compressed bit-stream together with redundant picture information, we are able to achieve the desired error resilient scalability of video bit-stream at the media gateway for heterogeneous networks. Joint rate source-channel-distortion model is adopted to optimize the generation of redundant picture information under various packet loss rates. Experimental results demonstrate expected effectiveness of the proposed scheme in error resilience scalability.

Error resilient intra refresh scheme for H.26L stream

Content Based Error Resilience Coding Using Redundant Coding, Reference Frame Modification, and Mode Decision

An Error Resilient H.26L Mode Decision Scheme for Internet Channel

An Error Robust Macro-Block Mode Decision for H.26l Stream

Interactive H.264/SVC Error Control Methods Design and Implementation

A Network-Aware Error-Resilient Method Using Prioritized Intra Refresh for Wireless Video Communications

Low-complexity frame importance modelling and resource allocation scheme for error-resilience H.264 video streaming

A Network-Aware Error-Resilient Video Coding Using Adaptive Intra and Reference Selection Refresh

A H.26L Intra/inter Mode Switching Decision Scheme for Wireless Channel

Error Resilient Coding of H.264 Using Intact Long-Term Reference Frames

Error resilient video transmission with adaptive stream-shuffling and bi-directional error concealment

A New Scheme for Enhancing H. 26L's Robustness in Internet Channel

A New Error Robustness Scheme Based on Uep for H.264 Streaming over Internet

Studies of Error Resilient Technologies for H.263 Video Coder

Unequal Forced-Intra-refresh for Robust Video Streaming

Distortion Modeling And Error Robust Coding Scheme For H.26l Video

A Self-Adaptive Temporal and Spatial Combined Error Resiliency Scheme Based on H.264/AVC

Error-resilient video coding of H.264/AVC based on network-adaptive intra refresh and reference selection refresh

An H. 26L Mode Decision Scheme over Wireless Channel

A New Error Resilience Method for FGS Video Enhancement Bit-Stream.

Error resilient scalability for video bit-stream over heterogeneous packet loss networks