Stereo Image Coding System Based on ,joint Prediction

李劼伟,季晓勇

DOI: https://doi.org/10.3969/j.issn.1002-8692.2009.04.006

2009-01-01

Abstract:A novel stereo video coding system is proposed using joint prediction scheme which combines three prediction schemes to achieve high coding efficiency and low computational complexity.

What problem does this paper attempt to address?

Weighted Joint Inter Prediction Algorithm Of Stereo Video Encoding

Guo Rui,Wang Lixin,Liu Jilin,Wu Wei

DOI: https://doi.org/10.1109/WiCom.2008.776

2008-01-01

Abstract:In this paper, a weighted joint prediction mode is proposed. It not only compares the motion prediction and disparity prediction, but also compares the motion prediction, disparity prediction and the weighted joint prediction. Then, the prediction mode which leads the least prediction distortion is chosen as inter prediction. Experimental results show that the proposed encoding scheme can solve the problem that motion prediction and disparity contribute differently in different area, even different block of the same area, and can improve the stereo video encoding performance.
Enhanced Block Prediction In Stereoscopic Video Coding

Dong Li,Yongbing Zhang,Qiong Liu,Xiangyang Ji,Qionghai Dai

DOI: https://doi.org/10.1109/3dtv.2011.5877163

2011-01-01

Abstract:The coding efficiency improvement of stereoscopic video system is a hot research topic in the 3D video coding areas. To better exploit the redundancy between the two channels of stereoscopic video, a stereoscopic video coding scheme for Audio Video Coding Standard (AVS) is proposed in the paper. The superior coding performance of the proposed scheme benefits from an enhanced block prediction algorithm, which includes an improvement of AVS direct mode and motion vector prediction, as well as adaptively combining the prediction results of motion compensation and disparity compensation. The experimental results demonstrate that the proposed scheme and algorithm greatly outperforms the reference software of AVS.
A new scheme of layered coding of stereoscopic video

Xiaotong Liao,Ran Ma,Ping An,Zhaoyang Zhang

DOI: https://doi.org/10.1109/ICALIP.2010.5684996

2010-01-01

Abstract:A new scheme of layered coding of stereoscopic video based on the correlation of motion vector fields (MV fields) is proposed in this paper, in which the bit streams robustness is improved to error channel and the coding efficiency is not reduced evidently. In our proposed scheme, the stereoscopic video is classified into one base layer and two enhancement layers. First, left-view video is encoded as Base Layer to ensure the basic quality of two-dimensional video. Then, the disparity vectors(DVs) of right-view video are encoded as Enhancement Layer 1.To lower bit rates further and reduce the network load, the strong correlation of the motion vectors(MVs) for two views video sequence are tested. Based on the correlation of MVs between views, the MVs of right-view are transmitted as Enhancement Layer 2 only if the correlation between left and right view is less than some threshold. Experimental results are demonstrated to testify the efficiency of our proposed scheme. ©2010 IEEE.
Stereoscopic video coding based on global displacement compensated prediction

HuiZhu Jia,Wen Gao,Yan Lu

DOI: https://doi.org/10.1109/ICICS.2003.1292413

2003-01-01

Abstract:In this paper, we propose a novel algorithm for coding the stereoscopic video sequence based on the global displacement information between the left- and right-view images. MPEG-4 temporal scalable video coding scheme is employed at the baseline, in which the left- and right-view images are compressed at the base and enhancement layer, respectively. To further improve the coding efficiency, some intuitive properties of stereoscopic videos are utilized. One of the major properties lies in the global displacement between the left- and right-view images. In this paper, we propose coding the right-view image with global motion compensated prediction from the left-view image. A further main property of stereoscopic video arises from the fact that, objects simultaneously existing in the left- and right-view images usually result in the very close motion vectors. Based on the global motion information, the motion vectors of the right-view sequence can be easily predicted from that of the left-view sequence. Rate-distortion optimization is also used to select the coding mode. Experimental results show that, compared to the MPEG-4 temporal scalability algorithm for low bitrate stereoscopic video coding, the proposed algorithm can save the bitrate up to 20%.
Multi-view video coding based on sequence correlation

Feng Lu,Ping An,Zhaoyang Zhang,Liquan Shen

DOI: https://doi.org/10.1109/ICALIP.2010.5685139

2010-01-01

Abstract:Traditional coding method used the same prediction structure to encode the multi-view sequences whose correlation are distinctly different. This method eliminated the temporal and spatial redundancy by using multi-references blindly. Although the traditional prediction structures have quite good coding efficiency, it results in the problem of high complexity. So by analyzing the characteristic of the multiview video data itself, we designed a correlation testing structure and depending on the correlation intensity on both the temporal and spatial direction, a method of multiple prediction structures coding jointly is proposed. Experimental results show that the proposed method can reduce the coding complexity while maintaining high coding efficiency, and to the sequences whose spatial correlation is quite strong, the method given can not only raise the PSNR, but reduce the bitrate as well.
Multi-view Video Coding Based on View Prediction

Ping An,Qiuyan Guo,Tao Mi,Li Zhou,Zhaoyang Zhang

DOI: https://doi.org/10.1109/icalip.2008.4590138

2008-01-01

Abstract:Multiple view video coding (MVC) is key technology that serves a wide variety of applications, including FTV (free-viewpoint television), 3DTV (three dimensional television) and surveillance. Multi-view video consists of multiple views of the same scene in which there is a high degree of correlation between inter views and intra views. In this paper, a multi-view video coding method based on a new view prediction structure is proposed which makes full use of the spatial redundancy in addition to exploiting the temporal redundancy by performing spatial prediction across different views. A multi-reference disparity prediction method based on variable size block matching is used to get better disparity compensation effect in the proposed structure. Besides, by omitting transmission some B frames, the coding bit-rate is further reduced. Experimental results show that compared to general GoGOP algorithm, the proposed multi-reference prediction algorithm can reconstruct the target images with higher quality, and the MVC scheme based on the new view prediction structure can obtain a coding gain with about 1.4 dB.
Fast Stereoscopic Frame Estimation and Interpolation Algorithm in Compressed Stereo Video Streams

Y Luo,ZY Zhang

DOI: https://doi.org/10.1117/12.477072

2002-01-01

Abstract:A novel stereoscopic coding-decoding framework was proposed in this paper. The reference image stream of a stereoscopic sequence is independently coded by a conventional MPEG-type scheme at higher quality; only a few reference frames in target stream are coded and transmitted. The rest frames are 'skipped' and are reconstructed at the decoder using a Combine Stereoscopic Frame Estimation and Interpolation without search (CSFEI) technique proposed in this paper. In order to estimate the unfilled regions due to occlusion, a global solution based on a probability model is also proposed. Simulation results show that the CSFEI scheme can achieve a PSNR gain (about 2-3 dB) as compared to the block-based matching algorithm.
Joint Local and Nonlocal Progressive Prediction for Versatile Video Coding

Meng Lei,Falei Luo,Xinfeng Zhang,Shanshe Wang,Siwei Ma

DOI: https://doi.org/10.1109/tip.2022.3161831

IF: 10.6

2022-01-01

IEEE Transactions on Image Processing

Abstract:In the latest video coding standard, namely Versatile Video Coding (VVC), more directional intra modes and reference lines have been utilized to improve prediction efficiency. However, complex content still cannot be predicted well with only the adjacent reference samples. Although nonlocal prediction has been proposed to further improve the prediction efficiency in existing algorithms, explicit signalling or matching error potentially limits the coding efficiency. To address these issues, we propose a joint local and nonlocal progressive prediction scheme, targeting at improving nonlocal prediction accuracy without additional signalling. Specifically, template matching based prediction (TMP) is conducted firstly to derive an initial nonlocal predictor. Based on the first prediction and previously decoded reconstruction information, a local template, including inner textures and neighboring reconstruction, is carefully designed. With the local template involved in nonlocal matching process, a more accurate nonlocal predictor can be found progressively in the second prediction. Finally, the coefficients from the two predictions are fused and transmitted in bitstreams. In this way, more accurate nonlocal predictor can be derived implicitly with local information instead of being explicitly signalled. Experimental results on the reference software VTM-9.0 of VVC show that the method achieves 1.02% BD-Rate reduction for natural sequences and 2.31% BD-Rate reduction for screen content videos under all intra (AI) configuration.
Multi-view Video Coding Based on Resultant Vector Estimation

Suxing Liu,Ping An,Zhaoyang Zhang,Zhanwei Liu

DOI: https://doi.org/10.1049/cp:20070158

2007-01-01

Abstract:Aiming at fully exploiting the temporal redundancy and spatial redundancy, we propose a multi-view video coding scheme based on resultant vector estimation. Combining the disparity vector and motion vector as one vector, the novel "resultant vector" was first proposed. Meanwhile, by extending the loop constraint to multi-view images for a parallel camera geometry model, redundancy between views is greatly reduced by utilizing the linear relationship of adjacent views and the "resultant vector". Experimental results show that our scheme's performance is superior to conventional methods such as GOP (group-of-picture) or M-picture. Coding efficiency is improved about 1.2~1.5 dB.
A Novel Data Embedding Method for H.264 Stereo Video Codec with Joint Prediction Scheme

Minfang Gao,Xiaoyong Ji,Yuanqing Wang

DOI: https://doi.org/10.1007/s11859-010-0110-3

2010-01-01

Abstract:It is important to reduce data redundancy of stereo video in practical applications. In this paper, first, a data embedding method for stereo video (DEMSV) is investigated by embedding the encoding data into the reference frame to encode stereo video. It can use only one channel to transfer all the video data and the receiver can choose a monocular video decoder or stereo video decoder adaptively. Then, introducing the joint prediction scheme in the coding process of DEMSV, we propose a novel data embedding method for H.264 stereo video codec with joint prediction scheme (DEMSV-JPS) to achieve high coding efficiency. Experimental results show that the proposed method can obtain high peak signal-to-noise ratio (PSNR) and compression ratio (at least 33 dB for the test sequence). Comparing the testing methods using JPS and without using JPS, we prove that JPS can further improve the objective and visual quality. DEMSV-JPS shows such advantages and will be suitable to applications in real-time environments of stereo-video transmission.
Stereoscopic Video Coding in AVS.

Xiangyang Ji,Yongbing Zhang,Lu Yu,Gwo Giun Lee

DOI: https://doi.org/10.1109/vcip.2011.6116044

2011-01-01

Abstract:This paper is an overview for AVS stereoscopic video coding technology, including two channels based inter-view prediction coding and stereo packing mode coding. The first one utilizes inter-view prediction to efficiently exploit the redundancy between the two channels of stereoscopic video. The superior coding performance of the inter-view prediction scheme benefits from an enhanced block prediction algorithm, which includes an improvement of direct mode for B-picture and motion vector prediction for P-picture. In addition, stereo packing mode, including side by side and top bottom, is adopted in AVS stereoscopic video coding to support the stereoscopic video service deployments based on the frame-compatible approach. Furthermore, an enhanced stereo packing mode is also developed to allow the prediction between signals coming from different channels within one packed frame. The simulation results demonstrate that the adopted techniques in AVS stereoscopic video are able to improve the compression efficiency of stereoscopic videos compared to simulcast one.
Interweaved Prediction for Video Coding.

Kai Zhang,Li Zhang,Hongbin Liu,Jizheng Xu,Zhipin Deng,Yue Wang

DOI: https://doi.org/10.1109/tip.2020.2987432

IF: 10.6

2020-01-01

IEEE Transactions on Image Processing

Abstract:In the emerging next generation video coding standard Versatile Video Coding (VVC) developed by the Joint Video Exploration Team (JVET), sub-block-based inter-prediction plays a key role in promising coding tools such as Affine Motion Compensation (AMC) and sub-block-based Temporal Motion Vector Prediction (sbTMVP). With sub-block-based inter-prediction, a coding block is divided into sub-blocks, and the motion information of each sub-block is derived individually. Although sub-block-based inter-prediction can provide a higher quality prediction benefiting from a finer motion granularity, it still suffers two problems: uneven prediction quality and boundary discontinuity. In this paper, we present a method of interweaved prediction to further improve sub-block-based inter-prediction. With interweaved prediction, a coding block with AMC or sbTMVP mode is divided into sub-blocks with two different dividing patterns, so that a corner position of a sub-block in one dividing pattern coincides with the central position of a sub-block in the other dividing pattern. Then two auxiliary predictions are generated by AMC or sbTMVP with the two dividing patterns, independently. The final prediction is calculated as a weighted-sum of the two auxiliary predictions. Theoretical analysis and statistical data prove that interweaved prediction can significantly mitigate the two problems in sub-block-based inter-prediction. Simulation results show that the proposed methods can achieve 0.64% BD-rate saving on average with the random access configurations. On sequences with rich affine motions, the average BD-rate saving can be up to 2.54%.
A joint encoder-decoder error control framework for stereoscopic video coding

Xinguang Xiang,Debin Zhao,Qiang Wang,Siwei Ma,Wen Gao

DOI: https://doi.org/10.1016/j.jvcir.2010.07.002

IF: 2.887

2010-01-01

Journal of Visual Communication and Image Representation

Abstract:Stereoscopic video coding (SSVC) plays an important role in various 3D video applications. In SSVC, robust stereoscopic video transmission over error-prone networks is still a challenge problem to be solved. In this paper, we propose a joint encoder-decoder error control framework for SSVC, where error-resilient source coding, transmission network conditions, and error concealment scheme are jointly considered to achieve better error robustness performance. The proposed joint encoder-decoder error control framework includes two parts: an error concealment algorithm at the decoder side and a rate-distortion optimized error resilience algorithm at the encoder side. For error concealment at the decoder side, an overlapped block motion and disparity compensation based error concealment scheme is proposed to adaptively utilize inter-view correlations and temporal correlations. For error resilience at the encoder side, first, the inter-view refreshment is proposed for SSVC to suppress error propagations. Then, an end-to-end distortion model for SSVC is derived, which jointly considers the transmission network conditions, inter-view refreshment, and error concealment tools at the decoder side. Finally, based on the derived end-to-end distortion model, the rate-distortion optimized error resilience algorithm is presented to adaptively select inter-view, inter- or intra-coding for SSVC. The experimental results show that the proposed joint encoder-decoder error control framework has superior error robustness performance for stereoscopic video transmission over error-prone networks.
A Prediction-Transformation-combined Intra Picture Coding Method.

Yunfei Wang,Xiaoran Cao,Shao Li,Yun He

DOI: https://doi.org/10.1109/pcs.2012.6213351

2012-01-01

Abstract:In the state of the art hybrid video coding structure, intra prediction and transform coding are the most important two parts for intra picture coding. Generally, the prediction process and the transform process are separated. The current block is first predicted from the neighboring reconstructed pixels, the residue block is then transformed. In our approach, the prediction process and transform process are combined, therefore more information can be used for prediction and more accurate prediction can be achieved.
Compound Image Compression by Multi-Stage Prediction

Weijia Zhu,Wenpeng Ding,Ruiqin Xiong,Yuhui Shi,Baocai Yin

DOI: https://doi.org/10.1109/vcip.2012.6410758

2012-01-01

Abstract:Computer generated compound images contain not only photographic images but also text and graphics images, which makes it difficult to be efficiently compressed using exiting image and video coding standards. This paper presents a new compound image coding scheme based on the intra coding framework of the upcoming high efficiency video coding (HEVC) standard. The proposed scheme first decomposes the compound image into color components and structure components. Then two-stage prediction scheme is employed to exploit the correlation among structure components, where the first prediction is generated by directional prediction and second prediction is generated by template matching. Experimental results show that the proposed scheme achieves up to 10.2 dB coding gain on compound images compared with HEVC. And on average it achieves 42.2 percent bitrate saving compared with HEVC.
Line-Based Distributed Coding Scheme For Onboard Lossless Compression Of High-Resolution Stereo Images

Jinlei Zhang,Houqiang Li

DOI: https://doi.org/10.1109/ISCAS.2013.6572123

2013-01-01

Abstract:On board compression coding of remote sensing images requires simple encoder and small storage, etc. However, the existing scheme such as JPEG2000 which is based on DWT has a complex encoder, and many algorithms based on DWT with a lower storage requirement have been researched. In this paper, we propose a novel line-based distributed lossless compression scheme for remote sensing stereo images with low storage costs and light complexity at the encoder. All the lines are encoded independently so that the required storage of the encoder is only one line. In order to achieve low encoding complexity, distributed coding techniques are used to exploit the spatial correlation and inter-view correlation of the stereo images. At the encoder, sub-sampled lines are successively encoded and transmitted. At the decoder, side information is generated with the knowledge of decoded sub-sampled lines and other previously decoded lines for the first view, and the second view will use the previous lines of the first view to remove the inter-view redundancy. In addition, line-based adaptive filter is performed to capture the spatial characteristics and template matching is used to remove the inter-view redundancy. Experimental results on high-resolution remote sensing stereo images demonstrate that the proposed scheme is comparable to JPEG2000 with respect to the compression performance, but with much lower encoding complexity and storage requirement.
Bidirectional Stereo Image Compression with Cross-Dimensional Entropy Model

Zhening Liu,Xinjie Zhang,Jiawei Shao,Zehong Lin,Jun Zhang

2024-07-15

Abstract:With the rapid advancement of stereo vision technologies, stereo image compression has emerged as a crucial field that continues to draw significant attention. Previous approaches have primarily employed a unidirectional paradigm, where the compression of one view is dependent on the other, resulting in imbalanced compression. To address this issue, we introduce a symmetric bidirectional stereo image compression architecture, named BiSIC. Specifically, we propose a 3D convolution based codec backbone to capture local features and incorporate bidirectional attention blocks to exploit global features. Moreover, we design a novel cross-dimensional entropy model that integrates various conditioning factors, including the spatial context, channel context, and stereo dependency, to effectively estimate the distribution of latent representations for entropy coding. Extensive experiments demonstrate that our proposed BiSIC outperforms conventional image/video compression standards, as well as state-of-the-art learning-based methods, in terms of both PSNR and MS-SSIM.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
Stereo Interleaving Video Coding With Content Adaptive Image Subsampling

Yongbing Zhang,Xiangyang Ji,Haoqian Wang,Qionghai Dai

DOI: https://doi.org/10.1109/TCSVT.2012.2223792

IF: 5.859

2013-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Stereo interleaving video coding, in which both left and right view frames are subsampled into half size and multiplexed into one single frame before being encoded by a traditional 2-D video encoder, is an efficient encoding scenario for stereoscopic video. Many existing stereo interleaving video coding methods subsample each frame by utilizing fixed subsampling filter coefficients. Such methods are easy to implement; however, the varying property of the frame signal is ignored. By jointly considering the influences of subsampling and compression, a rate and distortion analysis about stereo interleaving video coding is proposed. The final distortion in stereo interleaving video coding is the summation of errors caused by subsampling (causing distortion between subsampling-interpolated image and the original full resolution one) and by quantization during compression. Based on the provided rate distortion analysis, a content adaptive image subsampling (CAIS) is also proposed. In CAIS, the half-size frames are generated by the optimal subsampling filters, which are calculated based on frame contents and the targeted interpolation coefficients. Experimental results demonstrate that the proposed CAIS is able to greatly improve compression efficiency of stereo interleaving video coding.
A Compact Representation for Compressing Converted Stereo Videos

Zhebin Zhang,Chen Zhou,Ronggang Wang,Yizhou Wang,Wen Gao

DOI: https://doi.org/10.1109/tip.2014.2315958

IF: 10.6

2014-01-01

IEEE Transactions on Image Processing

Abstract:We propose a novel representation for stereo videos namely 2D-plus-depth-cue. This representation is able to encode stereo videos compactly by leveraging the by-product of a stereo video conversion process. Specifically, the depth cues are derived from an interactive labeling process during 2D-to-stereo video conversion-they are contour points of image regions and their corresponding depth models, and so forth. Using such cues and the image features of 2D video frames, the scene depth can be reliably recovered. Experimental results demonstrate that the bit rate can be saved about 10%-50% in coding a stereo video compared with multiview video coding and the 2D-plus-depth methods. In addition, since the objects are segmented in the conversion process, it is convenient to adopt the region-of-interest (ROI) coding in the proposed stereo video coding system. Experimental results show that using ROI coding, the bit rate is reduced by 30%-40% or the video quality is increased by 1.5-4 dB with the fixed bit rate.

Stereo Image Coding System Based on ,joint Prediction

Weighted Joint Inter Prediction Algorithm Of Stereo Video Encoding

Enhanced Block Prediction In Stereoscopic Video Coding

A new scheme of layered coding of stereoscopic video

Stereoscopic video coding based on global displacement compensated prediction

Multi-view video coding based on sequence correlation

Multi-view Video Coding Based on View Prediction

Fast Stereoscopic Frame Estimation and Interpolation Algorithm in Compressed Stereo Video Streams

Joint Local and Nonlocal Progressive Prediction for Versatile Video Coding

Multi-view Video Coding Based on Resultant Vector Estimation

A Novel Data Embedding Method for H.264 Stereo Video Codec with Joint Prediction Scheme

Stereoscopic Video Coding in AVS.

Interweaved Prediction for Video Coding.

A joint encoder-decoder error control framework for stereoscopic video coding

A Prediction-Transformation-combined Intra Picture Coding Method.

Compound Image Compression by Multi-Stage Prediction

Line-Based Distributed Coding Scheme For Onboard Lossless Compression Of High-Resolution Stereo Images

Bidirectional Stereo Image Compression with Cross-Dimensional Entropy Model

Stereo Interleaving Video Coding With Content Adaptive Image Subsampling

A Compact Representation for Compressing Converted Stereo Videos