Abstract:View synthesis prediction (VSP) is a crucial coding tool for improving compression efficiency in the next generation 3D video systems. However, VSP is susceptible to catastrophic error propagation when multi-view video plus depth (MVD) data are transmitted over lossy networks. This paper aims at accurately modeling the transmission errors propagated in the inter-view direction caused by VSP. Toward this end, we first study how channel errors gradually propagate along the VSP-based inter-view prediction path. Then, a new recursive model is formulated to estimate the expected end-to-end distortion caused by those channel losses. For the proposed model, the compound impact of the transmission distortions of both the texture video and depth map on the quality of the synthetic reference view is mathematically analyzed. Especially, the expected view synthesis distortion due to depth errors is characterized in the frequency domain using a new approach, which combines the energy densities of the reconstructed texture image and the channel errors. The proposed model also explicitly considers the disparity rounding operation invoked for the sub-pixel precision rendering of the synthesized reference view. Experimental results are presented to demonstrate that the proposed analytic model is capable of effectively modeling the channel-induced distortion for MVD-based 3D video transmission.

Distortion analysis and error concealment for multi-view video transmission

Modeling of Transmission Distortion for Multi-View Video in Packet Lossy Networks

Analysis of transmission-induved distortion for multi-view video

Channel Distortion Modeling for Multi-View Video Transmission over Packet-Switched Networks

Error Concealment Algorithm for Spatial Multiple Description Coding of Video

Rate-distortion Based Reference Viewpoints Selection for Multi-View Video Plus Depth Coding

A Multi-View Stereoscopic Video Transmission System with Error Concealment Algorithm

An Error Concealment Algorithm for Whole Frame Loss

Analysis of Error Concealment Technology Based on 3D Video Coding

Error-resilient Multi-View Video Coding for Next Generation 3-D Video Broadcasting

Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization

Analysis of Packet-Loss-Induced Distortion in View Synthesis Prediction-Based 3D Video Coding

Quality of multi-view 3D video transmission in error-prone networks

Error Control Techniques Based on Multiview Video

A Frame Loss Error Concealment Scheme for Multi-view Video Coding

Inter-view Coding Correlation Based Error Concealment for Stereoscopic Video Transmission.

Efficient rendering distortion estimation for depth map compression

An advanced rate control algorithm for multi-view video based on the quadratic R-D model

Depth Map Intra Coding Based on Virtual View Rendering Distortion Estimation

Fast Error Concealment Method for 3D Video Transmission

Real-Time Error-Resistent Transmission of Multiview 3D Video over IP Networks