Abstract:Natural scene statistics (NSSs) models have been developed that make it possible to impose useful perceptually relevant priors on the luminance, colors, and depth maps of natural scenes. We show that these models can be used to develop 3D content creation algorithms that can convert monocular 2D videos into statistically natural 3D-viewable videos. First, accurate depth information on key frames is obtained via human annotation. Then, both forward and backward motion vectors are estimated and compared to decide the initial depth values, and a compensation process is applied to further improve the depth initialization. Then, the luminance/chrominance and initial depth map are decomposed by a Gabor filter bank. Each subband of depth is modeled to produce a NSS prior term. The statistical color-depth priors are combined with the spatial smoothness constraint in the depth propagation target function as a prior regularizing term. The final depth map associated with each frame of the input 2D video is optimized by minimizing the target function over all subbands. In the end, stereoscopic frames are rendered from the color frames and their associated depth maps. We evaluated the quality of the generated 3D videos using both subjective and objective quality assessment methods. The experimental results obtained on various sequences show that the presented method outperforms several state-of-the-art 2D-to-3D conversion methods.

2 D to 3 D Conversion in 3 DTV Using Depth Map Generation and Vir Tual View Synthesis

An automatic 2D to 3D conversion algorithm using multi-depth cues

A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

Depth-image Based View Synthesis for Threedimensional Television

A novel 2D-to-3D conversion method based on blocks world

Stereoscopic video conversion based on depth tracking

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps

3DV Quality Model Based Depth Maps for View Synthesis in FTV System

Depth-image-based Rendering with Spatial and Temporal Texture Synthesis for 3DTV

Depth Image Segmentation for Improved Virtual View Image Quality in 3-DTV

Depth Template Based 2D-to-3d Video Conversion and Coding System.

A novel method for 2D-to-3D video conversion using bi-directional motion estimation

Visual Pertinent 2D-to-3d Video Conversion by Multi-Cue Fusion

Automatic 2D-To-3D video conversion technique based on depth-from-motion and color segmentation

Real-time Stereo to Multi-View Conversion System Based on Adaptive Meshing

A Novel Method For Automatic 2d-To-3d Video Conversion

Improved Multi-View Depth Estimation For View Synthesis In 3d Video Coding

A New Approach of 2D-to-3d Video Conversion and Its Implementation on Embedded System

Toward Naturalistic 2D-to-3d Conversion

A Novel Method For Semi-Automatic 2d To 3d Video Conversion