Abstract:Natural scene statistics (NSSs) models have been developed that make it possible to impose useful perceptually relevant priors on the luminance, colors, and depth maps of natural scenes. We show that these models can be used to develop 3D content creation algorithms that can convert monocular 2D videos into statistically natural 3D-viewable videos. First, accurate depth information on key frames is obtained via human annotation. Then, both forward and backward motion vectors are estimated and compared to decide the initial depth values, and a compensation process is applied to further improve the depth initialization. Then, the luminance/chrominance and initial depth map are decomposed by a Gabor filter bank. Each subband of depth is modeled to produce a NSS prior term. The statistical color-depth priors are combined with the spatial smoothness constraint in the depth propagation target function as a prior regularizing term. The final depth map associated with each frame of the input 2D video is optimized by minimizing the target function over all subbands. In the end, stereoscopic frames are rendered from the color frames and their associated depth maps. We evaluated the quality of the generated 3D videos using both subjective and objective quality assessment methods. The experimental results obtained on various sequences show that the presented method outperforms several state-of-the-art 2D-to-3D conversion methods.

Spatio-temporal Adaptive 2D to 3D Video Conversion for 3DTV

An automatic 2D to 3D conversion algorithm using multi-depth cues

A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

Stereoscopic video conversion based on depth tracking

A Novel Method For Automatic 2d-To-3d Video Conversion

A Simple Semi-Automatic Technique For 2d To 3d Video Conversion

2D to 3D conversion with motion-type adaptive depth estimation

2 D to 3 D Conversion in 3 DTV Using Depth Map Generation and Vir Tual View Synthesis

A novel method for 2D-to-3D video conversion using bi-directional motion estimation

Motion-Based Depth Estimation for 2D to 3D Video Conversion.

A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps

2D-to-3D conversion based on depth-from-motion

A novel 2D-to-3D conversion method based on blocks world

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

A Novel Method For Semi-Automatic 2d To 3d Video Conversion

2d-To-3d Conversion Based On Motion And Color Mergence

Semi-Automatic 2D-to-3D Conversion Using Disparity Propagation

Real-time Stereo to Multi-View Conversion System Based on Adaptive Meshing

A novel method for semi-automatic 2D to3D video conversion

Toward Naturalistic 2D-to-3d Conversion

Automatic 2D-To-3D video conversion technique based on depth-from-motion and color segmentation