Abstract:Natural scene statistics (NSSs) models have been developed that make it possible to impose useful perceptually relevant priors on the luminance, colors, and depth maps of natural scenes. We show that these models can be used to develop 3D content creation algorithms that can convert monocular 2D videos into statistically natural 3D-viewable videos. First, accurate depth information on key frames is obtained via human annotation. Then, both forward and backward motion vectors are estimated and compared to decide the initial depth values, and a compensation process is applied to further improve the depth initialization. Then, the luminance/chrominance and initial depth map are decomposed by a Gabor filter bank. Each subband of depth is modeled to produce a NSS prior term. The statistical color-depth priors are combined with the spatial smoothness constraint in the depth propagation target function as a prior regularizing term. The final depth map associated with each frame of the input 2D video is optimized by minimizing the target function over all subbands. In the end, stereoscopic frames are rendered from the color frames and their associated depth maps. We evaluated the quality of the generated 3D videos using both subjective and objective quality assessment methods. The experimental results obtained on various sequences show that the presented method outperforms several state-of-the-art 2D-to-3D conversion methods.

A Real-Time Time-Consistent 2D-to-3d Video Conversion System Using Color Histogram

Real-time Time-Consistent 2D-to-3d Video Conversion Based on Color Histogram

An automatic 2D to 3D conversion algorithm using multi-depth cues

A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

A novel 2D-to-3D conversion method based on blocks world

Stereoscopic video conversion based on depth tracking

2D/3D Video Conversion Method Based on Foreground Temporal-Spatial Analyzing and Background Understanding

Automatic 2D-To-3D video conversion technique based on depth-from-motion and color segmentation

An Automatic Depth Map Generation for 2D-to-3d Conversion

2d-To-3d Conversion Based On Motion And Color Mergence

Motion-Based Depth Estimation for 2D to 3D Video Conversion.

Automatic 2D-to-3d Image Conversion Based on Depth Map Estimation

Semi-Automatic 2D-to-3D Conversion Using Disparity Propagation

Real-time high resolution 2D-plus-depth video generation using time-of-flight sensor

Toward Naturalistic 2D-to-3d Conversion

A 2D to 3D Conversion Method Based on Support Vector Machine and Image Classification

A New Approach of 2D-to-3d Video Conversion and Its Implementation on Embedded System

A Novel Method For Automatic 2d-To-3d Video Conversion

Low Complexity Depth Coding Assisted by Coding Information From Color Video