Abstract:Reconstructing a full-resolution stereoscopic video from an asymmetric stereoscopic video is a challenging task. The existing approaches require depth information, which imposes an additional challenge in data acquisition. In this paper, we propose a novel scheme that is capable of obtaining super-resolution and depth estimation simultaneously from an asymmetric stereoscopic video. The proposed scheme models the video super-resolution and stereo matching with a unified energy function. Then, we apply an alternating optimization method to minimize this energy function, which can be implemented with a two-step algorithm. In the first step we calculate the initial depth map by using a region-based cooperative optimization technique while considering the temporal consistency in video. In the second step we resolve the super-resolution problem under the guidance of the depth information. It is effective because each step benefits from the additional improvement over the previous step. We iteratively update the two steps until stable depth and super-resolution results are obtained. We have conducted a series of experiments on public stereoscopic video sequences to evaluate the performance of the proposed method. Both objective indexes and subjective visual comparisons verify that the proposed scheme can achieve satisfactory super-resolution results and high-quality depth map simultaneously. In particular, the subjective evaluation experiments on a 3-D monitor show that this scheme outperforms others and achieves the best visual sharpness.

Image-guided Depth Propagation for 2-D-to-3-d Video Conversion Using Superpixel Matching and Adaptive Autoregressive Model.

An automatic 2D to 3D conversion algorithm using multi-depth cues

Depth Image Super-resolution via Two-Branch Network

A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

Stereoscopic video conversion based on depth tracking

Efficient intra coding algorithm for depth map in 3D video

A Novel Depth Propagation Algorithm with Color Guided Motion Estimation

A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps

Towards naturalistic depth propagation

Depth Map Generation for 2D-to-3d Conversion by Limited User Inputs and Depth Propagation

A novel method for 2D-to-3D video conversion using bi-directional motion estimation

A Temporally Streamlined Optimization Method for Stereo Video Correspondence

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

Deinterlacing of Depth-Image-based Three-Dimensional Video for a Depth-Image-based Rendering System.

A novel 2D-to-3D conversion method based on blocks world

A Unified Scheme for Super-Resolution and Depth Estimation from Asymmetric Stereoscopic Video

Inter Mode Selection for Depth Map Coding in 3D Video.

Semi-Automatic 2D-to-3D Conversion Using Disparity Propagation

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Efficient depth coding in 3D video to minimize coding bitrate and complexity

Guided Depth Map Super-Resolution Using Recumbent Y Network