Abstract:Reconstructing a full-resolution stereoscopic video from an asymmetric stereoscopic video is a challenging task. The existing approaches require depth information, which imposes an additional challenge in data acquisition. In this paper, we propose a novel scheme that is capable of obtaining super-resolution and depth estimation simultaneously from an asymmetric stereoscopic video. The proposed scheme models the video super-resolution and stereo matching with a unified energy function. Then, we apply an alternating optimization method to minimize this energy function, which can be implemented with a two-step algorithm. In the first step we calculate the initial depth map by using a region-based cooperative optimization technique while considering the temporal consistency in video. In the second step we resolve the super-resolution problem under the guidance of the depth information. It is effective because each step benefits from the additional improvement over the previous step. We iteratively update the two steps until stable depth and super-resolution results are obtained. We have conducted a series of experiments on public stereoscopic video sequences to evaluate the performance of the proposed method. Both objective indexes and subjective visual comparisons verify that the proposed scheme can achieve satisfactory super-resolution results and high-quality depth map simultaneously. In particular, the subjective evaluation experiments on a 3-D monitor show that this scheme outperforms others and achieves the best visual sharpness.

Stereoscopic Image Completion and Depth Recovery.

StereoPasting: interactive composition in stereoscopic images.

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Consistent depth maps recovery from a video sequence.

Consistent Depth Maps Recovery from a Trinocular Video Sequence.

Dense Depth Recovery Based on Adaptive Image Segmentation

Stereoscopic video conversion based on depth tracking

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

Automatic and accurate image completion from a large displacement view

A Temporally Streamlined Optimization Method for Stereo Video Correspondence

Recovering Consistent Video Depth Maps Via Bundle Optimization

3d Stereoscopic Image Generation From Monocular View In Structured Environments

Depth Extraction Method Based on Multi-view Stereo Matching

Spatio-Temporal Depth Recovery of Dynamic Scenes with Multiple Handheld Cameras

High-Quality Depth Recovery via Interactive MultiView Stereo Supplementary Document

A Unified Scheme for Super-Resolution and Depth Estimation from Asymmetric Stereoscopic Video

Patchmatch Stereo++: Patchmatch Binocular Stereo with Continuous Disparity Optimization

Global Depth Refinement Based on Patches

Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Stereo Matching by Incorporating Depth Cues