Abstract:With the rapid development of 3D movie and light-field displays, there is a growing demand for stereo videos. However, generating high-quality stereo videos from planar videos remains a challenging task. Traditional depth-image-based rendering techniques struggle to effectively handle the problem of occlusion exposure, which occurs when the occluded contents become visible in other views. Recently, the single-view multiplane images (MPI) representation has shown promising performance for planar video stereoscopy. However, the MPI still lacks real details that are occluded in the current frame, resulting in blurry artifacts in occlusion exposure regions. In fact, planar videos can leverage complementary information from adjacent frames to predict a more complete scene representation for the current frame. Therefore, this paper extends the MPI from still frames to the temporal domain, introducing the temporal MPI (TMPI). By extracting complementary information from adjacent frames based on optical flow guidance, obscured regions in the current frame can be effectively repaired. Additionally, a new module called masked optical flow warping (MOFW) is introduced to improve the propagation of pixels along optical flow trajectories. Experimental results demonstrate that the proposed method can generate high-quality stereoscopic or light-field videos from a single view and reproduce better occluded details than other state-of-the-art (SOTA) methods. https://github.com/Dio3ding/TMPI

Image based stereoscopic rendering with non-mosaic impeller matching.

Design of a single-sensor gazing panoramic stereo imaging system with no central blind area

StereoPasting: interactive composition in stereoscopic images.

Design of Panoramic Stereo Imaging with Single Optical System

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Human-Computer Interaction System Based on Binocular Stereo Vision

Image mosaic based view synthesis for interactive stereoscopic display

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Stereoscopic video conversion based on depth tracking

Intermediate View Synthesis Based on Image Mosaic in Video Conferencing

Asymmetric representation for 3D panoramic video

Stereoscopic Video Synthesis from A Monocular Video

An Accelerated Rendering Algorithm for Stereoscopic Display

Stereoscopic Image Quality Assessment By Cons Ring Binocular Visual Mechanisms

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

An IBR Method: Panoramic Mosaics of Slit Images with Depth

Stereo Image Rectification Algorithm for Multi-View 3D Display

Stereo Vision Conversion from Planar Videos Based on Temporal Multiplane Images

Real-time Stereo to Multi-View Conversion System Based on Adaptive Meshing

Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax.

Lightweight Multiplane Images Network for Real-Time Stereoscopic Conversion from Planar Video