Abstract:Depth image-based rendering (DIBR) has recently received significant attention as an efficient concept for generating virtual views. One of the main challenges in the view synthesis process is that holes will appear in the background (BG) of the virtual views because of occlusion. The existing methods either utilize spatial or temporal information from the original views and depth maps to fill the holes. However, the performance of the existing methods is seriously affected by the quality of the depth maps. Foreground (FG) texture will be wrongly introduced to the BG when the depth maps are not accurate enough. We develop a hole-filling approach for DIBR based on convolutional neural network, which shows reduced dependency on the quality of the depth map. More specifically, FG objects are detected on the RGB image by combining the Laplacian operator with a graph cut algorithm to avoid dependencies on the depth map quality. Furthermore, we learn an end-to-end mapping between the warped virtual view and the ground-truth view image with FG awareness. The learning-based approach exhibits excellent superiority in terms of saving time. The experimental results also show that the proposed approach outperforms current state-of-the-art techniques quantitatively and qualitatively. (C) 2020 SPIE and IS&T

A Novel DIBR Method Based on Image Inpainting

A New Method of DIBR Based on Background Inpainting

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

A novel virtual view rendering approach based on DIBR

A Novel Filling Disocclusion Method Based on Background Extraction in Depth-Image-Based-Rendering

Arbitrary view generation based on DIBR

Arbitrary View Generation Based on DIBR and Depth-Aided Image Inpainting

Depth-image-based Rendering with Spatial and Temporal Texture Synthesis for 3DTV

A New Multidirectional Extrapolation Hole-Filling Method For Depth-Image-Based Rendering

A Novel Image Inpainting Method Based on Sparse Decomposition

A New Disocclusion Filling Approach in Depth Image Based Rendering for Stereoscopic Imaging

A Novel Hole Filling Method Based on Projection Onto Convex Set in DIBR

Hole-filling based on disparity map for DIBR.

A NEW DEPTH-AIDED MULTIDIRECTIONAL DISOCCLUSION RESTORATION METHOD FOR DEPTH-IMAGE-BASED RENDERING

A Novel Method of Multi-view Virtual Image Synthesis for Auto-stereoscopic Display

Hole-Filling for DIBR Based on Depth and Gradient Information

Hole-filling Approach Based on Convolutional Neural Network for Depth Image-Based Rendering View Synthesis.

Improvement of Virtual View Rendering Based on Depth Image.

A Divide-and-conquer Hole-Filling Method for Handling Disocclusion in Single-View Rendering

Virtual View Image Rendering with High Quality

Innovative Hole Filling Method for Depth-Image-based-rendering (DIBR) Based on Context Learning