Abstract:Depth images play an important role and are prevalently used in many computer vision and computational imaging tasks. However, due to the limitation of active sensing technology, the captured depth images in practice usually suffer from low resolution and noise, which prevents its further applications. To remedy this problem, in this paper, we first propose an adaptive data fidelity formulation to optimally generate each depth pixel from a mixture probability distribution, characterizing the similarity both in the depth map and the corresponding high-resolution guided color image. The proposed method is able to fit the distribution of the input depth signal as an optimization problem by maximizing the mixture probability. Furthermore, to promote the piecewise property that depth images exhibit, we propose a transferred graph Laplacian model as a regularization term, which is general and able to handle various depth recovery tasks such as super-resolution and denoising well. Specifically, each pixel within the recovered depth image is represented as a vertex in a graph with weights in connected edges representing the similarity between vertices. By minimizing the squared variations of the image signal, the task of depth image recovery can be converted to the problem of graph-based image filtering. Since the proposed graph Laplacian regularization model is able to fully exploit a priori information about the depth image, a much more accurate and robust estimation of the underlying depth can be obtained. Extensive experiment evaluations verify that the proposed method obtains recovered depth with higher quality in terms of both objective and subjective criteria, compared with most of the state-of-the-art methods.

Image processing method for recovering depth information

Depth Map Inpainting Using a Fully Convolutional Network

Guided depth enhancement via a fast marching method

A Comparative Study on Guided Depth Enhancement

Reliable Fusion of ToF and Stereo Data Based on Joint Depth Filter

Depth map enhancement based on color and depth consistency

Theory and implementation of depth photography

Depth recovery from a single defocused image based on depth locally consistency

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Iterative Error Removal for Time-of-Flight Depth Imaging

Color-Guided Depth Image Recovery with Adaptive Data Fidelity and Transferred Graph Laplacian Regularization

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

Real-time Depth Extraction and Multi-View Rendering Algorithm Based on Kinect

High Quality Depth Map Estimation Method Based on Graph Cut

Reconstructing Sparsely Represented High-resolution Depth Map from Corrupted Samples

Recovering depth from a single image using spectral energy of the defocused step edge gradient

Depth Extraction Method Based on Multi-view Stereo Matching

Depth Measurement by Co-Axial Stereo Vision

Depth estimation from a single defocused image using multi-scale kernels

Effective Improvement for Depth Estimated Based on Defocus Images