Abstract:Depth images play an important role and are prevalently used in many computer vision and computational imaging tasks. However, due to the limitation of active sensing technology, the captured depth images in practice usually suffer from low resolution and noise, which prevents its further applications. To remedy this problem, in this paper, we first propose an adaptive data fidelity formulation to optimally generate each depth pixel from a mixture probability distribution, characterizing the similarity both in the depth map and the corresponding high-resolution guided color image. The proposed method is able to fit the distribution of the input depth signal as an optimization problem by maximizing the mixture probability. Furthermore, to promote the piecewise property that depth images exhibit, we propose a transferred graph Laplacian model as a regularization term, which is general and able to handle various depth recovery tasks such as super-resolution and denoising well. Specifically, each pixel within the recovered depth image is represented as a vertex in a graph with weights in connected edges representing the similarity between vertices. By minimizing the squared variations of the image signal, the task of depth image recovery can be converted to the problem of graph-based image filtering. Since the proposed graph Laplacian regularization model is able to fully exploit a priori information about the depth image, a much more accurate and robust estimation of the underlying depth can be obtained. Extensive experiment evaluations verify that the proposed method obtains recovered depth with higher quality in terms of both objective and subjective criteria, compared with most of the state-of-the-art methods.

Color-Guided Depth Recovery Via Joint Local Structural and Nonlocal Low-Rank Regularization

Depth Super-Resolution Via Joint Color-Guided Internal and External Regularizations

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Color-Guided Depth Image Recovery with Adaptive Data Fidelity and Transferred Graph Laplacian Regularization

Depth Map Super-Resolution Via Local and Nonlocal Priors

Depth Restoration from RGB-D Data Via Joint Adaptive Regularization and Thresholding on Manifolds

Depth Super-Resolution Using Joint Adaptive Weighted Least Squares and Patching Gradient.

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Image Guided Depth Enhancement Via Deep Fusion And Local Linear Regularization

Depth Restoration: A fast low-rank matrix completion via dual-graph regularization

Recovering Consistent Video Depth Maps Via Bundle Optimization

Depth Map Super-resolution Based on Dual Normal-depth Regularization and Graph Laplacian Prior

Consistent Depth Maps Recovery from a Trinocular Video Sequence.

Co-occurrent Structural Edge Detection for Color-Guided Depth Map Super-Resolution.

Color and Geometric Contrastive Learning Based Intra-Frame Supervision for Self-Supervised Monocular Depth Estimation

Depth incorporating with color improves salient object detection

Consistent depth maps recovery from a video sequence.

Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depth

Reinforcing Local Structure Perception for Monocular Depth Estimation

DCT Regularized Extreme Visual Recovery

Depth map enhancement based on color and depth consistency