Abstract:Image-guided depth completion aims at generating a dense depth map from sparse LiDAR data and RGB image. Recent methods have shown promising performance by reformulating it as a classification problem with two sub-tasks: depth discretization and probability prediction. They divide the depth range into several discrete depth values as depth categories, serving as priors for scene depth distributions. However, previous depth discretization methods are easy to be impacted by depth distribution variations across different scenes, resulting in suboptimal scene depth distribution priors. To address the above problem, we propose a progressive depth decoupling and modulating network, which incrementally decouples the depth range into bins and adaptively generates multi-scale dense depth maps in multiple stages. Specifically, we first design a Bins Initializing Module (BIM) to construct the seed bins by exploring the depth distribution information within a sparse depth map, adapting variations of depth distribution. Then, we devise an incremental depth decoupling branch to progressively refine the depth distribution information from global to local. Meanwhile, an adaptive depth modulating branch is developed to progressively improve the probability representation from coarse-grained to fine-grained. And the bi-directional information interactions are proposed to strengthen the information interaction between those two branches (sub-tasks) for promoting information complementation in each branch. Further, we introduce a multi-scale supervision mechanism to learn the depth distribution information in latent features and enhance the adaptation capability across different scenes. Experimental results on public datasets demonstrate that our method outperforms the state-of-the-art methods. The code will be open-sourced at [this https URL](

Depth Map Upsampling via Progressive Manner Based on Probability Maximization.

Depth map enhancement based on color and depth consistency

Depth Upsampling Method Via Markov Random Fields Without Edge-Misaligned Artifacts

Depth Map Inpainting Using a Fully Convolutional Network

A Comparative Study on Guided Depth Enhancement

Guided depth enhancement via a fast marching method

Reconstructing Sparsely Represented High-resolution Depth Map from Corrupted Samples

Robust High Quality Image Guided Depth Upsampling

Joint Depth Map Upsampling Via Prior Minimum Spanning Tree

Temporal Upsampling of Depth Maps Using a Hybrid Camera

Progressive Depth Decoupling and Modulating for Flexible Depth Completion

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Depth Map Super-Resolution Via Local and Nonlocal Priors

Depth super resolution using bilateral filter

Depth Map Generation for 2D-to-3d Conversion by Limited User Inputs and Depth Propagation

High Quality Depth Map Estimation Method Based on Graph Cut

Depth Map Super-resolution Based on Dual Normal-depth Regularization and Graph Laplacian Prior

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

Depth Map Completion by Jointly Exploiting Blurry Color Images and Sparse Depth Maps

Depth Super-Resolution Using Joint Adaptive Weighted Least Squares and Patching Gradient.