Abstract:Image-guided depth completion aims at generating a dense depth map from sparse LiDAR data and RGB image. Recent methods have shown promising performance by reformulating it as a classification problem with two sub-tasks: depth discretization and probability prediction. They divide the depth range into several discrete depth values as depth categories, serving as priors for scene depth distributions. However, previous depth discretization methods are easy to be impacted by depth distribution variations across different scenes, resulting in suboptimal scene depth distribution priors. To address the above problem, we propose a progressive depth decoupling and modulating network, which incrementally decouples the depth range into bins and adaptively generates multi-scale dense depth maps in multiple stages. Specifically, we first design a Bins Initializing Module (BIM) to construct the seed bins by exploring the depth distribution information within a sparse depth map, adapting variations of depth distribution. Then, we devise an incremental depth decoupling branch to progressively refine the depth distribution information from global to local. Meanwhile, an adaptive depth modulating branch is developed to progressively improve the probability representation from coarse-grained to fine-grained. And the bi-directional information interactions are proposed to strengthen the information interaction between those two branches (sub-tasks) for promoting information complementation in each branch. Further, we introduce a multi-scale supervision mechanism to learn the depth distribution information in latent features and enhance the adaptation capability across different scenes. Experimental results on public datasets demonstrate that our method outperforms the state-of-the-art methods. The code will be open-sourced at [this https URL](

MetaComp: Learning to Adapt for Online Depth Completion

MetaComp: Learning to Adapt for Online Depth Completion

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

Online Adaptation Through Meta-Learning for Stereo Depth Estimation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Online Mutual Adaptation of Deep Depth Prediction and Visual SLAM

LiDAR Meta Depth Completion

Test-Time Adaptation for Depth Completion

Meta-Adapter: An Online Few-shot Learner for Vision-Language Model

Learn to Adapt for Self-Supervised Monocular Depth Estimation

Online Depth Learning against Forgetting in Monocular Videos

Self-Supervised Deep Visual Odometry with Online Adaptation

Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learning

Learn to Adapt for Monocular Depth Estimation

Online Visual SLAM Adaptation Against Catastrophic Forgetting with Cycle-Consistent Contrastive Learning.

MECOM: A Meta-Completion Network for Fine-Grained Recognition With Incomplete Multi-Modalities

Adaptive Context-Aware Multi-Modal Network for Depth Completion

Adaptive Compositional Continual Meta-Learning.

Meta-Auxiliary Learning for Future Depth Prediction in Videos

Progressive Depth Decoupling and Modulating for Flexible Depth Completion

Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning