Abstract:Depth completion is a crucial task in autonomous driving, aiming to convert a sparse depth map into a dense depth prediction. The sparse depth map serves as a partial reference for the actual depth, and the fusion of RGB images is frequently employed to augment the completion process owing to its inherent richness in semantic information. Image-guided depth completion confronts three principal challenges: (1) the effective fusion of the two modalities; (2) the enhancement of depth information recovery; and (3) the realization of real-time predictive capabilities requisite for practical autonomous driving scenarios. In response to these challenges, we propose a concise but high-performing network, named CHNet, to achieve high-performance depth completion with an elegant and straightforward architecture. Firstly, we use a fast guidance module to fuse the two sensor features, harnessing abundant auxiliary information derived from the color space. Unlike the prevalent complex guidance modules, our approach adopts an intuitive and cost-effective strategy. In addition, we find and analyze the optimization inconsistency problem for observed and unobserved positions. To mitigate this challenge, we introduce a decoupled depth prediction head, tailored to better discern and predict depth values for both valid and invalid positions, incurring minimal additional inference time. Capitalizing on the dual-encoder and single-decoder architecture, the simplicity of CHNet facilitates an optimal balance between accuracy and computational efficiency. In benchmark evaluations on the KITTI depth completion dataset, CHNet demonstrates competitive performance metrics and inference speeds relative to contemporary state-of-the-art methodologies. To assess the generalizability of our approach, we extend our evaluations to the indoor NYUv2 dataset, where CHNet continues to yield impressive outcomes. The code of this work will be available at https://github.com/lmomoy/CHNet .

SEHLNet: Separate Estimation of High- and Low-Frequency components for Depth Completion

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

Least Square Estimation Network for Depth Completion

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Gated Recurrent Fusion UNet for Depth Completion

RigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completion

FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth Completion

Depth Completion Using Laplacian Pyramid-Based Depth Residuals.

AF2R Net: Adaptive Feature Fusion and Robust Network for Efficient and Precise Depth Completion

S&CNet: A Enhanced Coarse-to-fine Framework For Monocular Depth Completion

An Adaptive Fusion Algorithm for Depth Completion

Gated Cross-Attention Network for Depth Completion

CU-Net: LiDAR Depth-Only Completion With Coupled U-Net

S&CNet: A Lightweight Network for Fast and Accurate Depth Completion.

A concise but high-performing network for image guided depth completion in autonomous driving

Deep Sparse Depth Completion Using Multi-Affinity Matrix

MSFNet:Multi-scale features network for monocular depth estimation

Decoupled and Reparameterized Compound Attention-Based Light Field Depth Estimation Network

Chfnet: a coarse-to-fine hierarchical refinement model for monocular depth estimation

High precision light field image depth estimation via multi‐region attention enhanced network

PENet: Towards Precise and Efficient Image Guided Depth Completion