Abstract:Due to the visual properties of reflection and refraction, RGB-D cameras cannot accurately capture the depth of transparent objects, leading to incomplete depth maps. To fill in the missing points, recent studies tend to explore new visual features and design complex networks to reconstruct the depth, however, these approaches tremendously increase computation, and the correlation of different visual features remains a problem. To this end, we propose an efficient depth completion network named DistillGrasp which distillates knowledge from the teacher branch to the student branch. Specifically, in the teacher branch, we design a position correlation block (PCB) that leverages RGB images as the query and key to search for the corresponding values, guiding the model to establish correct correspondence between two features and transfer it to the transparent areas. For the student branch, we propose a consistent feature correlation module (CFCM) that retains the reliable regions of RGB images and depth maps respectively according to the consistency and adopts a CNN to capture the pairwise relationship for depth completion. To avoid the student branch only learning regional features from the teacher branch, we devise a distillation loss that not only considers the distance loss but also the object structure and edge information. Extensive experiments conducted on the ClearGrasp dataset manifest that our teacher network outperforms state-of-the-art methods in terms of accuracy and generalization, and the student network achieves competitive results with a higher speed of 48 FPS. In addition, the significant improvement in a real-world robotic grasping system illustrates the effectiveness and robustness of our proposed system.

Multi-Scale Distillation for Low Scanline Resolution Depth Completion

Self-Paced Knowledge Distillation for Real-Time Image Guided Depth Completion

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Least Square Estimation Network for Depth Completion

DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion

Self-supervised Sparse-to-Dense: Self-supervised Depth Completion from LiDAR and Monocular Camera

Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints

Lightweight Depth Completion Network with Local Similarity-Preserving Knowledge Distillation

FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth Completion

Depth Completion via Inductive Fusion of Planar LIDAR and Monocular Camera

Real-time depth completion based on LiDAR-stereo for autonomous driving

MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillation

Focal Distillation from High-Resolution Data to Low-Resolution Data for 3D Object Detection

ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation

Depth Completion Towards Different Sensor Configurations Via Relative Depth Map Estimation and Scale Recovery

Multiscale Adaptation Fusion Networks for Depth Completion

DLFusion: Painting-Depth Augmenting-LiDAR for Multimodal Fusion 3D Object Detection

DistillGrasp: Integrating Features Correlation with Knowledge Distillation for Depth Completion of Transparent Objects

Learning Guided Convolutional Network for Depth Completion

FastCompletion: A Cascade Network with Multiscale Group-Fused Inputs for Real-Time Depth Completion.