Abstract:Perceiving the three-dimensional (3D) structure of the spacecraft is a prerequisite for successfully executing many on-orbit space missions, and it can provide critical input for many downstream vision algorithms. In this paper, we propose to sense the 3D structure of spacecraft using light detection and ranging sensor (LIDAR) and a monocular camera. To this end, Spacecraft Depth Completion Network (SDCNet) is proposed to recover the dense depth map based on gray image and sparse depth map. Specifically, SDCNet decomposes the object-level spacecraft depth completion task into foreground segmentation subtask and foreground depth completion subtask, which segments the spacecraft region first and then performs depth completion on the segmented foreground area. In this way, the background interference to foreground spacecraft depth completion is effectively avoided. Moreover, an attention-based feature fusion module is also proposed to aggregate the complementary information between different inputs, which deduces the correlation between different features along the channel and the spatial dimension sequentially. Besides, four metrics are also proposed to evaluate object-level depth completion performance, which can more intuitively reflect the quality of spacecraft depth completion results. Finally, a large-scale satellite depth completion dataset is constructed for training and testing spacecraft depth completion algorithms. Empirical experiments on the dataset demonstrate the effectiveness of the proposed SDCNet, which achieves 0.25m mean absolute error of interest and 0.759m mean absolute truncation error, surpassing state-of-the-art methods by a large margin. The spacecraft pose estimation experiment is also conducted based on the depth completion results, and the experimental results indicate that the predicted dense depth map could meet the needs of downstream vision tasks.

SDC: Spatial Depth Completion for Outdoor Scenes

Semantic-guided Depth Completion from Monocular Images and 4D Radar Data

Aggregating Feature Point Cloud for Depth Completion

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

SparseDC: Depth Completion from sparse and non-uniform inputs

Self-supervised Multi-frame Depth Completion Based on Local-depth-field Cost Volume

Depth Completion in Autonomous Driving: Adaptive Spatial Feature Fusion and Semi-Quantitative Visualization

S&CNet: A Lightweight Network for Fast and Accurate Depth Completion.

RigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completion

DepthSSC: Depth-Spatial Alignment and Dynamic Voxel Resolution for Monocular 3D Semantic Scene Completion

A Real-Time Semi-Dense Depth-Guided Depth Completion Network

Depth Completion Towards Different Sensor Configurations Via Relative Depth Map Estimation and Scale Recovery

S&CNet: A Enhanced Coarse-to-fine Framework For Monocular Depth Completion

DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion

Deep Sparse Depth Completion Using Multi-Scale Residuals and Channel Shuffle

Spacecraft depth completion based on the gray image and the sparse depth map

A Two-stage Hybrid CNN-Transformer Network for RGB Guided Indoor Depth Completion.

Depth Coefficients for Depth Completion

Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints

SDformer: Efficient End-to-End Transformer for Depth Completion

Self‐supervised Depth Completion with Multi‐view Geometric Constraints