Abstract:Perceiving the three-dimensional (3D) structure of the spacecraft is a prerequisite for successfully executing many on-orbit space missions, and it can provide critical input for many downstream vision algorithms. In this paper, we propose to sense the 3D structure of spacecraft using light detection and ranging sensor (LIDAR) and a monocular camera. To this end, Spacecraft Depth Completion Network (SDCNet) is proposed to recover the dense depth map based on gray image and sparse depth map. Specifically, SDCNet decomposes the object-level spacecraft depth completion task into foreground segmentation subtask and foreground depth completion subtask, which segments the spacecraft region first and then performs depth completion on the segmented foreground area. In this way, the background interference to foreground spacecraft depth completion is effectively avoided. Moreover, an attention-based feature fusion module is also proposed to aggregate the complementary information between different inputs, which deduces the correlation between different features along the channel and the spatial dimension sequentially. Besides, four metrics are also proposed to evaluate object-level depth completion performance, which can more intuitively reflect the quality of spacecraft depth completion results. Finally, a large-scale satellite depth completion dataset is constructed for training and testing spacecraft depth completion algorithms. Empirical experiments on the dataset demonstrate the effectiveness of the proposed SDCNet, which achieves 0.25m mean absolute error of interest and 0.759m mean absolute truncation error, surpassing state-of-the-art methods by a large margin. The spacecraft pose estimation experiment is also conducted based on the depth completion results, and the experimental results indicate that the predicted dense depth map could meet the needs of downstream vision tasks.

Exploiting Temporal–Spatial Feature Correlations for Sequential Spacecraft Depth Completion

Spacecraft depth completion based on the gray image and the sparse depth map

Least Square Estimation Network for Depth Completion

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Semantic-guided Depth Completion from Monocular Images and 4D Radar Data

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

Up-to-Down Network: Fusing Multi-Scale Context for 3D Semantic Scene Completion

LODM: Large-scale Online Dense Mapping for UAV

Spatio-Temporal Depth Recovery of Dynamic Scenes with Multiple Handheld Cameras

Spatio-Temporal 3-D Residual Networks for Simultaneous Detection and Depth Estimation of CFRP Subsurface Defects in Lock-In Thermography

RSDCN: A Road Semantic Guided Sparse Depth Completion Network

Self-Supervised Depth Completion Guided by 3D Perception and Geometry Consistency

DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion

SLCF-Net: Sequential LiDAR-Camera Fusion for Semantic Scene Completion using a 3D Recurrent U-Net

Temporally Consistent Depth Map Prediction Using Deep Convolutional Neural Network and Spatial-Temporal Conditional Random Field

DepthSSC: Depth-Spatial Alignment and Dynamic Voxel Resolution for Monocular 3D Semantic Scene Completion

DenseLiDAR: A Real-Time Pseudo Dense Depth Guided Depth Completion Network

SGSNet: A Lightweight Depth Completion Network Based on Secondary Guidance and Spatial Fusion

Accurate Depth Recovery Method Based on the Fusion of Time-of-Flight and Dot-Coded Structured Light

Robust single-photon 3D imaging based on full-scale feature integration and intensity edge guidance

Depth Completion Towards Different Sensor Configurations Via Relative Depth Map Estimation and Scale Recovery