Abstract:As space technology advances, an increasing number of spacecrafts are being launched into space, making it essential to monitor and maintain satellites to ensure safe and stable operations. Acquiring 3D information of space targets enables the accurate assessment of their shape, size, and surface damage, providing critical support for on-orbit service activities. Existing 3D reconstruction techniques for space targets, which mainly rely on laser point cloud measurements or image sequences, cannot adapt to scenarios with limited observation data and viewpoints. We propose a novel method to achieve a high-quality 3D reconstruction of space targets. The proposed approach begins with a preliminary 3D reconstruction using the neural radiance field (NeRF) model, guided by observed optical images of the space target and depth priors extracted from a customized monocular depth estimation network (MDE). A NeRF is then employed to synthesize optical images from unobserved viewpoints. The corresponding depth information for these viewpoints, derived from the same depth estimation network, is integrated as a supervisory signal to iteratively refine the 3D reconstruction. By exploiting MDE and the NeRF, the proposed scheme iteratively optimizes the 3D reconstruction of spatial objects from seen viewpoints to unseen viewpoints. To minimize excessive noise from unseen viewpoints, we also incorporate a confident modeling mechanism with relative depth ranking loss functions. Experimental results demonstrate that the proposed method achieves superior 3D reconstruction quality under sparse input, outperforming traditional NeRF and DS-NeRF models in terms of perceptual quality and geometric accuracy.

A conditional random field model for 3D reconstruction in image sequences

CRF-Based Reconstruction from Narrow-Baseline Image Sequences.

3-D Map Reconstruction in Cross-country Environment

Adaptive Video Segmentation Algorithm Using Hidden Conditional Random Fields

Autonomous Flights in Dynamic Environments with Onboard Vision

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

Obstacle Detection Based on Single View Vision

Efficient 3D Reconstruction Using Monocular Vision

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Urban Scene Segmentation with Laser-Constrained CRFs

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Robust 3D Reconstruction with an RGB-D Camera

Obstacle detection for aircraft based on layered model

CRF-based depth refinement with hybrid depth information

Visual Odometry Based 3D-Reconstruction

Semantic Conditional Random Field for Object Based SAR Image Segmentation.

Snow Removal for LiDAR Point Clouds With Spatio-Temporal Conditional Random Fields

3D Reconstruction of Outdoor Scenes from Synchronized Laser Range Data and Visual Image Data

Scene description based on the conditional random fields model

Neural Field-Based Space Target 3D Reconstruction with Predicted Depth Priors

Real-time Indoor Scene Reconstruction with RGBD and Inertial Input.