Abstract:Compared to 2-D inverse synthetic aperture radar (ISAR) images of a space target, its 3-D model can provide adequate details and accurate measurement parameters. However, it is challenging to tackle the problem of feature extraction and correlation during 3-D reconstruction of space targets purely based on radar image sequences, due to their lack of clear evidence in imaging similarity compared to optical images. To address this problem, this article proposes radar neural radiance fields (i.e., RaNeRF), which is a novel 3-D reconstruction method using only observed ISAR image sequences. First, the 3-D structure of a target is represented as a continuous 6-D function of space positions and viewing directions using a fully connected deep network. Second, the relationship between the 3-D structure and 2-D ISAR images of the target is constructed to enable differential rendering of ISAR images. Our overall pipeline can thus be trained using the discrepancy between the modulus of rendered and observed ISAR images in a purely self-supervised manner without 3-D supervision. Finally, the 3-D mesh model of the target can be retrieved from the learned density field via marching cube (MC). As a result, the proposed RaNeRF can directly reconstruct the 3-D structure of targets without explicit feature extraction and correlation of ISAR image sequences. Both quantitative and qualitative results verify the effectiveness of the proposed method. Compared to conventional baseline methods using point clouds, our reconstructed structure is more complete and accurate. In addition, the optimized model can synthesize ISAR images at novel observation direction, which can be used for downstream tasks, including data augmentation and target recognition.

3D Reconstruction Method of Space Target on Optical Images with Wide Baseline via Neural Radiance Field

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Neural Field-Based Space Target 3D Reconstruction with Predicted Depth Priors

RaNeRF: Neural 3-D Reconstruction of Space Targets From ISAR Image Sequences

Neural 3D Reconstruction in the Wild

ISAR-NeRF: Neural Radiance Fields for 3D Imaging of Space Target from Multi-view ISAR Images

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

3D Reconstruction of Ancient Buildings Using UAV Images and Neural Radiation Field with Depth Supervision

Unmanned Aerial Vehicle-Neural Radiance Field (UAV-NeRF): Learning Multiview Drone Three-Dimensional Reconstruction with Neural Radiance Field

OmniNeRF: Hybriding Omnidirectional Distance and Radiance fields for Neural Surface Reconstruction

Neural 3D Scene Reconstruction from Multiple 2D Images without 3D Supervision

Three-Dimensional Geometry Reconstruction Method from Multi-View ISAR Images Utilizing Deep Learning

Three-dimensional Reconstruction of Space Targets from Multi-view ISAR Images Using Differentiable Voxel Reconstruction Network

3D Reconstruction of Non-cooperative Resident Space Objects using Instant NGP-accelerated NeRF and D-NeRF

Photogrammetry for Unconstrained Optical Satellite Imagery with Combined Neural Radiance Fields

A Research on 3-D Point Clouds Reconstruction of SAR Images Driven by Electromagnetic Scattering Mechanisms

SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields

Urban Radiance Fields

Research on 3D Visualization of Drone Scenes Based on Neural Radiance Fields

3D Reconstruction From Traditional Methods to Deep Learning

3D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Field