Abstract:Compared to 2-D inverse synthetic aperture radar (ISAR) images of a space target, its 3-D model can provide adequate details and accurate measurement parameters. However, it is challenging to tackle the problem of feature extraction and correlation during 3-D reconstruction of space targets purely based on radar image sequences, due to their lack of clear evidence in imaging similarity compared to optical images. To address this problem, this article proposes radar neural radiance fields (i.e., RaNeRF), which is a novel 3-D reconstruction method using only observed ISAR image sequences. First, the 3-D structure of a target is represented as a continuous 6-D function of space positions and viewing directions using a fully connected deep network. Second, the relationship between the 3-D structure and 2-D ISAR images of the target is constructed to enable differential rendering of ISAR images. Our overall pipeline can thus be trained using the discrepancy between the modulus of rendered and observed ISAR images in a purely self-supervised manner without 3-D supervision. Finally, the 3-D mesh model of the target can be retrieved from the learned density field via marching cube (MC). As a result, the proposed RaNeRF can directly reconstruct the 3-D structure of targets without explicit feature extraction and correlation of ISAR image sequences. Both quantitative and qualitative results verify the effectiveness of the proposed method. Compared to conventional baseline methods using point clouds, our reconstructed structure is more complete and accurate. In addition, the optimized model can synthesize ISAR images at novel observation direction, which can be used for downstream tasks, including data augmentation and target recognition.

Three-dimensional Reconstruction of Space Targets from Multi-view ISAR Images Using Differentiable Voxel Reconstruction Network

Differentiable Voxel Reconstruction of Satellite Target from Multi-Station ISAR and Optical Image Sequence

ISAR-NeRF: Neural Radiance Fields for 3D Imaging of Space Target from Multi-view ISAR Images

3-D Reconstruction of Space Target Based on Silhouettes Fused ISAR–Optical Images

Three-Dimensional Geometry Reconstruction Method from Multi-View ISAR Images Utilizing Deep Learning

Three-Dimensional Reconstruction From a Multiview Sequence of Sparse ISAR Imaging of a Space Target

RaNeRF: Neural 3-D Reconstruction of Space Targets From ISAR Image Sequences

SAR Image Generation by Integrating Differentiable SAR Renderer with Neural Networks

Space Target 3-D Reconstruction Using Votes Accumulation Method of ISAR Image Sequence

Profiling the malaria genome: a gene survey of three species of malaria parasite with comparison to other apicomplexan species.

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

Extension of Differentiable SAR Renderer for Ground Target Reconstruction from Multiview Images and Shadows

3D-Isrnet

Differentiable SAR Renderer and SAR Target Reconstruction

Differentiable SAR Renderer and Image-Based Target Reconstruction

Highly Applicable Iterative Network for 3-D Reconstruction Based on Multiview Satellite Images

3D Reconstruction Method of Space Target on Optical Images with Wide Baseline via Neural Radiance Field

A Research on 3-D Point Clouds Reconstruction of SAR Images Driven by Electromagnetic Scattering Mechanisms

Reconstruct 3D Geometry of Target Using Differentiable SAR Renderer

Recovering Geometric Parameters from SAR Images Using Differentiable Ray Tracing

Lightweight Pixel2mesh for 3D Target Reconstruction from a Single SAR Image