Abstract:Compared to 2-D inverse synthetic aperture radar (ISAR) images of a space target, its 3-D model can provide adequate details and accurate measurement parameters. However, it is challenging to tackle the problem of feature extraction and correlation during 3-D reconstruction of space targets purely based on radar image sequences, due to their lack of clear evidence in imaging similarity compared to optical images. To address this problem, this article proposes radar neural radiance fields (i.e., RaNeRF), which is a novel 3-D reconstruction method using only observed ISAR image sequences. First, the 3-D structure of a target is represented as a continuous 6-D function of space positions and viewing directions using a fully connected deep network. Second, the relationship between the 3-D structure and 2-D ISAR images of the target is constructed to enable differential rendering of ISAR images. Our overall pipeline can thus be trained using the discrepancy between the modulus of rendered and observed ISAR images in a purely self-supervised manner without 3-D supervision. Finally, the 3-D mesh model of the target can be retrieved from the learned density field via marching cube (MC). As a result, the proposed RaNeRF can directly reconstruct the 3-D structure of targets without explicit feature extraction and correlation of ISAR image sequences. Both quantitative and qualitative results verify the effectiveness of the proposed method. Compared to conventional baseline methods using point clouds, our reconstructed structure is more complete and accurate. In addition, the optimized model can synthesize ISAR images at novel observation direction, which can be used for downstream tasks, including data augmentation and target recognition.

Lightweight Pixel2mesh for 3D Target Reconstruction from a Single SAR Image

Single Target SAR 3D Reconstruction Based on Deep Learning

Semantic Reconstruction based on RGB Image and Sparse Depth

3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-Lmnet from Single Image

Three-dimensional Reconstruction of Space Targets from Multi-view ISAR Images Using Differentiable Voxel Reconstruction Network

Recognition of 3D Target ISAR Images Based on Lightweight Network

Recognition of Deformation Military Targets in the Complex Scenes via MiniSAR Submeter Images with FASAR-Net

HRLE-SARDet: A Lightweight SAR Target Detection Algorithm Based on Hybrid Representation Learning Enhancement

SAR Nonsparse Scene Reconstruction Network via Image Feature Representation Learning

RaNeRF: Neural 3-D Reconstruction of Space Targets From ISAR Image Sequences

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

Hybrid Mesh-neural Representation for 3D Transparent Object Reconstruction

A Research on 3-D Point Clouds Reconstruction of SAR Images Driven by Electromagnetic Scattering Mechanisms

SAR ATR under Limited Training Data Via MobileNetV3

Fast Super-resolution 3D SAR Imaging Using an Unfolded Deep Network

Multi-view Pixel2Mesh++: 3D reconstruction via Pixel2Mesh with more images

SAR Image Generation by Integrating Differentiable SAR Renderer with Neural Networks

PnP-MFAMP-Net: A Novel Plug-and-Play Sparse Reconstruction Network for SAR Imaging

A deep deformable residual learning network for SAR images segmentation

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

A lightweight deep convolutional network with inverted residuals for matching optical and SAR images