Abstract:The electromagnetic inverse problem has long been a research hotspot. Thisstudy aims to reverse radar view angles in synthetic aperture radar (SAR)images given a target model. Nonetheless, the scarcity of SAR data, combinedwith the intricate background interference and imaging mechanisms, limit theapplications of existing learning-based approaches. To address thesechallenges, we propose an interactive deep reinforcement learning (DRL)framework, where an electromagnetic simulator named differentiable SAR render(DSR) is embedded to facilitate the interaction between the agent and theenvironment, simulating a human-like process of angle prediction. Specifically,DSR generates SAR images at arbitrary view angles in real-time. And thedifferences in sequential and semantic aspects between the viewangle-corresponding images are leveraged to construct the state space in DRL,which effectively suppress the complex background interference, enhance thesensitivity to temporal variations, and improve the capability to capturefine-grained information. Additionally, in order to maintain the stability andconvergence of our method, a series of reward mechanisms, such as memorydifference, smoothing and boundary penalty, are utilized to form the finalreward function. Extensive experiments performed on both simulated and realdatasets demonstrate the effectiveness and robustness of our proposed method.When utilized in the cross-domain area, the proposed method greatly mitigatesinconsistency between simulated and real domains, outperforming referencemethods significantly.

Reconstruct 3D Geometry of Target Using Differentiable SAR Renderer

Differentiable SAR Renderer and SAR Target Reconstruction

Differentiable SAR Renderer and Image-Based Target Reconstruction

Extension of Differentiable SAR Renderer for Ground Target Reconstruction from Multiview Images and Shadows

Recovering Geometric Parameters from SAR Images Using Differentiable Ray Tracing

Differentiable Rendering for Synthetic Aperture Radar Imagery

Learning Surface Scattering Parameters From SAR Images Using Differentiable Ray Tracing

Three-dimensional Reconstruction of Space Targets from Multi-view ISAR Images Using Differentiable Voxel Reconstruction Network

SAR Image Generation by Integrating Differentiable SAR Renderer with Neural Networks

Differentiable Rendering of Neural SDFs through Reparameterization

Approximate Differentiable Rendering with Algebraic Surfaces

Efficient Multi-View Inverse Rendering Using a Hybrid Differentiable Rendering Method

Differentiable SAR Renderer Embedded Reinforcement Learning for View Angles Inversion in SAR Images

A General Differentiable Mesh Renderer for Image-Based 3D Reasoning

Analytical Derivatives for Differentiable Renderer: 3D Pose Estimation by Silhouette Consistency

Differentiable Voxel Reconstruction of Satellite Target from Multi-Station ISAR and Optical Image Sequence

Differentiable Rendering of Parametric Geometry

A Simple Approach to Differentiable Rendering of SDFs

Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Rendering

Reconstructable geometry shadow maps