Abstract:This study introduces a pioneering multimodal fusion framework to enhance near-field 3D Synthetic Aperture Radar (SAR) imaging, crucial for applications like radar cross-section measurement and concealed object detection. Traditional near-field 3D SAR imaging struggles with issues like target–background confusion due to clutter and multipath interference, shape distortion from high sidelobes, and lack of color and texture information, all of which impede effective target recognition and scattering diagnosis. The proposed approach presents the first known application of multimodal fusion in near-field 3D SAR imaging, integrating LiDAR and optical camera data to overcome its inherent limitations. The framework comprises data preprocessing, point cloud registration, and data fusion, where registration between multi-sensor data is the core of effective integration. Recognizing the inadequacy of traditional registration methods in handling varying data formats, noise, and resolution differences, particularly between near-field 3D SAR and other sensors, this work introduces a novel three-stage registration process to effectively address these challenges. First, the approach designs a structure–intensity-constrained centroid distance detector, enabling key point extraction that reduces heterogeneity and accelerates the process. Second, a sample consensus initial alignment algorithm with SHOT features and geometric relationship constraints is proposed for enhanced coarse registration. Finally, the fine registration phase employs adaptive thresholding in the iterative closest point algorithm for precise and efficient data alignment. Both visual and quantitative analyses of measured data demonstrate the effectiveness of our method. The experimental results show significant improvements in registration accuracy and efficiency, laying the groundwork for future multimodal fusion advancements in near-field 3D SAR imaging.

Feature-based Fusion of Tomosar Point Clouds from Multiview TerraSAR-X Data Stacks

Towards TerraSAR-X Street View: Creating city point cloud from multi-aspect data stacks

Automatic Feature-Based Geometric Fusion of Multiview TomoSAR Point Clouds in Urban Area

Fusion Algorithm of Laser-Point Clouds and Optical Images

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

Spaceborne TomoSAR and Beyond: from SAR Image Stacks to Objects

Reconstructing 2-D/3-D Building Shapes from Spaceborne Tomographic Synthetic Aperture Radar Data

Operational TomoSAR Processing Using TerraSAR-X High Resolution Spotlight Stacks from Multiple View Angles

An Efficient Tomographic Inversion Approach for Urban Mapping Using Meter Resolution SAR Image Stacks

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

A Novel Multimodal Fusion Framework Based on Point Cloud Registration for Near-Field 3D SAR Perception

Fusing Spaceborne Sar Interferometry And Street View Images For 4d Urban Modeling

Urban SAR Tomography With Z-Structure Constraint of Buildings

Building point cloud reconstruction in TomoSAR based on deep learning semantic segmentation

High Quality Large-Scale 3-D Urban Mapping with Multi-Master TomoSAR

Efficient Volumetric Fusion of Airborne and Street-Side Data for Urban Reconstruction

Non-Local SAR Tomography for Large-Scale Urban Mapping

SAR Tomography at the Limit: Building Height Reconstruction Using Only 3-5 TanDEM-X Bistatic Interferograms

TEXTURE ANALYSIS BASED FUSION EXPERIMENTS USING HIGH-RESOLUTION SAR AND OPTICAL IMAGERY

KD-Tree-Based Euclidean Clustering for Tomographic SAR Point Cloud Extraction and Segmentation

A Framework for SAR-Optical Stereogrammetry over Urban Areas