Abstract:This study introduces a pioneering multimodal fusion framework to enhance near-field 3D Synthetic Aperture Radar (SAR) imaging, crucial for applications like radar cross-section measurement and concealed object detection. Traditional near-field 3D SAR imaging struggles with issues like target–background confusion due to clutter and multipath interference, shape distortion from high sidelobes, and lack of color and texture information, all of which impede effective target recognition and scattering diagnosis. The proposed approach presents the first known application of multimodal fusion in near-field 3D SAR imaging, integrating LiDAR and optical camera data to overcome its inherent limitations. The framework comprises data preprocessing, point cloud registration, and data fusion, where registration between multi-sensor data is the core of effective integration. Recognizing the inadequacy of traditional registration methods in handling varying data formats, noise, and resolution differences, particularly between near-field 3D SAR and other sensors, this work introduces a novel three-stage registration process to effectively address these challenges. First, the approach designs a structure–intensity-constrained centroid distance detector, enabling key point extraction that reduces heterogeneity and accelerates the process. Second, a sample consensus initial alignment algorithm with SHOT features and geometric relationship constraints is proposed for enhanced coarse registration. Finally, the fine registration phase employs adaptive thresholding in the iterative closest point algorithm for precise and efficient data alignment. Both visual and quantitative analyses of measured data demonstrate the effectiveness of our method. The experimental results show significant improvements in registration accuracy and efficiency, laying the groundwork for future multimodal fusion advancements in near-field 3D SAR imaging.

Sensor Registration Based on Neural Network in Data Fusion

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

Multi-Sensors Data Tracking Fusion Based on a Neural Network Filter

Multi-Sensor Data Fusion Algorithm Based on BP Neural Network

Camera-Radar Fusion Sensing System Based on Multi-Layer Perceptron

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

Enhanced Radar Perception via Multi-Task Learning: Towards Refined Data for Sensor Fusion Applications

Research on Track Fusion in Radar Networking

A Novel Multimodal Fusion Framework Based on Point Cloud Registration for Near-Field 3D SAR Perception

Multi-Modal and Multi-Scale Fusion 3D Object Detection of 4D Radar and LiDAR for Autonomous Driving

RSA-fusion: radar spatial attention fusion for object detection and classification

A Deep Framework for Hyperspectral Image Fusion Between Different Satellites

Study on Multi-sensor Data Fusion Based on Approach Degree

Improved Multi-Sensor Fusion Dynamic Odometry Based on Neural Networks

Data Fusion for Multi-Source Sensors Using GA-PSO-BP Neural Network

Wireless Sensor System of UAV Infrared Image and Visible Light Image Registration Fusion

A Deep Learning Approach for Drone Detection and Classification Using Radar and Camera Sensor Fusion

Multi-Subband Radar Signal Fusion Processing Based on Deep Neural Network in Low Signal-to-Noise Ratio

Target Tracking System for Multi-Sensor Data Fusion

A Novel Multi-Sensor Hybrid Fusion Framework

Attention-Based Road Registration for GPS-Denied UAS Navigation