Abstract:Due to the interaction between floating weak targets and sea clutter in complex marine environments, it is necessary to distinguish targets and sea clutter from different dimensions by designing universal deep learning models. Therefore, in this paper, we introduce the concept of multimodal data fusion from the field of artificial intelligence (AI) to the marine target detection task. Using deep learning methods, a target detection network model based on the multimodal data fusion of radar echoes is proposed. In the paper, according to the characteristics of different modalities data, the temporal LeNet (T-LeNet) network module and time-frequency feature extraction network module are constructed to extract the time domain features, frequency domain features, and time-frequency features from radar sea surface echo signals. To avoid the impact of redundant features between different modalities data on detection performance, a Self-Attention mechanism is introduced to fuse and optimize the features of different dimensions. The experimental results based on the publicly available IPIX radar and CSIR datasets show that the multimodal data fusion of radar echoes can effectively improve the detection performance of marine floating weak targets. The proposed model has a target detection probability of 0.97 when the false alarm probability is 10−3 under the lower signal-to-clutter ratio (SCR) sea state. Compared with the feature-based detector and the detection model based on single-modality data, the new model proposed by us has stronger detection performance and universality under various marine detection environments. Moreover, the transfer learning method is used to train the new model in this paper, which effectively reduces the model training time. This provides the possibility of applying deep learning methods to real-time target detection at sea.

Radar Signal Detection Method Based on Multi-Features Fusion

Sample Intercorrelation-Based Multidomain Fusion Network for Aquatic Human Activity Recognition Using Millimeter-Wave Radar.

Daytime Water Hazard Detection Based on Multi-Feature Fusion

RaViDeep: Target Detection Based on Deep Fusion of Radar and Vision in Berthing Scenarios

A Novel Potential Drowning Detection System Based on Millimeter-Wave Radar

A Decision-level Weighting Fusion Detection Method Based on the Joint Multi-features of VFGPIR

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

Deep Learning-Based Multi-Feature Fusion for Communication and Radar Signal Sensing

Detection of Small Floating Targets on the Sea Surface Based on Multi-Features and Principal Component Analysis

Radar Maritime Target Detection via Spatial–Temporal Feature Attention Graph Convolutional Network

Automatic SAR Ship Detection Based on Multi-Feature Fusion Network in Spatial and Frequency Domain

Radar HRRP Feature Fusion Recognition Method Based on ConvLSTM Network with Multi-Input Gate Recurrent Unit

A Network Model for Detecting Marine Floating Weak Targets Based on Multimodal Data Fusion of Radar Echoes

Underwater Target Noise Recognition and Classification Technology based on Multi-Classes Feature Fusion

Two-Stage Sea-Surface Small Target Detection Using Multifeature-Fusion-Based Binary Classifier and SCR Enhancement

LPI Radar Waveform Recognition Based on Multi-Resolution Deep Feature Fusion

Underwater Acoustic Target Recognition Based on Sub-Regional Feature Enhancement and Multi-Activated Channel Aggregation

Camera-Radar Fusion with Radar Channel Extension and Dual-CBAM-FPN for Object Detection

RSA-fusion: radar spatial attention fusion for object detection and classification

MIMO Radar Signal Fusion Detection Method Based on Markov Chain

Robust Small Object Detection on the Water Surface Through Fusion of Camera and Millimeter Wave Radar