Abstract:Due to the interaction between floating weak targets and sea clutter in complex marine environments, it is necessary to distinguish targets and sea clutter from different dimensions by designing universal deep learning models. Therefore, in this paper, we introduce the concept of multimodal data fusion from the field of artificial intelligence (AI) to the marine target detection task. Using deep learning methods, a target detection network model based on the multimodal data fusion of radar echoes is proposed. In the paper, according to the characteristics of different modalities data, the temporal LeNet (T-LeNet) network module and time-frequency feature extraction network module are constructed to extract the time domain features, frequency domain features, and time-frequency features from radar sea surface echo signals. To avoid the impact of redundant features between different modalities data on detection performance, a Self-Attention mechanism is introduced to fuse and optimize the features of different dimensions. The experimental results based on the publicly available IPIX radar and CSIR datasets show that the multimodal data fusion of radar echoes can effectively improve the detection performance of marine floating weak targets. The proposed model has a target detection probability of 0.97 when the false alarm probability is 10−3 under the lower signal-to-clutter ratio (SCR) sea state. Compared with the feature-based detector and the detection model based on single-modality data, the new model proposed by us has stronger detection performance and universality under various marine detection environments. Moreover, the transfer learning method is used to train the new model in this paper, which effectively reduces the model training time. This provides the possibility of applying deep learning methods to real-time target detection at sea.

Multi-polarization Features Fusion Detection of Marine Small Targets based on LSTM

Small Low-Contrast Target Detection: Data-Driven Spatiotemporal Feature Fusion and Implementation

A Decision-level Weighting Fusion Detection Method Based on the Joint Multi-features of VFGPIR

Radar HRRP Feature Fusion Recognition Method Based on ConvLSTM Network with Multi-Input Gate Recurrent Unit

A Network Model for Detecting Marine Floating Weak Targets Based on Multimodal Data Fusion of Radar Echoes

Novel Dynamic Feature Fusion Stragegy for Detection of Small Underwater Marine Object

Detection, tracking and recognition of multi-targets using fusion data from different sensors

Dual-band polarimetric HRRP recognition via a brain-inspired multi-channel fusion feature extraction network

A Multiscale Information Fusion Network Based on PixelShuffle Integrated With YOLO for Aerial Remote Sensing Object Detection

Sea-Surface Small Target Detection Based on Improved Markov Transition Fields

Multi-Polarization Fusion Few-Shot HRRP Target Recognition Based on Meta-Learning Framework

Two-Stage Sea-Surface Small Target Detection Using Multifeature-Fusion-Based Binary Classifier and SCR Enhancement

D-MFPN: A Doppler Feature Matrix Fused with a Multilayer Feature Pyramid Network for SAR Ship Detection

Multi-Dimensional Information Fusion You Only Look Once Network for Suspicious Object Detection in Millimeter Wave Images

LPI Radar Waveform Recognition Based on Multi-Resolution Deep Feature Fusion

Multiscale Accurate Ship Detection Network Driven by Multiattention Fusion for Complex Maritime Backgrounds

Airborne Small Target Detection Method Based on Multimodal and Adaptive Feature Fusion

DSF-Net: A Dual Feature Shuffle Guided Multi-Field Fusion Network for SAR Small Ship Target Detection

Automatic SAR Ship Detection Based on Multi-Feature Fusion Network in Spatial and Frequency Domain

Target detection based on multi-scale feature fusion and cross-channel interactive attention mechanism

Multi-Scale Rotation-Invariant Haar-Like Feature Integrated CNN-Based Ship Detection Algorithm of Multiple-Target Environment in SAR Imagery