Abstract:Due to the interaction between floating weak targets and sea clutter in complex marine environments, it is necessary to distinguish targets and sea clutter from different dimensions by designing universal deep learning models. Therefore, in this paper, we introduce the concept of multimodal data fusion from the field of artificial intelligence (AI) to the marine target detection task. Using deep learning methods, a target detection network model based on the multimodal data fusion of radar echoes is proposed. In the paper, according to the characteristics of different modalities data, the temporal LeNet (T-LeNet) network module and time-frequency feature extraction network module are constructed to extract the time domain features, frequency domain features, and time-frequency features from radar sea surface echo signals. To avoid the impact of redundant features between different modalities data on detection performance, a Self-Attention mechanism is introduced to fuse and optimize the features of different dimensions. The experimental results based on the publicly available IPIX radar and CSIR datasets show that the multimodal data fusion of radar echoes can effectively improve the detection performance of marine floating weak targets. The proposed model has a target detection probability of 0.97 when the false alarm probability is 10−3 under the lower signal-to-clutter ratio (SCR) sea state. Compared with the feature-based detector and the detection model based on single-modality data, the new model proposed by us has stronger detection performance and universality under various marine detection environments. Moreover, the transfer learning method is used to train the new model in this paper, which effectively reduces the model training time. This provides the possibility of applying deep learning methods to real-time target detection at sea.

Marine Radar Small Target Classification Based on Normalized Time-Frequency Image and Residual Network

Classification of Small Targets on Sea Surface Based on Improved Residual Fusion Network and Complex Time–Frequency Spectra

A Small Target Detection Method for Sea Surface Based on Guided Filtering and Local Mean Gray Difference

Small-floating Target Detection in Sea Clutter via Visual Feature Classifying in the Time-Doppler Spectra

A Floating Small Target Identification Method Based on Doppler Time Series Information

A Network Model for Detecting Marine Floating Weak Targets Based on Multimodal Data Fusion of Radar Echoes

Real-Time Ubiquitous Radar Target Classification with 1D ResNet-SE-Based Multi-Channel Network

Floating Small Target Detection in Sea Clutter Using Mean Spectral Radius

RadarTCN: Lightweight Online Classification Network for Automotive Radar Targets Based on TCN

A Method for Detecting Small Slow Targets on Sea Surface Based on FC-MCNN

Sea-Surface Small Target Detection Based on Improved Markov Transition Fields

Marine radar monitoring IoT system and case study of target detection based on PPI images

Detection of Small Floating Targets on the Sea Surface Based on Multi-Features and Principal Component Analysis

Aerial Target Recognition with Enhanced Micro-Doppler Dynamic Features Based on Frequency-Modulated Continuous-Wave Radar

Wave Height and Period Estimation from X-Band Marine Radar Images Using Convolutional Neural Network

A Sea Clutter Suppression Method based on Machine Learning Approach for Marine Surveillance Radar

Maritime Target Detection Based on Radar Graph Data and Graph Convolutional Network

A Complete Automatic Target Recognition System of Low Altitude, Small RCS and Slow Speed (LSS) Targets Based on Multi-Dimensional Feature Fusion

Detection and Recognition of SAR Small Ship Objects Using Deep Neural Network

Feature Extraction and Classification of Radar Targets Based on High Resolution Range Profiles

A Method for Nearshore Vessel Target Detection in SAR Imagery Utilizing Edge Characteristics and Augmented Global Information Amplification