Abstract:The study addresses the challenge of distinguishing between surface and underwater targets in passive sonar detection, which often includes both types of targets. To tackle this issue, the study employs two key methods: Dynamic Time Warping (DTW) to align sonar and AIS data in the time domain, handling temporal misalignment, and a deep learning algorithm with a multi‐head attention mechanism for spatial alignment of the data. These methods effectively manage the spatio‐temporal misalignment and heterogeneous nature of the data sources, significantly improving underwater target detection by reducing surface target interference. As a result, the approach achieves over 95% accuracy in matching targets detected by AIS with those identified by sonar. In the field of underwater target detection, the passive sonar is an important means of long‐distance target detection. The sonar detection information typically includes both surface and underwater targets, whereas it is a great challenge on effectively distinguishing between surface and underwater targets solely based on sonar information. Effective fusion of sonar and AIS (Automatic Identification System) data can leverage their complementary nature to compensate for the limitation of sonar information. However, the sonar information and AIS information are acquired based on different detection principles and systems, which are essentially multi‐source heterogeneous information with obvious spatio‐temporal misalignment in nature. Existing fusion methods normally struggle to effectively align sonar and AIS data in both time and space subject to the complexity of the problem. In this study, the Dynamic Time Warping (DTW) algorithm is applied to align sonar and AIS data in the time domain. In addition, a deep learning algorithm with multi‐head attention mechanism is proposed to achieve the spatial alignment of sonar and AIS data, where the matching between the surface targets in AIS data and the same surface targets in sonar data can also be successfully achieved. It provides a priori knowledge to enhance the underwater target detection of the passive sonar by eliminating the interference of the surface targets. Based on the attention mechanism, the abstract features extracted from the intermediate‐layer of the neural networks are found to be effective to represent the typical features of the target motion trajectories, which also demonstrates the effectiveness of the attention mechanism. The experiment results show that the proposed method can successfully achieve a MatchingSucccessRate of over 95% between the AIS targets and sonar detection targets.

Detection of Man-Made Object in Sonar Image Based on Multi-Features Fusion

Daytime Water Hazard Detection Based on Multi-Feature Fusion

A Decision-level Weighting Fusion Detection Method Based on the Joint Multi-features of VFGPIR

Multi-Feature Fusion Based Outdoor Water Hazards Detection

Hazards Detection Multi-Feature Fusion Based Outdoor Water

An Object Enhancement Method for Forward-Looking Sonar Images Based on Multi-Frame Fusion

Enhancing underwater target detection: Fusion of spatio‐temporal incompletely‐aligned AIS and sonar information via DTW and multi‐head attention mechanism

Visual Detection And Feature Recognition Of Underwater Target Using A Novel Model-Based Method

Underwater Object Detection Based on Enhanced YOLO

Novel Dynamic Feature Fusion Stragegy for Detection of Small Underwater Marine Object

Underwater Material Recognition Based on Laser-Induced Acoustic Source

Automatic SAR Ship Detection Based on Multi-Feature Fusion Network in Spatial and Frequency Domain

A Target Detection Method Based on a New Multi-Scale Fractal Feature

A SIFT-Like Feature Detector and Descriptor for Multibeam Sonar Imaging

Dynamic Multiscale Feature Fusion Method for Underwater Target Recognition

Man-Made Object Recognition from Underwater Optical Images Using Deep Learning and Transfer Learning

A Mathematical Morphology-Based Detector for Underwater Target Detection Using Side-Scan Sonar Images

A Multi-Scale Fusion Strategy for Side Scan Sonar Image Correction to Improve Low Contrast and Noise Interference

A Dataset with Multibeam Forward-Looking Sonar for Underwater Object Detection

Realizing Target Detection in SAR Images Based on Multiscale Superpixel Fusion

Moving Object Detection in Shallow Underwater Using Multi-Scale Spatial-Temporal Lacunarity