Abstract:The localization of underwater acoustic sensor networks (UASNs) has emerged as a critical research area in the marine information fusion field. Generally, the convex optimization method is adopted to solve the localization problem. However, this method has limitations in complex underwater environments, since it is difficult to transform the non-convex optimization problem into a convex optimization problem under such conditions. Recently, deep reinforcement learning (DRL) has shown great potential and promise in solving intricate optimization tasks. Motivated by this, we propose to adopt DRL for UASNs localization to improve accuracy and robustness. The key challenge is that existing DRL-based methods require discretization of the environment, which leads to a compromise between search time and localization precision. To address this challenge, we first model the localization problem as a Markov Decision Process (MDP) with continuous state and action spaces and subsequently introduce a continuous control DRL framework to solve the localization problem. Within this framework, we develop three continuous control DRL-based localization estimators to address the localization problem in unsupervised, supervised, and semisupervised scenarios. Comprehensive simulations demonstrate the effectiveness of our approach, as the proposed solutions exhibit several advantageous features compared to traditional methods, such as: 1) compared with convex optimization-based method, the convex relaxation is not required; 2) compared with least squares method, the proposed estimators are capable of converging to a global optimal state; 3) compared with discrete control DRL method, the proposed estimators reduce localization time and enhance localization accuracy significantly.

A Multi-Scale Coordinate Embedded Dual-Path U-Net for Shallow-Sea Source Localization

Matched-field source localization using sparsely-coded neural network and data-model mixed training

Fine-Tuning Neural Network Based Target Localization Using Sources of Opportunity

A Novel AMSS-FFN for Underwater Multisource Localization Using Artificial Lateral Line.

An Underwater Wideband Sound Source Localization Method Based on Light Neural Network Structure

Underwater Target Classification at Greater Depths Using Deep Neural Network with Joint Multiple‐domain Feature

Underwater Wireless Sensor Network-Based Localization Method under Mixed Line-of-Sight/Non-Line-of-Sight Conditions

A Deep Learning Localization Method for Acoustic Source via Improved Input Features and Network Structure

Asynchronous Localization for Underwater Acoustic Sensor Networks: A Continuous Control Deep Reinforcement Learning Approach

Underwater Localization and Mapping Based on Multi-Beam Forward Looking Sonar.

Weighted Source Localization in a Underwater Wireless Sensor Array Network

Source Depth Estimation Using Spectral Transformations and Convolutional Neural Network in a Deep-Sea Environment.

Source localization using deep neural networks in a shallow water environment

A Generalized Network Based on Multi-Scale Densely Connection and Residual Attention for Sound Source Localization and Detection.

Deep learning for source localization and seabed classification under dynamic oceanographic environments using explosive sound signals

Effective Underwater Acoustic Target Passive Localization of Using a Multi-Task Learning Model with Attention Mechanism: Analysis and Comparison under Real Sea Trial Datasets

A Mds-Based Localization Algorithm for Underwater Wireless Sensor Network

Dual Spatial Attention Network for Underwater Object Detection With Sonar Imagery

Passive Ship Localization in a Shallow Water Using Pre-trained Deep Learning Networks

Semi-supervised underwater acoustic source localization based on residual convolutional autoencoder

A Deep Learning Method for UUV to Detect Undersea Landform Features