Abstract:The localization of underwater acoustic sensor networks (UASNs) has emerged as a critical research area in the marine information fusion field. Generally, the convex optimization method is adopted to solve the localization problem. However, this method has limitations in complex underwater environments, since it is difficult to transform the non-convex optimization problem into a convex optimization problem under such conditions. Recently, deep reinforcement learning (DRL) has shown great potential and promise in solving intricate optimization tasks. Motivated by this, we propose to adopt DRL for UASNs localization to improve accuracy and robustness. The key challenge is that existing DRL-based methods require discretization of the environment, which leads to a compromise between search time and localization precision. To address this challenge, we first model the localization problem as a Markov Decision Process (MDP) with continuous state and action spaces and subsequently introduce a continuous control DRL framework to solve the localization problem. Within this framework, we develop three continuous control DRL-based localization estimators to address the localization problem in unsupervised, supervised, and semisupervised scenarios. Comprehensive simulations demonstrate the effectiveness of our approach, as the proposed solutions exhibit several advantageous features compared to traditional methods, such as: 1) compared with convex optimization-based method, the convex relaxation is not required; 2) compared with least squares method, the proposed estimators are capable of converging to a global optimal state; 3) compared with discrete control DRL method, the proposed estimators reduce localization time and enhance localization accuracy significantly.

Asynchronous Localization for Underwater Acoustic Sensor Networks: A Continuous Control Deep Reinforcement Learning Approach

Reinforcement Learning Based Mobile Underwater Localization for Silent UUV in Underwater Acoustic Sensor Networks

Fine-Tuning Neural Network Based Target Localization Using Sources of Opportunity

Deep Reinforcement Learning Based Accurate UUV Localization

AUV-Aided Localization for Internet of Underwater Things: A Reinforcement-Learning-Based Method.

Reinforcement Learning Based AUV Localization in Underwater Acoustic Sensor Networks.

Privacy-Preserving Localization for Underwater Sensor Networks via Deep Reinforcement Learning

Underwater Acoustic Aided Grid Localization of Multi-UUVs with Reinforcement Learning

Secure Localization for Underwater Wireless Sensor Networks Via AUV Cooperative Beamforming with Reinforcement Learning

Underwater Localization and Mapping Based on Multi-Beam Forward Looking Sonar.

Underwater Wireless Sensor Network-Based Localization Method under Mixed Line-of-Sight/Non-Line-of-Sight Conditions

Broad-Learning-Based Localization for Underwater Sensor Networks with Stratification Compensation.

Deep Reinforcement Learning (DRL): Another Perspective for Unsupervised Wireless Localization

Integrated Localization and Tracking for AUV With Model Uncertainties via Scalable Sampling-Based Reinforcement Learning Approach

Efficient Beacon-Aided AUV Localization: A Reinforcement Learning Based Approach

A Multi-Hop Reverse Localization Scheme for Underwater Wireless Sensor Networks

Asynchronous Localization of Dynamic Node Through Underwater Acoustic Sensor Networks

End-to-end multi-sensor fusion method based on deep reinforcement learning in UASNs

Asynchronous Localization with Mobility Prediction for Underwater Acoustic Sensor Networks

Asynchronous Localization of Underwater Target Using Consensus-Based Unscented Kalman Filtering

Deep Reinforcement Learning for Localizability-Enhanced Navigation in Dynamic Human Environments