Abstract:The localization of underwater acoustic sensor networks (UASNs) has emerged as a critical research area in the marine information fusion field. Generally, the convex optimization method is adopted to solve the localization problem. However, this method has limitations in complex underwater environments, since it is difficult to transform the non-convex optimization problem into a convex optimization problem under such conditions. Recently, deep reinforcement learning (DRL) has shown great potential and promise in solving intricate optimization tasks. Motivated by this, we propose to adopt DRL for UASNs localization to improve accuracy and robustness. The key challenge is that existing DRL-based methods require discretization of the environment, which leads to a compromise between search time and localization precision. To address this challenge, we first model the localization problem as a Markov Decision Process (MDP) with continuous state and action spaces and subsequently introduce a continuous control DRL framework to solve the localization problem. Within this framework, we develop three continuous control DRL-based localization estimators to address the localization problem in unsupervised, supervised, and semisupervised scenarios. Comprehensive simulations demonstrate the effectiveness of our approach, as the proposed solutions exhibit several advantageous features compared to traditional methods, such as: 1) compared with convex optimization-based method, the convex relaxation is not required; 2) compared with least squares method, the proposed estimators are capable of converging to a global optimal state; 3) compared with discrete control DRL method, the proposed estimators reduce localization time and enhance localization accuracy significantly.

End-to-end multi-sensor fusion method based on deep reinforcement learning in UASNs

An end-to-end sensor scheduling method based on D3QN for underwater passive tracking in UWSNs

Asynchronous Localization for Underwater Acoustic Sensor Networks: A Continuous Control Deep Reinforcement Learning Approach

Multi-AUV Assisted Seamless Underwater Target Tracking Relying on Deep Learning and Reinforcement Learning

A Novel Sensor Scheduling Algorithm Based on Deep Reinforcement Learning for Bearing-Only Target Tracking in UWSNs

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

UAV Target Following in Complex Occluded Environments with Adaptive Multi-Modal Fusion

Multi-Sensor Fusion Simultaneous Localization Mapping Based on Deep Reinforcement Learning and Multi-Model Adaptive Estimation

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

Multimodal fusion for autonomous navigation via deep reinforcement learning with sparse rewards and hindsight experience replay

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Cooperative Sensing Enhanced UAV Path-Following and Obstacle Avoidance with Variable Formation

A Federated Deep Reinforcement Learning-Based Trust Model in Underwater Acoustic Sensor Networks

Multi-target tracking for unmanned aerial vehicle swarms using deep reinforcement learning

A Deep Learning Method Based on the Multi-stage Fusion of Radar and Camera in UAV Obstacle Avoidance

Characteristic evaluation via multi-sensor information fusion strategy for spherical underwater robots

Multi-agent deep reinforcement learning based multiple access for underwater cognitive acoustic sensor networks

AUV-Aided Optical-Acoustic Hybrid Data Collection Based on Deep Reinforcement Learning

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Enhancing Underwater IoT Security: A Collaborative Pursuit Strategy Using Multi-Agent Reinforcement Learning

Multi-sensor fusion for underwater robot self-localization using PC/BC-DIM neural network