Abstract:The localization of underwater acoustic sensor networks (UASNs) has emerged as a critical research area in the marine information fusion field. Generally, the convex optimization method is adopted to solve the localization problem. However, this method has limitations in complex underwater environments, since it is difficult to transform the non-convex optimization problem into a convex optimization problem under such conditions. Recently, deep reinforcement learning (DRL) has shown great potential and promise in solving intricate optimization tasks. Motivated by this, we propose to adopt DRL for UASNs localization to improve accuracy and robustness. The key challenge is that existing DRL-based methods require discretization of the environment, which leads to a compromise between search time and localization precision. To address this challenge, we first model the localization problem as a Markov Decision Process (MDP) with continuous state and action spaces and subsequently introduce a continuous control DRL framework to solve the localization problem. Within this framework, we develop three continuous control DRL-based localization estimators to address the localization problem in unsupervised, supervised, and semisupervised scenarios. Comprehensive simulations demonstrate the effectiveness of our approach, as the proposed solutions exhibit several advantageous features compared to traditional methods, such as: 1) compared with convex optimization-based method, the convex relaxation is not required; 2) compared with least squares method, the proposed estimators are capable of converging to a global optimal state; 3) compared with discrete control DRL method, the proposed estimators reduce localization time and enhance localization accuracy significantly.

Blessing of High-Order Dimensionality: from Non-Convex to Convex Optimization for Sensor Network Localization

Sensor Network Localization via Riemannian Conjugate Gradient and Rank Reduction: An Extended Version

Sensor Network Localization, Euclidean Distance Matrix Completions, and Graph Realization

Global solution to sensor network localization: A non-convex potential game approach and its distributed implementation

A Feasible Method for Sensor Network Localization

Non-convex potential games for finding global solutions to sensor network localization

Semi-supervised Laplacian regularized least squares algorithm for localization in wireless sensor networks

Sensor Network Localization Using Kernel Spectral Regression

Asynchronous Localization for Underwater Acoustic Sensor Networks: A Continuous Control Deep Reinforcement Learning Approach

Exact Convex Relaxation-Based Sensor Network Localization Using Noisy Distance Measurements.

Angle-Based Sensor Network Localization

Distributed Maximum Likelihood Sensor Network Localization

Sensor Network Localization Via Nondifferentiable Optimization.

A Kernel-Based Localization Approach in Wireless Sensor Networks

Efficient Deterministic Algorithm for Huge-Sized Noisy Sensor Localization Problems via Canonical Duality Theory

A Dynamic State Transition Algorithm with Application to Sensor Network Localization

Multiscale Semidefinite Programming Approach to Positioning Problems with Pairwise Structure

A Multi-Player Potential Game Approach for Sensor Network Localization with Noisy Measurements

DisLoc: A Convex Partitioning Based Approach for Distributed 3-D Localization in Wireless Sensor Networks

A Connectivity Based Localization Algorithm for Sensor Network

Co-SRL: A Convex Optimization Algorithm for Anchor Localization in Wireless Sensor Networks