Abstract:With the rapid development of underwater communication, sensing, automation, robot technologies, autonomous underwater vehicle (AUV) swarms are gradually becoming popular and have been widely promoted in ocean exploration and underwater tracking or surveillance, etc. However, the complex underwater environment poses significant challenges for AUV swarm-based accurate tracking for the underwater moving targets. In this paper, we aim at proposing a multi-AUV cooperative underwater multi-target tracking algorithm especially when the real underwater factors are taken into account.We first give normally modelling approach for the underwater sonar-based detection and the ocean current interference on the target tracking process.Then, we regard the AUV swarm as a underwater ad-hoc network and propose a novel Multi-Agent Reinforcement Learning (MARL) architecture towards the AUV swarm based on Software-Defined Networking (SDN).It enhances the flexibility and scalability of the AUV swarm through centralized management and distributed operations.Based on the proposed MARL architecture, we propose the "dynamic-attention switching" and "dynamic-resampling switching" mechanisms, to enhance the efficiency and accuracy of AUV swarm cooperation during task execution.Finally, based on a proposed AUV classification method, we propose an efficient cooperative tracking algorithm called ASMA.Evaluation results demonstrate that our proposed tracking algorithm can perform precise underwater multi-target tracking, comparing with many of recent research products in terms of convergence speed and tracking accuracy.

Analysis of Belief Propagation Based Cooperative Localization and Target Tracking Schemes

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

Multi-AUV Localization for an Underwater Acoustic Sensor Network

Bayesian Passive Acoustic Tracking of a Cooperative Moving Source in Shallow Water

Multi-AUV Cooperative Localization in Adaptive Sampling for Marine Environmental Monitoring

Secure and Cooperative Target Tracking Via AUV Swarm - A Reinforcement Learning Approach.

The Principles and Practice of Tropical Medicine

A Novel Passive Localization Scheme of Underwater Non-Cooperative Targets based on Weak-Control AUVs

Feature-Aided Passive Tracking of Noncooperative Multiple Targets Based on the Underwater Sensor Networks

A Multi-Node Cooperative Bearing-Only Target Passive Tracking Algorithm Via UWSNs

Cooperative localization of AUVs using moving horizon estimation

Uncertainty Constrained Belief Propagation for Cooperative Target Tracking

Cooperative Localization for Autonomous Underwater Vehicles Using Parallel Projection

Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-enabled Multi-Agent Reinforcement Learning

Local Node Selection for Target Tracking Based on Underwater Wireless Sensor Networks

Probabilistic Cooperative Target Localization

A Hybrid Control Approach to Cooperative Target Tracking with Multiple Mobile Robots

Distributed Circumnavigation Control of Autonomous Underwater Vehicles Based on Local Information.

Energy-efficient Localization and Target Tracking Via Underwater Mobile Sensor Networks

Cooperative Tracking by Multi-Agent Systems Using Signals of Opportunity

Localization and Tracking Control Using Hybrid Acoustic–Optical Communication for Autonomous Underwater Vehicles