Abstract:In recent years, autonomous underwater vehicles (AUVs) have been widely applied to collect data in underwater acoustic sensor networks (UWASNs). Limited by the capacity of a single AUV, as well as the low-latency requirement of data collection, the intelligent swarm consisting of multiple AUVs is expected to execute the secure and efficient data collection tasks in a cooperative manner. However, most of the existing works assumed that the locations of sensor nodes are already known, which is impractical in a real AUV network. In addition, the security issues are not well considered in underwater searching and transmission tasks. To improve the searching efficiency in an unknown underwater area where locations of sensor nodes cannot be obtained precisely, this work proposes a data collection scheme via a target uncertainty map based multi-agent reinforcement learning algorithm for AUV swarms. Specifically, the target uncertainty map is established based on the current and past searching and collection results, which can guide the AUV swarm to search the areas with higher probabilities to find sensor nodes waiting for data collection. Moreover, to mitigate the potential security risk of data leakage, we design a multi-agent deep deterministic policy gradient (MADDPG) algorithm for each AUV in the swarm to make its searching and data collection strategies through a manner of centralized training with distributed execution. Simulation results validate that the proposed scheme can achieve a high collection rate with low energy consumption. In addition, the security referring to data protection can be also guaranteed in AUV swarms.

Distributional Soft Actor-Critic-Based Multi-AUV Cooperative Pursuit for Maritime Security Protection

Distributed Trajectory Estimation for Multi-Autonomous Underwater Vehicle

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Multi-AUVs Cooperative Target Search Based on Autonomous Cooperative Search Learning Algorithm

Research on Multiple-AUVs Collaborative Detection and Surrounding Attack Simulation

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Secure and Cooperative Target Tracking Via AUV Swarm - A Reinforcement Learning Approach.

Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-enabled Multi-Agent Reinforcement Learning

A Multi-AUV Maritime Target Search Method for Moving and Invisible Objects Based on Multi-Agent Deep Reinforcement Learning

Multi-AUV Cooperative Localization in Adaptive Sampling for Marine Environmental Monitoring

A Multi-Robot Coverage Path Planning Method for Maritime Search and Rescue Using Multiple AUVs

Distributed short-term predictive control for AUV clusters in underwater cooperative hunting tasks

A Cooperative Hunting Method for Multi-AUV Swarm in Underwater Weak Information Environment with Obstacles

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

Multi-AUV Pursuit-Evasion Game in the Internet of Underwater Things: an Efficient Training Framework Via Offline Reinforcement Learning

Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic

Multi-Agent Generative Adversarial Interactive Self-Imitation Learning for AUV Formation Control and Obstacle Avoidance

Deep Reinforcement Learning Based Multi-UUV Cooperative Control for Target Capturing

Collaborative task decision-making of multi-UUV in dynamic environments based on deep reinforcement learning

Multi-Agent Reinforcement Learning Based Secure Searching and Data Collection in AUV Swarms.

Multi-Auv Collaborative Data Collection in Integrated Underwater Acoustic Communication and Detection Networks