Abstract:In recent years, autonomous underwater vehicles (AUVs) have been widely applied to collect data in underwater acoustic sensor networks (UWASNs). Limited by the capacity of a single AUV, as well as the low-latency requirement of data collection, the intelligent swarm consisting of multiple AUVs is expected to execute the secure and efficient data collection tasks in a cooperative manner. However, most of the existing works assumed that the locations of sensor nodes are already known, which is impractical in a real AUV network. In addition, the security issues are not well considered in underwater searching and transmission tasks. To improve the searching efficiency in an unknown underwater area where locations of sensor nodes cannot be obtained precisely, this work proposes a data collection scheme via a target uncertainty map based multi-agent reinforcement learning algorithm for AUV swarms. Specifically, the target uncertainty map is established based on the current and past searching and collection results, which can guide the AUV swarm to search the areas with higher probabilities to find sensor nodes waiting for data collection. Moreover, to mitigate the potential security risk of data leakage, we design a multi-agent deep deterministic policy gradient (MADDPG) algorithm for each AUV in the swarm to make its searching and data collection strategies through a manner of centralized training with distributed execution. Simulation results validate that the proposed scheme can achieve a high collection rate with low energy consumption. In addition, the security referring to data protection can be also guaranteed in AUV swarms.

Enhancing Underwater IoT Security: A Collaborative Pursuit Strategy Using Multi-Agent Reinforcement Learning

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Secure and Cooperative Target Tracking Via AUV Swarm - A Reinforcement Learning Approach.

Underwater Target Tracking Based on Hierarchical Software-Defined Multi-AUV Reinforcement Learning: A Multi-AUV Advantage-Attention Actor-Critic Approach

Smart Underwater Pollution Detection Based on Graph-Based Multi-Agent Reinforcement Learning Towards AUV-Based Network ITS

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-enabled Multi-Agent Reinforcement Learning

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Maritime Search and Rescue Leveraging Heterogeneous Units: A Multi-Agent Reinforcement Learning Approach.

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

A Software-Defined MARL-Based Architecture for AUV Cluster Network to Enable Cooperative and Smart Underwater Target Tracking

Distributional Soft Actor-Critic-Based Multi-AUV Cooperative Pursuit for Maritime Security Protection

Reinforcement Learning Based Obstacle Avoidance for AUV Swarm in Dynamic Ocean Environment

Multi-Agent Reinforcement Learning Based Secure Searching and Data Collection in AUV Swarms.

Distributed Information Fusion Based Trajectory Tracking for USV and UAV Clusters Via Multi-Agent Deep Learning Approach

Research on Unmanned Surface Vessel Intrusion Evasion Strategy Based on Deep Reinforcement Learning

Dynamic Navigation and Area Assignment of Multiple USVs Based on Multi-Agent Deep Reinforcement Learning

Multi-AUV Assisted Seamless Underwater Target Tracking Relying on Deep Learning and Reinforcement Learning

Autonomous Underwater Vehicle Formation Control and Obstacle Avoidance Using Multi-Agent Generative Adversarial Imitation Learning

Underwater Target Tracking Based on Interrupted Software-Defined Multi-AUV Reinforcement Learning: A Multi-AUV Time-Saving MARL Approach

Multi-AUV Pursuit-Evasion Game in the Internet of Underwater Things: an Efficient Training Framework Via Offline Reinforcement Learning