Abstract:Autonomous underwater vehicles (AUVs) play a crucial role in data collection for underwater acoustic sensor networks (UWASNs). The limited capacity of individual AUV and the need for low-latency data collection necessitate the deployment of AUV swarms to achieve efficient and secure cooperative data collection. However, most existing works assume prior knowledge of sensor node locations, which is impractical in real-world AUV networks. Additionally, continuous data collection needs to be considered due to the sustained operation of sensors and cluster head replacement. To address these challenges, we propose a target uncertainty map assisted data collection scheme for AUV swarms based on the multi-agent proximal policy optimization (MAPPO) algorithm. Specifically, the target uncertainty map is established by leveraging current and past search and collection results, guiding the AUV swarm to prioritize areas with higher probabilities of containing sensor nodes. Moreover, a digital pheromone mechanism incorporating repulsive and attractive pheromones is designed to establish an artificial potential field for adjusting the target uncertainty map. To further enable a comprehensive exploration of unknown environments, we introduce the age of information (AoI) as an indicator. Additionally, we consider the energy consumption associated with data collection to strike a balance between collection and energy efficiency, and derive a lower bound on the policy improvement achieved by the MAPPO algorithm. Simulation results have validated that the proposed scheme has a superior performance compared to the baselines, achieving an approximately 15% increase in the collection rate while reducing the energy consumption of data collection and AoI as well.

Multi-AUV Task Scheduling for Target Hunting and Exploration: An AoI-Aware DMAPPO Approach

Task Scheduling for Distributed AUV Network Target Hunting and Searching: an Energy-Efficient AoI-Aware DMAPPO Approach

Distributed Trajectory Estimation for Multi-Autonomous Underwater Vehicle

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

Cooperative UUVs Detection Task Scheduling Integrated with Underwater Acoustic Environments

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Cooperative Coverage Path Planning for AUVs in Integrated Underwater Acoustic Communication and Detection Networks

Underwater Searching and Multi-Round Data Collection Via AUV Swarms: an Energy-Efficient AoI-Aware MAPPO Approach

Multi-AUV Collaborative Data Collection and Trajectory Planning in Integrated Sensing and Communication for Underwater Acoustic Networks

An adaptive distributed auction algorithm and its application to multi-AUV task assignment

Multi-AUV dynamic trajectory optimization and collaborative search combined with task urgency and energy consumption scheduling in 3-D underwater environment with random ocean currents and uncertain obstacles

Distributed short-term predictive control for AUV clusters in underwater cooperative hunting tasks

Path Planning in Multiple-AUV Systems for Difficult Target Traveling Missions: A Hybrid Metaheuristic Approach

Dynamic Task Assignment and Path Planning for Multi-AUV System in Variable Ocean Current Environment

A Cooperative Hunting Method for Multi-AUV Swarm in Underwater Weak Information Environment with Obstacles

A dynamic velocity potential field method for multi-AUV cooperative hunting tasks

A Multi-Robot Coverage Path Planning Method for Maritime Search and Rescue Using Multiple AUVs

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

Multi-AUV Kinematic Task Assignment Based on Self-Organizing Map Neural Network and Dubins Path Generator

A Multi-AUV Path Planning System Based on the Omni-Directional Sensing Ability