Abstract:Nowadays, multiple types of equipment, including unmanned aerial vehicles (UAVs) and automatic surface vehicles (ASVs), have been deployed in maritime search and rescue (SAR). However, due to the lack of base stations (BSs), how to complete the rescue while maintaining the communication between vehicles is an unresolved challenge. In this paper, we design an efficient and fault-tolerant communication solution by jointly optimizing vehicles' trajectory, offloading scheduling, and routing topology for a heterogeneous vehicles system. First, we model several essential factors in maritime SAR, including the impact of ocean currents, the observational behavior of UAVs, the fault tolerance of relay networks, resource management of mobile edge computing (MEC), and energy consumption. A multi-objective optimization problem is formulated, aiming at minimizing time and energy consumption while increasing the fault tolerance of relay networks. Then, we transfer the objective into a decentralized partially observable Markov Decision Process (Dec-POMDP) and introduce multi-agent reinforcement learning (MARL) to search for a collaborative strategy. Specifically, two MARL approaches with different training styles are evaluated, and three techniques are added for improving performance, including sharing parameters , normalized generalized-advantage-estimation (GAE), and preserving-outputs-precisely-while-adaptively-rescaling-targets (Pop-Art). Experimental results demonstrate that our proposed approach, named heterogeneous vehicles multi-agent proximal policy optimization (HVMAPPO), outperforms other baselines in efficiency and fault tolerance of communication.

Multi-Agent Distributed Cooperative Routing for Maritime Emergency Communication.

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Maritime Search and Rescue Networking Based on Multi-Agent Cooperative Communication.

A Multi-Agent Reinforcement Learning Routing Protocol for Underwater Optical Sensor Networks

Double Q Learning Multi-Agent Routing Method for Maritime Search and Rescue

Maritime Search and Rescue Leveraging Heterogeneous Units: A Multi-Agent Reinforcement Learning Approach.

Joint Federated Learning and Reinforcement Learning for Maritime Ad Hoc Networks: An Integration of Personalized Collaborative Route Planning.

A Multi-Vessels Cooperation Scheduling for Networked Maritime Fog-Ran Architecture Leveraging SDN.

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

Multiple Ships Cooperative Navigation and Collision Avoidance using Multi-agent Reinforcement Learning with Communication

Source-based Disjoint Multi-Path Routing Protocol for Underwater Acoustic Networks

Dependency-Aware Task Offloading and Resource Allocation for Maritime Ultrareliable Applications

Joint Trajectory and Communication Optimization for Heterogeneous Vehicles in Maritime SAR: Multi-Agent Reinforcement Learning

A Multi-agent Reinforcement Learning Routing Protocol in Mobile Robot Network

An Efficient Routing Access Method Based on Multi-Agent Reinforcement Learning in UWSNs

Learning to Routing in UAV Swarm Network: A Multi-Agent Reinforcement Learning Approach

ER-OCN: Towards efficient network routing in ocean city based on deep reinforcement learning

Multi-Agent Reinforcement Learning-Based Routing Protocol for Underwater Wireless Sensor Networks with Value of Information

Multi Agents to Search and Rescue Based on Group Intelligent Algorithm and Edge Computing

Adaptive Clustering Routing Protocol for Underwater Sensor Networks

QMCR: A Q-learning-based Multi-Hop Cooperative Routing Protocol for Underwater Acoustic Sensor Networks