Abstract:Multi-UAV Cooperative Search (MCS) can significantly enhance the efficiency and effectiveness of search by enabling multiple unmanned aerial vehicles (UAVs) to collaborate in conducting search missions. Thus, it has played a vital role in various applications, such as surveillance, target detection, and information gathering. While existing works in this field mainly focused on a single UAV layer, in this work we consider a Multi-layered Aerial Computing Network (MACN) scenario, which consists of a Low-Altitude Platform (LAP) layer with multiple high-flexibility and low-capacity UAVs (called LUAVs) and a High-Altitude Platform (HAP) layer with one low-flexibility and high-capacity UAV (called HUAV). In such a scenario, We focus on the joint optimization of flying trajectories, computation offloading, and resource allocation, aiming at minimizing the uncertainty of Search Probability Map (SPM). The problem is challenging due to the co-existence of discrete and continuous decision variables, as well as the fast and randomly changing of wireless environment. To solve the problem in an online and distributed manner, we propose a Multi-Agent Deep Reinforcement Learning (MADRL) approach based on Parameter Sharing and Action Mask (PSAM), called PSAMMA, where the State-Action-Reward-State-Action (SARSA) method is leveraged to determine the discrete flying and offloading decisions. Experiment results show that the proposed PSAMMA algorithm outperforms existing methods in terms of the average SPM uncertainty, the target discovery rate, and the coverage rate.

Multi-UAV autonomous collision avoidance based on PPO-GIC algorithm with CNN-LSTM fusion network

UAV Cooperative Search Based on Multi-agent Generative Adversarial Imitation Learning

On-policy Actor-Critic Reinforcement Learning for Multi-UAV Exploration

Proximal Policy Optimization for Multi-rotor UAV Autonomous Guidance, Tracking and Obstacle Avoidance

A Reinforcement Learning-based Decentralized Method of Avoiding Multi-UAV Collision in 3-D Airspace

RaCIL: Ray Tracing based Multi-UAV Obstacle Avoidance through Composite Imitation Learning

Research on collision avoidance algorithm of unmanned surface vehicle based on deep reinforcement learning

Obstacle Avoidance for UAS in Continuous Action Space Using Deep Reinforcement Learning

Research on the Multiagent Joint Proximal Policy Optimization Algorithm Controlling Cooperative Fixed-Wing UAV Obstacle Avoidance

Multiple-UAV Reinforcement Learning Algorithm Based on Improved PPO in Ray Framework

Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs.

Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

End-to-end UAV Intelligent Training via Deep Reinforcement Learning

Proximal policy optimization with reciprocal velocity obstacle based collision avoidance path planning for multi-unmanned surface vehicles

Multi-Uav Automatic Dynamic Obstacle Avoidance With Experience-Shared A2c

Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

PPO-Exp: Keeping Fixed-Wing UAV Formation with Deep Reinforcement Learning

An LGMD Based Competitive Collision Avoidance Strategy for UAV

An Improved PPO for Multiple Unmanned Aerial Vehicles

Multi-Agent Reinforcement Learning for Unmanned Aerial Vehicle Coordination by Multi-Critic Policy Gradient Optimization