Abstract:Multi-UAV Cooperative Search (MCS) can significantly enhance the efficiency and effectiveness of search by enabling multiple unmanned aerial vehicles (UAVs) to collaborate in conducting search missions. Thus, it has played a vital role in various applications, such as surveillance, target detection, and information gathering. While existing works in this field mainly focused on a single UAV layer, in this work we consider a Multi-layered Aerial Computing Network (MACN) scenario, which consists of a Low-Altitude Platform (LAP) layer with multiple high-flexibility and low-capacity UAVs (called LUAVs) and a High-Altitude Platform (HAP) layer with one low-flexibility and high-capacity UAV (called HUAV). In such a scenario, We focus on the joint optimization of flying trajectories, computation offloading, and resource allocation, aiming at minimizing the uncertainty of Search Probability Map (SPM). The problem is challenging due to the co-existence of discrete and continuous decision variables, as well as the fast and randomly changing of wireless environment. To solve the problem in an online and distributed manner, we propose a Multi-Agent Deep Reinforcement Learning (MADRL) approach based on Parameter Sharing and Action Mask (PSAM), called PSAMMA, where the State-Action-Reward-State-Action (SARSA) method is leveraged to determine the discrete flying and offloading decisions. Experiment results show that the proposed PSAMMA algorithm outperforms existing methods in terms of the average SPM uncertainty, the target discovery rate, and the coverage rate.

Ballooning: an Agent-Based Search Strategy in Wireless Sensor and Actor Networks

A cooperative rescue framework by using wireless sensor and actor networks

An incremental deployment algorithm for wireless sensor networks using one or multiple autonomous agents

XY-expansion: Joint search and clock synchronization for wireless sensor and actor networks

Follow the trail: a search strategy in event driven wireless sensor and actor networks

Bionic Optimization Based Stability and Congestion Aware Routing Algorithm for Airborne Highly Dynamic Network.

Towards Optimal Barrier Coverage in Wireless Sensor and Actor Networks

Sharing Mobility Strategy Improves Location Service in Wireless Sensor and Actor Networks.

An Active Search Strategy with Multiple Unmanned Aerial Systems for Multiple Targets

Sensor-based Multi-agent Coverage Control with Spatial Separation in Unstructured Environments

An Information-Motivated Exploration Agent to Locate Stationary Persons with Wireless Transmitters in Unknown Environments

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

Effective Cooperative UAV Searching Using Adaptive STGM Mobility Model in a FANET

Balancing energy consumption with mobile agents in wireless sensor networks

Dynamic Coverage with Wireless Sensor and Actor Networks in Underwater Environment

Decentralized Uncertainty-Aware Active Search with a Team of Aerial Robots

Spatial Configuration of Agile Wireless Networks with Drone-BSs and User-in-the-loop

Traffic Optimization in Satellites Communications: A Multi-agent Reinforcement Learning Approach

Multi-UAV Collaborative Target Search Method in Unknown Dynamic Environment

Simple Agents, Smart Swarms: a Cooperative Search Algorithm for Swarms of Autonomous Underwater Vehicles

Agent-based dynamic routing in the packet-switched LEO satellite networks