Abstract:Unmanned and intelligent technologies are the future development trend in the business field. It is of great significance for the connotation analysis and application characterization of massive interactive data. Particularly, during major epidemics or disasters, how to provide business services safely and securely is crucial. Specifically, providing users with resilient and guaranteed communication services is a challenging business task when the communication facilities are damaged. Unmanned aerial vehicles (UAVs), with flexible deployment and high maneuverability, can be used to serve as aerial base stations (BSs) to establish emergency networks. However, it is challenging to control multiple UAVs to provide efficient and fair communication quality of service (QoS) to users due to their limited communication service capabilities. In this paper, we propose a learning-based resilience guarantee framework for multi-UAV collaborative QoS management. We formulate this problem as a partial observable Markov decision process and solve it with proximal policy optimization (PPO), which is a policy-based deep reinforcement learning method. A centralized training and decentralized execution paradigm is used, where the experience collected by all UAVs is used to train the shared control policy. Each UAV takes actions based on the partial environment information it observes. In addition, the design of the reward function considers the average and variance of the communication QoS of all users. Extensive simulations are conducted for performance evaluation. The simulation results indicate that (1) the trained policies can adapt to different scenarios and provide resilient and guaranteed communication QoS to users, (2) increasing the number of UAVs can compensate for the lack of service capabilities of UAVs, (3) when UAVs have local communication service capabilities, the policies trained with PPO have better performance compared with the policies trained with other algorithms.

Enhanced Emergency Communication Services for Post–Disaster Rescue: Multi-IRS Assisted Air-Ground Integrated Data Collection

Game Theoretical Bandwidth Allocation in UAV-UGV Collaborative Disaster Relief Networks.

Disaster Resilient Emergency Communication With Intelligent Air-Ground Cooperation

VFC-Based Cooperative UAV Computation Task Offloading for Post-disaster Rescue

An Improved Virtual Force Approach for UAV Deployment and Resource Allocation in Emergency Communications

Joint Channel Allocation and Data Delivery for UAV-Assisted Cooperative Transportation Communications in Post-Disaster Networks

UAV-Assisted Emergency Networks in Disasters

Joint Coverage and Power Control in Highly Dynamic and Massive UAV Networks: An Aggregative Game-theoretic Learning Approach

Joint Task Offloading and Resource Allocation in Aerial-Terrestrial UAV Networks with Edge and Fog Computing for Post-Disaster Rescue

Multi-Task and Multi-Objective Joint Resource Optimization for UAV-Assisted Air-Ground Integrated Networks under Emergency Scenarios

Task Offloading for Post-Disaster Rescue in Unmanned Aerial Vehicles Networks

QoE‐driven multi‐UAV deployment scheme for emergency communication networks

Multi-UAV Assisted Air–Ground Collaborative MEC System: DRL-Based Joint Task Offloading and Resource Allocation and 3D UAV Trajectory Optimization

Adaptive Coverage Solution In Multi-Uavs Emergency Communication System: A Discrete-Time Mean-Field Game

Biobjective UAV/UGV Collaborative Rendezvous Planning in Persistent Intelligent Task-Based Wireless Communication

Unmanned Aerial Vehicle Assisted Post-Disaster Communication Coverage Optimization Based on Internet of Things Big Data Analysis

Fair Communications in UAV Networks for Rescue Applications

Learning-based Resilience Guarantee for Multi-Uav Collaborative QoS Management.

UAV-Assisted Emergency Communications: an Extended Multi-Armed Bandit Perspective

Collaborative Task Allocation and Optimization Solution for Unmanned Aerial Vehicles in Search and Rescue