Abstract:This paper investigates an air-ground cooperative monitoring problem for spatiotemporal fields, such as air pollution, forest fires, oil spills, etc, with unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs). To fully exploit complementarities of these heterogeneous vehicles and improve efficiency of the cooperative monitoring, we design a novel cooperation scheme: each UAV is assigned to loiter over and transmit its observations to a pre-allocated UGV, and the UGV provides guidance on informative trajectories for the UAV and aims to reach a target position as fast as possible. Such a scheme brings challenges to informative trajectory planning of the UGVs, lying in the delayed observations from the UAVs and the cumulative information constraint depending on the unknown field. To overcome them, this work proposes a model-free reinforcement learning (RL)-based trajectory planning method to learn continuous policies for the UGVs, where a field estimator is designed for each UGV to recover observability of the field. In addition, we derive model predictive control (MPC)-based trajectory planners for the UAVs with tailored reference positions, where the uncertain tracking errors can be handled by the RL-based method of the UGVs. Thus, a performance coupling problem of the heterogeneous vehicles is tackled. Simulations illustrate the effectiveness of the proposed trajectory planning methods and the efficiency of the air-ground cooperative monitoring scheme. Note to Practitioners —This article is motivated by cooperative monitoring tasks with UAVs and UGVs in practical applications, such as environmental monitoring, search and rescue after disasters, etc. Due to the complex dynamics of spatiotemporal fields in these tasks, trajectory planning for the cooperative monitoring system is challenging and requires much computations. To resolve the issues, we propose a novel cooperation scheme in this article, where the large computational capability of the UGVs is utilized to solve a minimum-time trajectory planning problem under a cumulative information constraint, and the UAVs only loiter over and transmit measurements about the field to the UGVs. To achieve this scheme, RL-based and MPC-based trajectory planning methods are proposed for the UGVs and the UAVs, respectively. Simulations have validated the effectiveness of the proposed trajectory planning methods and good performance of the cooperative monitoring system.

Cooperative Aerial and Ground Vehicle Trajectory Planning for Post-Disaster Communications: an Attention-Based Learning Approach

Learning-Based Cooperative Aerial and Ground Vehicle Routing for Emergency Communications

Trajectory Planning for Multi-UAV Assisted Wireless Networks in Post-Disaster Scenario

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Joint Deployment and Trajectory Planning of Multiple UAVs for Emergency Communications

UAV Trajectory Optimization in a Post-Disaster Area Using Dual Energy-Aware Bandits

Disaster Resilient Emergency Communication With Intelligent Air-Ground Cooperation

Efficient Aerial Data Collection with Cooperative Trajectory Planning for Large-Scale Wireless Sensor Networks

Joint Channel Allocation and Data Delivery for UAV-Assisted Cooperative Transportation Communications in Post-Disaster Networks

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

Reinforcement Learning-Based Collision Avoidance and Optimal Trajectory Planning in UAV Communication Networks

Informative Trajectory Planning for Air-Ground Cooperative Monitoring of Spatiotemporal Fields

Unmanned Aerial Vehicle Assisted Post-Disaster Communication Coverage Optimization Based on Internet of Things Big Data Analysis

Trajectory optimization for UAV-enabled relaying with reinforcement learning

Joint Coverage and Power Control in Highly Dynamic and Massive UAV Networks: An Aggregative Game-theoretic Learning Approach

Learning-Based UAV Trajectory Optimization with Collision Avoidance and Connectivity Constraints

UAV-Assisted Emergency Communications: an Extended Multi-Armed Bandit Perspective

UAV Trajectory Planning with Interference Awareness in UAV-Enabled Time-Constrained Data Collection Systems

VFC-Based Cooperative UAV Computation Task Offloading for Post-disaster Rescue

Distributed Federated Deep Reinforcement Learning Based Trajectory Optimization for Air-Ground Cooperative Emergency Networks

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance