Abstract:In recent years, unmanned aerial vehicles (UAVs) are considered to be integrated into wireless communication systems because of their tremendous advantages in mobility, cost, maneuverability, etc. In some real UAV-assisted communication scenarios, the dynamics of the environment, such as the roaming of served users, make it hard to obtain an optimal trajectory before the UAV is dispatched. Implanting an intelligent control policy into UAVs for distributed task execution is necessary to complete the task. In this paper, a UAV trajectory design problem is investigated for an orthorgonal-frequency-division-multiplexing (OFDM) wireless sensor network, which is dynamic because mobile sensors may randomly roam within a certain range. The UAV is expected to balance task efficiency with the safety constraint with a pre-trained onboard control policy. Compared to prior works, this work requires the policy to adapt to randomly generated obstacle maps, and also assumes that the UAV has no prior knowledge of the obstacles before it is dispatched, which brings about challenges to the problem. The motivation comes from adversarial environments without the specific obstacle distribution beforehand, such as a disaster area. The problem is formulated as a constrained Markov decision process (CMDP) model, which incorporates the safety constraint compared to basic MDP. Due to the assumption of randomized obstacle distribution and lack of prior knowledge, existing algorithms for CMDP can not be applied directly. To tackle this issue, we enhance reinforcement learning (RL) algorithm with a safety control mechanism to derive our novel safe reinforcement learning (Safe RL) algorithm, which is based on the framework of Lagrangian method. Compared to former algorithms about CMDP, our algorithm eliminates the premise that the safety model is known, the agent is able to learn safety judgement from scratch through its interactions with the environment. Simulation results demonstrate that our proposed algorithm outperforms the benchmark algorithm under the problem’s setup.

Drone Trajectory Control for Line-of-Sight Optical Camera Communication

Communication and Trajectory Design in UAV-enabled Flying Network.

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

Multi-UAV Deployment in Obstacle-Cluttered Environments with LOS Connectivity

Control-Aware Trajectory Predictions for Communication-Efficient Drone Swarm Coordination in Cluttered Environments

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Joint Neural Network for Trajectory and Communication Design in Multi-DAV Systems

A UAV-Mounted Free Space Optical Communication: Trajectory Optimization for Flight Time

Farm Monitoring System with Drones and Optical Camera Communication

Low-cost adaptive obstacle avoidance trajectory control for express delivery drone

Safety Constrained Trajectory Optimization for Completion Time Minimization for UAV Communications

On Theoretical Trajectory Planning of Multiple Drones To Minimize Latency in Search-and-Reconnaissance Operations

Interpretable and Secure Trajectory Optimization for UAV-Assisted Communication

Optimal Transmission Control and Learning-Based Trajectory Design for UAV-Assisted Detection and Communication

Angle-Aware Coverage with Camera Rotational Motion Control

Occlusion Avoidance in Image-Based Control of Multiple Spacecraft

Trajectory Planning for UAV-Assisted Full-Duplex OWC Systems

Multi-UAV Trajectory Design for Fair and Secure Communication

Joint Communication and Trajectory Optimization for Multi-UAV Enabled Mobile Internet of Vehicles

Joint Trajectory and Communication Optimization for UAV-Assisted Over-The-Air Federated Learning.