Abstract:In recent years, unmanned aerial vehicles (UAVs) are considered to be integrated into wireless communication systems because of their tremendous advantages in mobility, cost, maneuverability, etc. In some real UAV-assisted communication scenarios, the dynamics of the environment, such as the roaming of served users, make it hard to obtain an optimal trajectory before the UAV is dispatched. Implanting an intelligent control policy into UAVs for distributed task execution is necessary to complete the task. In this paper, a UAV trajectory design problem is investigated for an orthorgonal-frequency-division-multiplexing (OFDM) wireless sensor network, which is dynamic because mobile sensors may randomly roam within a certain range. The UAV is expected to balance task efficiency with the safety constraint with a pre-trained onboard control policy. Compared to prior works, this work requires the policy to adapt to randomly generated obstacle maps, and also assumes that the UAV has no prior knowledge of the obstacles before it is dispatched, which brings about challenges to the problem. The motivation comes from adversarial environments without the specific obstacle distribution beforehand, such as a disaster area. The problem is formulated as a constrained Markov decision process (CMDP) model, which incorporates the safety constraint compared to basic MDP. Due to the assumption of randomized obstacle distribution and lack of prior knowledge, existing algorithms for CMDP can not be applied directly. To tackle this issue, we enhance reinforcement learning (RL) algorithm with a safety control mechanism to derive our novel safe reinforcement learning (Safe RL) algorithm, which is based on the framework of Lagrangian method. Compared to former algorithms about CMDP, our algorithm eliminates the premise that the safety model is known, the agent is able to learn safety judgement from scratch through its interactions with the environment. Simulation results demonstrate that our proposed algorithm outperforms the benchmark algorithm under the problem’s setup.

A Safety Constrained Control Framework for UAVs in GPS Denied Environment

Safety Constrained Multi-UAV Time Coordination: A Bi-level Control Framework in GPS Denied Environment

Improving Physical Layer Security for Multi-Uav Systems Against Hybrid Wireless Attacks

A Stealthy GPS Spoofing Strategy for Manipulating the Trajectory of an Unmanned Aerial Vehicle

An Analysis of GPS Spoofing Attack and Efficient Approach to Spoofing Detection in PX4

Combating the Control Signal Spoofing Attack in UAV Systems

Resilient Path Planning of UAVs against Covert Attacks on UWB Sensors

Hijacking Unmanned Aerial Vehicle by Exploiting Civil GPS Vulnerabilities Using Software-defined Radio

Safety Constrained Trajectory Optimization for Completion Time Minimization for UAV Communications

Event-based obstacle avoidance control for time-varying UAV formation under cyber-attacks

Drones in Distress: A Game-Theoretic Countermeasure for Protecting UAVs Against GPS Spoofing

Enhanced Machine Learning Ensemble Approach for Securing Small Unmanned Aerial Vehicles From GPS Spoofing Attacks

GPS Spoofing on UAV: A Survey.

Protecting Autonomous UAVs from GPS Spoofing and Jamming: A Comparative Analysis of Detection and Mitigation Techniques

Model Predictive Control Enabled UAV Trajectory Optimization and Secure Resource Allocation

Unmanned Aerial Vehicle’s Vulnerability to GPS Spoofing a Review

Control Barrier Function Based UAV Safety Controller in Autonomous Airborne Tracking and Following Systems

Detection of global positioning system spoofing attack on unmanned aerial vehicle system

EF-TTOA: Development of a UAV Path Planner and Obstacle Avoidance Control Framework for Static and Moving Obstacles

GPS-Spoofing Attack Detection Mechanism for UAV Swarms

Vulnerabilities Analysis and Secure Controlling for Unmanned Aerial System Based on Reactive Synthesis