Abstract:Unmanned Aerial Vehicles (UAVs), also known as drones, have advanced greatly in recent years. There are many ways in which drones can be used, including transportation, photography, climate monitoring, and disaster relief. The reason for this is their high level of efficiency and safety in all operations. While the design of drones strives for perfection, it is not yet flawless. When it comes to detecting and preventing collisions, drones still face many challenges. In this context, this paper describes a methodology for developing a drone system that operates autonomously without the need for human intervention. This study applies reinforcement learning algorithms to train a drone to avoid obstacles autonomously in discrete and continuous action spaces based solely on image data. The novelty of this study lies in its comprehensive assessment of the advantages, limitations, and future research directions of obstacle detection and avoidance for drones, using different reinforcement learning techniques. This study compares three different reinforcement learning strategies—namely, Deep Q-Networks (DQN), Proximal Policy Optimization (PPO), and Soft Actor-Critic (SAC)—that can assist in avoiding obstacles, both stationary and moving; however, these strategies have been more successful in drones. The experiment has been carried out in a virtual environment made available by AirSim. Using Unreal Engine 4, the various training and testing scenarios were created for understanding and analyzing the behavior of RL algorithms for drones. According to the training results, SAC outperformed the other two algorithms. PPO was the least successful among the algorithms, indicating that on-policy algorithms are ineffective in extensive 3D environments with dynamic actors. DQN and SAC, two off-policy algorithms, produced encouraging outcomes. However, due to its constrained discrete action space, DQN may not be as advantageous as SAC in narrow pathways and twists. Concerning further findings, when it comes to autonomous drones, off-policy algorithms, such as DQN and SAC, perform more effectively than on-policy algorithms, such as PPO. The findings could have practical implications for the development of safer and more efficient drones in the future.

Learning-Based Defense Against Malicious Unmanned Aerial Vehicles.

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Improving Physical Layer Security for Multi-Uav Systems Against Hybrid Wireless Attacks

Intercepting Unauthorized Aerial Robots in Controlled Airspace Using Reinforcement Learning

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

Robust Adversarial Attacks Detection based on Explainable Deep Reinforcement Learning For UAV Guidance and Planning

Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment

Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems

Application of Deep Reinforcement Learning to Defense and Intrusion Strategies Using Unmanned Aerial Vehicles in a Versus Game

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

UAV Detection Using Reinforcement Learning

Resilient Path Planning for UAVs in Data Collection under Adversarial Attacks

Detection of GPS Spoofing Attacks in UAVs Based on Adversarial Machine Learning Model

Anti-Intelligent UAV Jamming Strategy Via Deep Q-Networks

RIS-Assisted Jamming Rejection and Path Planning for UAV-Borne IoT Platform: A New Deep Reinforcement Learning Framework

Defending against Intrusion of Malicious UAVs with Networked UAV Defense Swarms

Deep Reinforcement Learning for Vision-Based Navigation of UAVs in Avoiding Stationary and Mobile Obstacles

Multi-Agent Reinforcement Learning for Wireless Networks Against Adversarial Communications

Gradient Monitored Reinforcement Learning for Jamming Attack Detection in FANETs