Abstract:Unmanned Aerial Systems (UAS) are being increasingly deployed for commercial, civilian, and military applications. The current UAS state-of-the-art still depends on a remote human controller with robust wireless links to perform several of these applications. The lack of autonomy restricts the domains of application and tasks for which a UAS can be deployed. Enabling autonomy and intelligence to the UAS will help overcome this hurdle and expand its use improving safety and efficiency. The exponential increase in computing resources and the availability of large amount of data in this digital era has led to the resurgence of machine learning from its last winter. Therefore, in this chapter, we discuss how some of the advances in machine learning, specifically deep learning and reinforcement learning can be leveraged to develop next-generation autonomous UAS. We first begin motivating this chapter by discussing the application, challenges, and opportunities of the current UAS in the introductory section. We then provide an overview of some of the key deep learning and reinforcement learning techniques discussed throughout this chapter. A key area of focus that will be essential to enable autonomy to UAS is computer vision. Accordingly, we discuss how deep learning approaches have been used to accomplish some of the basic tasks that contribute to providing UAS autonomy. Then we discuss how reinforcement learning is explored for using this information to provide autonomous control and navigation for UAS. Next, we provide the reader with directions to choose appropriate simulation suites and hardware platforms that will help to rapidly prototype novel machine learning based solutions for UAS. We additionally discuss the open problems and challenges pertaining to each aspect of developing autonomous UAS solutions to shine light on potential research areas.

Vision-Based Autonomous Drone Control using Supervised Learning in Simulation

Vision Based Drone Obstacle Avoidance by Deep Reinforcement Learning

Autonomous UAV Navigation Using Reinforcement Learning

Vision-based Learning for Drones: A Survey

Path planning of autonomous UAVs using reinforcement learning

Deep Reinforcement Learning for End-to-End Local Motion Planning of Autonomous Aerial Robots in Unknown Outdoor Environments: Real-Time Flight Experiments

Deep Neural Network for Real-Time Autonomous Indoor Navigation

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

Deep Drone Racing: Learning Agile Flight in Dynamic Environments

DRAL: Deep Reinforcement Adaptive Learning for Multi-UAVs Navigation in Unknown Indoor Environment

Multi-Task Regression-Based Learning for Autonomous Unmanned Aerial Vehicle Flight Control Within Unstructured Outdoor Environments

Path Planning of Unmanned Aerial Vehicle Based on Supervised Learning

Deep Convolutional Neural Network-Based Autonomous Drone Navigation

Autonomous unmanned aerial vehicle flight control using multi-task deep neural network for exploring indoor environments

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Autonomous Navigation of UAV in Large-Scale Unknown Complex Environment with Deep Reinforcement Learning.

A Vision Based Deep Reinforcement Learning Algorithm for UAV Obstacle Avoidance

Deep reinforcement learning for drone navigation using sensor data

Deep Learning and Reinforcement Learning for Autonomous Unmanned Aerial Systems: Roadmap for Theory to Deployment

Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing

Autonomous Drone Navigation