Abstract:Autonomous Drone Racing (ADR) was first proposed in IROS 2016. It called for the development of an autonomous drone capable of beating a human in a drone race. After almost five years, several teams have proposed different solutions with a common pipeline: gate detection; drone localization; and stable flight control. Recently, Deep Learning (DL) has been used for gate detection and localization of the drone regarding the gate. However, recent competitions such as the Game of Drones, held at NeurIPS 2019, called for solutions where DL played a more significant role. Motivated by the latter, in this work, we propose a CNN approach called DeepPilot that takes camera images as input and predicts flight commands as output. These flight commands represent: the angular position of the drone's body frame in the roll and pitch angles, thus producing translation motion in those angles; rotational speed in the yaw angle; and vertical speed referred as altitude h. Values for these 4 flight commands, predicted by DeepPilot, are passed to the drone's inner controller, thus enabling the drone to navigate autonomously through the gates in the racetrack. For this, we assume that the next gate becomes visible immediately after the current gate has been crossed. We present evaluations in simulated racetrack environments where DeepPilot is run several times successfully to prove repeatability. In average, DeepPilot runs at 25 frames per second (fps). We also present a thorough evaluation of what we called a temporal approach, which consists of creating a mosaic image, with consecutive camera frames, that is passed as input to the DeepPilot. We argue that this helps to learn the drone's motion trend regarding the gate, thus acting as a local memory that leverages the prediction of the flight commands. Our results indicate that this purely DL-based artificial pilot is feasible to be used for the ADR challenge.

Challenges and implemented technologies used in autonomous drone racing

An integrated solution for an autonomous drone racing in indoor environments

A Trajectory-based Flight Assistive System for Novice Pilots in Drone Racing Scenario

Polynomial-based Online Planning for Autonomous Drone Racing in Dynamic Environments

Autonomous Drone Racing: A Survey

AlphaPilot: autonomous drone racing

DeepPilot: A CNN for Autonomous Drone Racing

The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competition

FLAGDroneRacing: An Autonomous Drone Racing System

Autonomous Multi-Drone Racing Method Based on Deep Reinforcement Learning

A Sim-to-Real Deep Learning-Based Framework for Autonomous Nano-Drone Racing

Visual Model-predictive Localization for Computationally Efficient Autonomous Racing of a 72-gram Drone

Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing

Learned Inertial Odometry for Autonomous Drone Racing

Autonomous Robot Racing Competitions: Truly Multivehicle Autonomous Racing Competitions

A Review of Full-Sized Autonomous Racing Vehicle Sensor Architecture

Deep Drone Racing: Learning Agile Flight in Dynamic Environments

Human-Piloted Drone Racing: Visual Processing and Control

Autonomous Drone Racing with Deep Reinforcement Learning

Race Against the Machine: a Fully-annotated, Open-design Dataset of Autonomous and Piloted High-speed Flight