Abstract:Multi-rotor UAVs suffer from a restricted range and flight duration due to limited battery capacity. Autonomous landing on a 2D moving platform offers the possibility to replenish batteries and offload data, thus increasing the utility of the vehicle. Classical approaches rely on accurate, complex and difficult-to-derive models of the vehicle and the environment. Reinforcement learning (RL) provides an attractive alternative due to its ability to learn a suitable control policy exclusively from data during a training procedure. However, current methods require several hours to train, have limited success rates and depend on hyperparameters that need to be tuned by trial-and-error. We address all these issues in this work. First, we decompose the landing procedure into a sequence of simpler, but similar learning tasks. This is enabled by applying two instances of the same RL based controller trained for 1D motion for controlling the multi-rotor's movement in both the longitudinal and the lateral directions. Second, we introduce a powerful state space discretization technique that is based on i) kinematic modeling of the moving platform to derive information about the state space topology and ii) structuring the training as a sequential curriculum using transfer learning. Third, we leverage the kinematics model of the moving platform to also derive interpretable hyperparameters for the training process that ensure sufficient maneuverability of the multi-rotor vehicle. The training is performed using the tabular RL method Double Q-Learning. Through extensive simulations we show that the presented method significantly increases the rate of successful landings, while requiring less training time compared to other deep RL approaches. Finally, we deploy and demonstrate our algorithm on real hardware. For all evaluation scenarios we provide statistics on the agent's performance.

Quadrotor Autonomous Landing on Moving Platform

Autonomous Landing of a Quadrotor on a Moving Platform Via Model Predictive Control

Autonomous Landing Solution of Low-Cost Quadrotor on a Moving Platform

Quadrotors' Low-cost Vision-based Autonomous Landing Architecture on a Moving Platform

Low-Complexity Control for Vision-based Landing of Quadrotor UAV on Unknown Moving Platform

A nonlinear model predictive control based control method to quadrotor landing on moving platform

Landing control of a quadrotor on a moving platform with unknown speed in the field of view

Simultaneous Obstacles Avoidance and Robust Autonomous Landing of a UAV on a Moving Vehicle

Towards Non-Robocentric Dynamic Landing of Quadrotor UAVs

Vision-based Autonomous Landing Control of a Multi-rotor Aerial Vehicle on a Moving Platform with Experimental Validations

Towards a Fully Autonomous UAV Controller for Moving Platform Detection and Landing

Landing a quadrotor UAV on a moving platform with sway motion using robust control

Reinforcement Learning based Autonomous Multi-Rotor Landing on Moving Platforms

Path Planning and Control of a Quadrotor Landing on a Ground Moving Target

Online Safe Trajectory Generation of Quadrotors Autonomous Landing in Complex Dynamic Environments

Synthesized Landing Strategy for Quadcopter to Land Precisely on a Vertically Moving Apron

Robust Image-based Landing Control of a Quadrotor on an Unknown Moving Platform Using Circle Features.

Robust Visual Landing Control of Quadrotor on a Moving Platform: A Sampled-Data Approach with Delayed Output and Disturbances

Drone Autonomous Landing on a Moving Maritime Platform Using Machine Learning Classifiers

Finite-Time Tracking of Moving Platform With Single Camera for Quadrotor Autonomous Landing