Abstract:Multi-rotor UAVs suffer from a restricted range and flight duration due to limited battery capacity. Autonomous landing on a 2D moving platform offers the possibility to replenish batteries and offload data, thus increasing the utility of the vehicle. Classical approaches rely on accurate, complex and difficult-to-derive models of the vehicle and the environment. Reinforcement learning (RL) provides an attractive alternative due to its ability to learn a suitable control policy exclusively from data during a training procedure. However, current methods require several hours to train, have limited success rates and depend on hyperparameters that need to be tuned by trial-and-error. We address all these issues in this work. First, we decompose the landing procedure into a sequence of simpler, but similar learning tasks. This is enabled by applying two instances of the same RL based controller trained for 1D motion for controlling the multi-rotor's movement in both the longitudinal and the lateral directions. Second, we introduce a powerful state space discretization technique that is based on i) kinematic modeling of the moving platform to derive information about the state space topology and ii) structuring the training as a sequential curriculum using transfer learning. Third, we leverage the kinematics model of the moving platform to also derive interpretable hyperparameters for the training process that ensure sufficient maneuverability of the multi-rotor vehicle. The training is performed using the tabular RL method Double Q-Learning. Through extensive simulations we show that the presented method significantly increases the rate of successful landings, while requiring less training time compared to other deep RL approaches. Finally, we deploy and demonstrate our algorithm on real hardware. For all evaluation scenarios we provide statistics on the agent's performance.

Cooperative Landing on Mobile Platform for Multiple Unmanned Aerial Vehicles Via Reinforcement Learning

UAV Autonomous Tracking and Landing Based on Deep Reinforcement Learning Strategy

A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Platform

Reinforcement Learning based Autonomous Multi-Rotor Landing on Moving Platforms

Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

Towards a Fully Autonomous UAV Controller for Moving Platform Detection and Landing

A Multimodal Learning-based Approach for Autonomous Landing of UAV

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

A nonlinear model predictive control based control method to quadrotor landing on moving platform

Vision-Based Deep Reinforcement Learning of UAV-UGV Collaborative Landing Policy Using Automatic Curriculum

Autonomous Landing on a Moving Platform Using Vision-Based Deep Reinforcement Learning

Deep Reinforcement Learning-Driven Collaborative Rounding-Up for Multiple Unmanned Aerial Vehicles in Obstacle Environments

Cooperative Planning of Multi-Uav Logistics Delivery by Multi-Graph Reinforcement Learning

Cooperative Multi-Agent Deep Reinforcement Learning Methods for UAV-aided Mobile Edge Computing Networks

Research on the Multiagent Joint Proximal Policy Optimization Algorithm Controlling Cooperative Fixed-Wing UAV Obstacle Avoidance

Reinforcement Learning for Shared Autonomy Drone Landings

An Adaptive Multi-Level Quantization-Based Reinforcement Learning Model for Enhancing UAV Landing on Moving Targets

Research on Aerial Autonomous Docking and Landing Technology of Dual Multi-Rotor UAV

Multi-Agent Reinforcement Learning for Offloading Cellular Communications with Cooperating UAVs