Abstract:In searching for the stable motion re-planning as required by autonomous quadrotors, deep reinforcement learning ( DRL ) techniques play a vital role in balancing the reference trajectory tracking and flight safety. In this research, our intention amounts to improving the traditional DRL strategies in terms of the following two essential factors: 1). searching the best optimization without losing efficiency under the conditions of unstructured disturbances, e.g. , continuously changing wind perturbation or slight collisions; 2). balancing the safety and flight aggressiveness according to the intensity of the wind disturbance and the complexity of the environment. To be specific, in caring about the prompt convergence, in the present study, the reference trajectory with a re-timing publication mechanism was well-adopted for providing reasonable initial parameters for the proposed DRL model, hence improving the optimization performance of DRL strategies and meeting the requirements of smooth flight actions. Furthermore, the problem of motion re-planning in different environments was formulated into a series of partially observable Markov decision problems ( POMDPs ). Correspondingly, a learned objective function was introduced into the model agnostic meta-learning ( MAML ) framework and a MAML algorithm with mixed objective function ( OMAML ) was proposed for solving raised POMDPs while simultaneously enhancing the present method with the ability to balance flight aggressiveness and safety. Finally, sufficient simulation experiments were conducted in comparison with the state-of-the-art methods both in trajectory tracking and collision avoidance tasks, so as to demonstrate the effectiveness of the proposed method.

Multi-Fidelity Reinforcement Learning for Time-Optimal Quadrotor Re-planning

Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight

Automatic Parameter Adaptation for Quadrotor Trajectory Planning

Efficient Sampling-based Multirotors Kinodynamic Planning with Fast Regional Optimization and Post Refining

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Multi-Task Reinforcement Learning for Quadrotors

A Reinforcement Learning Based Motion Planner for Quadrotor Autonomous Flight in Dense Environment

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

A RDA-Based Deep Reinforcement Learning Approach for Autonomous Motion Planning of UAV in Dynamic Unknown Environments

Re-planning of Quadrotors under Disturbance Based on Meta Reinforcement Learning.

RAPTOR: Robust and Perception-Aware Trajectory Replanning for Quadrotor Fast Flight

Data-driven Offline Reinforcement Learning Approach for Quadrotor’s Motion and Path Planning

Dashing for the Golden Snitch: Multi-Drone Time-Optimal Motion Planning with Multi-Agent Reinforcement Learning

Learning Real-Time Dynamic Responsive Gap-Traversing Policy for Quadrotors with Safety-Aware Exploration

High-Speed Trajectory Tracking Control for Quadrotors Via Deep Reinforcement Learning

Optimal Trajectory Generation for Quadrotor Teach-and-Repeat

Multi-Agent Reinforcement Learning for the Low-Level Control of a Quadrotor UAV

Time-Optimal Planning for Quadrotor Waypoint Flight

End-to-end Reinforcement Learning for Time-Optimal Quadcopter Flight

Real-time Planning of Minimum-time Trajectories for Agile UAV Flight

Efficient and Robust Time-Optimal Trajectory Planning and Control for Agile Quadrotor Flight