Abstract:Executing precise and agile flight maneuvers is critical for quadrotors in various applications. Traditional quadrotor control approaches are limited by their reliance on flat trajectories or time-consuming optimization, which restricts their flexibility. Recently, RL-based policy has emerged as a promising alternative due to its ability to directly map observations to actions, reducing the need for detailed system knowledge and actuation constraints. However, a significant challenge remains in bridging the sim-to-real gap, where RL-based policies often experience instability when deployed in real world. In this paper, we investigate key factors for learning robust RL-based control policies that are capable of zero-shot deployment in real-world quadrotors. We identify five critical factors and we develop a PPO-based training framework named SimpleFlight, which integrates these five techniques. We validate the efficacy of SimpleFlight on Crazyflie quadrotor, demonstrating that it achieves more than a 50% reduction in trajectory tracking error compared to state-of-the-art RL baselines, and achieves 70% improvement over the traditional MPC. The policy derived by SimpleFlight consistently excels across both smooth polynominal trajectories and challenging infeasible zigzag trajectories on small thrust-to-weight quadrotors. In contrast, baseline methods struggle with high-speed or infeasible trajectories. To support further research and reproducibility, we integrate SimpleFlight into a GPU-based simulator Omnidrones and provide open-source access to the code and model checkpoints. We hope SimpleFlight will offer valuable insights for advancing RL-based quadrotor control. For more details, visit our project website at <a class="link-external link-https" href="https://sites.google.com/view/simpleflight/" rel="external noopener nofollow">this https URL</a>.

Motion Planning of a Quadrotor Robot Game Using a Simulation-Based Projected Policy Iteration Method

3D Path Planning of Quadrotor Aerial Robots Using Numerical Optimization

Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight

Polynomial-based Online Planning for Autonomous Drone Racing in Dynamic Environments

Internal and External Disturbances Aware Motion Planning and Control for Quadrotors

A Reinforcement Learning Based Motion Planner for Quadrotor Autonomous Flight in Dense Environment

Path Planning and Following Control of a Quadrotor Helicopter in Three-Dimensional Space With Limited Information

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

Real-time Motion Planning and Trajectory Tracking in Complex Environments Based on Bézier Curves and Nonlinear MPC Controller

Decision Planning Of A Quadrotor In Dynamical Environment

Global Path Planning of Quadrotor Using Reinforcement Learning

What Matters in Learning A Zero-Shot Sim-to-Real RL Policy for Quadrotor Control? A Comprehensive Study

Path Planning for Multi-Agent System in Games Via Behavior Prediction

Cooperative Motion Planning for Persistent 3D Visual Coverage with Multiple Quadrotor UAVs

Motion Simulation of Flying Quadruped Robot Based on Deep Reinforcement Learning

Motion Planning by Reinforcement Learning for an Unmanned Aerial Vehicle in Virtual Open Space with Static Obstacles

Robust Control Strategy for Quadrotor Drone Using Reference Model-Based Deep Deterministic Policy Gradient

A Model Predictive Path Integral Method for Fast, Proactive, and Uncertainty-Aware UAV Planning in Cluttered Environments

A Set-based Motion Planning Algorithm for Aerial Vehicles in the Presence of Obstacles Exhibiting Hybrid Dynamics

PE-Planner: A Performance-Enhanced Quadrotor Motion Planner for Autonomous Flight in Complex and Dynamic Environments

Learning Agile Flight Maneuvers: Deep SE(3) Motion Planning and Control for Quadrotors