Abstract:Precise arbitrary trajectory tracking for quadrotors is challenging due to unknown nonlinear dynamics, trajectory infeasibility, and actuation limits. To tackle these challenges, we present Deep Adaptive Trajectory Tracking (DATT), a learning-based approach that can precisely track arbitrary, potentially infeasible trajectories in the presence of large disturbances in the real world. DATT builds on a novel feedforward-feedback-adaptive control structure trained in simulation using reinforcement learning. When deployed on real hardware, DATT is augmented with a disturbance estimator using L1 adaptive control in closed-loop, without any fine-tuning. DATT significantly outperforms competitive adaptive nonlinear and model predictive controllers for both feasible smooth and infeasible trajectories in unsteady wind fields, including challenging scenarios where baselines completely fail. Moreover, DATT can efficiently run online with an inference time less than 3.2 ms, less than 1/4 of the adaptive nonlinear model predictive control baseline

What problem does this paper attempt to address?

The paper attempts to address the challenge of accurately tracking arbitrary trajectories for quadrotor drones under unknown nonlinear dynamics, trajectory infeasibility, and actuator limitations. Specifically, the authors propose a deep learning-based method called Deep Adaptive Trajectory Tracking (DATT), which aims to improve the trajectory tracking accuracy of quadrotor drones in complex environments, especially in the presence of significant disturbances. ### Main Issues: 1. **Unknown Nonlinear Dynamics**: The dynamics of quadrotor drones are highly nonlinear and underactuated. System parameters (such as motor characteristics) and environmental factors (such as unknown wind disturbances) are difficult to model accurately. 2. **Trajectory Infeasibility**: Some desired trajectories may be physically infeasible, requiring long-term prediction and optimization to approximate these trajectories. 3. **Actuator Limitations**: Aggressive trajectories demand operation at the system's performance limits, necessitating consideration and handling of actuator constraints, particularly for quadrotor drones with low thrust-to-weight ratios. 4. **Environmental Disturbances**: Various uncertain disturbances exist in real environments, such as wind disturbances, which affect the accuracy of trajectory tracking. ### Solution: DATT combines a feedforward-feedback-adaptive control structure and uses reinforcement learning for training in simulation, enabling effective deployment on real hardware without the need for fine-tuning. Specifically: - **Feedforward-Feedback-Adaptive Control Structure**: During training in simulation, DATT uses reinforcement learning to learn a neural network controller that can perform feedforward and feedback control based on the desired reference trajectory and estimated disturbances. - **Disturbance Estimation**: During actual deployment, DATT uses L1 adaptive control to estimate disturbances online and inputs these estimates into the controller to enhance the robustness of trajectory tracking. - **Efficient Operation**: DATT can run efficiently on real hardware, with an inference time of less than 3.2 milliseconds, significantly lower than traditional adaptive nonlinear model predictive control methods. ### Experimental Results: - **Trajectory Tracking Without Disturbances**: DATT shows significantly lower tracking errors on smooth and infeasible trajectories compared to other baseline methods, with much lower computational costs than model predictive control (MPC). - **Adaptation Performance in Unknown Wind Fields and with Drag Plates**: DATT can zero-shot generalize to complex dynamic environments under unknown wind fields and additional drag plates, demonstrating superior tracking performance compared to other baseline methods. In summary, the paper successfully addresses the problem of accurate trajectory tracking for quadrotor drones in complex environments, particularly in the presence of disturbances and trajectory infeasibility, by proposing the DATT method.

DATT: Deep Adaptive Trajectory Tracking for Quadrotor Control

Efficient Learning-based Trajectory Tacker for Quadrotor at High-speed Flight

Reinforcement Learning‐based Tracking Control for a Quadrotor Unmanned Aerial Vehicle under External Disturbances

Deep Neural Networks for Improved, Impromptu Trajectory Tracking of Quadrotors

Extended State Observer-Based Finite-Time Dynamic Surface Control for Trajectory Tracking of a Quadrotor Unmanned Aerial Vehicle.

Cascaded Trajectory Tracking Control for A Quadcopter UAV with Consideration of Actuator Dynamics

Event-Triggered Deep Learning Control of Quadrotors for Trajectory Tracking

D-Tracking: Digital Twin Enabled Trajectory Tracking System of Autonomous Vehicles

Learning Trajectories for Real- Time Optimal Control of Quadrotors.

Augmented L-1 Adaptive Tracking Control of Quad-Rotor Unmanned Aircrafts

A Novel Approach for Trajectory Tracking Control of an Under-Actuated Quad-Rotor UAV

Adaptive Artificial Time Delay Control for Quadrotors under State-dependent Unknown Dynamics

Robust Approximate Optimal Trajectory Tracking Control for Quadrotors

Event-Triggered Learning-Based Control of Quadrotors for Accurate Agile Trajectory Tracking

Adaptive Fault Tolerant Control for Trajectory Tracking of a Quadrotor Helicopter

High-Speed Trajectory Tracking Control for Quadrotors Via Deep Reinforcement Learning

Trajectory Tracking Control Design with Command-Filtered Compensation for a Quadrotor

Hybrid Finite-Time Trajectory Tracking Control of a Quadrotor.

Discrete-Time Adaptive Neural Tracking Control and Its Experiments for Quadrotor Unmanned Aerial Vehicle Systems

Adaptive Trajectory Tracking Control of Output Constrained Multi-Rotors Systems

Robust adaptive finite-time trajectory tracking control of a quadrotor aircraft