Abstract:Abstract Low-fidelity engineering-level dynamic models are commonly employed while designing uncrewed aircraft flight controllers due to their rapid development and cost-effectiveness. However, during adverse conditions, or complex path-following missions, the uncertainties in low-fidelity models often result in suboptimal controller performance. Aircraft system identification techniques offer alternative methods for finding higher fidelity dynamic models but can be restrictive in flight test requirements and procedures. This challenge is exacerbated when there is no pilot onboard. This work introduces data-driven machine learning (ML) to enhance the fidelity of aircraft dynamic models, overcoming the limitations of conventional system identification. A large dataset from twelve previous flights, is utilized within an ML framework to create a long short-term memory (LSTM) model for the aircraft's lateral-directional dynamics. A deep RL-based flight controller is developed using a randomized dynamic domain created using the LSTM and physics-based models to quantify the impact of LSTM dynamic model improvements on controller performance. The RL controller performance is compared to other modern controller techniques in four actual flight tests in the presence of exogenous disturbances and noise, assessing its tracking capabilities and its ability to reject disturbances. The RL controller with a randomized dynamic domain outperforms an RL controller trained using only the engineering-level dynamic model, a linear quadratic regulator controller, and an L1 adaptive controller. Notably, it demonstrated up to 72% improvements in lateral tracking when the aircraft had to follow challenging paths and during intentional adverse onboard conditions.

A deep reinforcement learning control approach for high-performance aircraft

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Deep Reinforcement-Learning-Based Air-Combat-Maneuver Generation Framework

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Deep Reinforcement Learning-Based Diving/Pull-out Control for Bioinspired Morphing UAVs.

Deep Reinforcement Learning With Application to Air Confrontation Intelligent Decision-Making of Manned/Unmanned Aerial Vehicle Cooperative System

Reinforcement Learning for UAV Attitude Control

Precision Landing of Autonomous Parafoil System Via Deep Reinforcement Learning

Deep Reinforcement Learning Automatic Landing Control of Fixed-Wing Aircraft Using Deep Deterministic Policy Gradient

Intelligent Lateral Control of a Canard Rotor/Wing Aircraft Based on Reinforcement Learning

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

A Control Method for Aero-engine Based on Reinforcement Learning

Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experiments

A Domain-Knowledge-Aided Deep Reinforcement Learning Approach for Flight Control Design

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Deep reinforcement learning for aircraft longitudinal control augmentation system

Hypersonic Vehicle Control Based on Deep Reinforcement Learning

Impact-Angle Constraint Guidance and Control Strategies Based on Deep Reinforcement Learning

Data-Driven Aircraft Modeling for Robust RL Control Synthesis with Flight Test Validation

Robust Control Strategy for Quadrotor Drone Using Reference Model-Based Deep Deterministic Policy Gradient

Active Disturbance Rejection Control Based on Deep Reinforcement Learning of PMSM for More Electric Aircraft