Reinforcement Learning-Based Integrated Decision-Making and Control for Morphing Flight Vehicles Under Aerodynamic Uncertainties
Zongyi Guo,Shiyuan Cao,Ruizhe Yuan,Jianguo Guo,Yuan Zhang,Jingyuan Li,Guanjie Hu,Yonglin Han
DOI: https://doi.org/10.1109/TAES.2024.3440969
IF: 3.491
2024-01-01
IEEE Transactions on Aerospace and Electronic Systems
Abstract:This paper presents an integrated decision-making and control framework of morphing flight vehicles with variable-span wings in the glide phase. The proposed framework comprehensively consists of morphing strategy, attitude control and online aerodynamic uncertainties estimate, thus outperforms existing works at its capacity of adequately considering the interaction between morphing mechanism and control design. Furthermore, the introduction of deep deterministic policy gradient (DDPG) algorithm has the effect of reducing the dependence on a precise model to some extent. By introducing aerodynamic uncertainties into the training environment and employing estimate, the framework enhances decision-making adaptability. Additionally, the decision-making method is designed to optimal a comprehensive performance index including lift-to-drag ratio and attitude tracking effect, thus ensuring the physical realisability. The effectiveness of decision-making and control is validated by simulation results.