Abstract:This paper focuses on utilizing deep reinforcement learning (DRL) to achieve the precision landing of an autonomous parafoil system. Specifically, we present an integrated guidance and control algorithm realized by a policy network, which maps the state observation collected by the onboard sensor to the flap deflection control command. The reward function is designed to guide the policy network in minimizing both the touchdown error and the terminal anti-wind angle of the parafoil system. To ensure a smooth control profile during the time interval, an action space parameterization method based on Lagrange interpolation is proposed. On this basis, the policy network is trained by the proximal policy optimization algorithm, a type of on-policy DRL method. The parafoil dynamics are described using the six-degree-of-freedom model. Randomly distributed initial conditions are considered to account for the accumulated guidance error prior to terminal landing. Additionally, the Dryden wind disturbance is incorporated to account for the uncertainty of the wind field. The numerical results demonstrate that: i) The trained policy network effectively provides a smooth control profile for the autonomous parafoil system; ii) the policy network exhibits the potential to provide real-time command; iii) The integrated guidance and control algorithm based on DRL successfully enables precise terminal landing of the parafoil system, with a mean touchdown error smaller than 100m. The findings from this study will benefit the design of guidance and control algorithms for future autonomous parafoil systems employed in payload recovery missions or space exploration missions.

Homing control of parafoil systems in unknown wind environments

Optimal homing trajectory design for parafoil systems using sensitivity analysis approach

In-flight Wind Field Identification and Prediction of Parafoil Systems

Active disturbance rejection control (ADRC)-based autonomous homing control of powered parafoils

Trajectory Tracking Control for Flapping-wing UAV Based on Model-Free Predictive Control

A Generalized Predictive Control-Based Path Following Method for Parafoil Systems in Wind Environments

Path Following Control of Parafoil System Based on SGLOS and Improved ADRC Tuned by MSMPA

Sideslip Angle Estimation Based Active Disturbance Rejection 3D Trajectory Tracking Control for Powered Parafoil System and Hardware-in-the-loop Simulation Verification

Trajectory Tracking Control for Differential-Driven Unmanned Surface Vessels Considering Propeller Servo Loop

Dynamic-model-based closed-loop guidance and control for heavy parafoil system precision landing

Development of integrated computer environment for numerical optimization and simulation toward autonomous parafoil delivery

Sliding mode control of trajectory tracking for underactuated aerostat

Trajectory tracking control of powered parafoil without velocity feedback

NSGAII based multi-objective homing trajectory planning of parafoil system

Synchronize the Parafoil and the Vessel: A Hierarchical Distributed Nonlinear Model Predictive Control Approach

Research on Intelligent Collaboration and Obstacle Avoidance Control of Multiple Parafoils System

Precision Landing of Autonomous Parafoil System Via Deep Reinforcement Learning

Trajectory tracking control of powered parafoil system based on sliding mode control in a complex environment

Trajectory Optimization for Collaborative Recovery of Parafoil Systems Using Unmanned Vessel

Research on parafoil optimal flight path planning algorithm for precise recovery of sub-stage booster of rocket

Autonomous parafoil precision landing using convex real-time optimized guidance and control