Abstract:This paper focuses on utilizing deep reinforcement learning (DRL) to achieve the precision landing of an autonomous parafoil system. Specifically, we present an integrated guidance and control algorithm realized by a policy network, which maps the state observation collected by the onboard sensor to the flap deflection control command. The reward function is designed to guide the policy network in minimizing both the touchdown error and the terminal anti-wind angle of the parafoil system. To ensure a smooth control profile during the time interval, an action space parameterization method based on Lagrange interpolation is proposed. On this basis, the policy network is trained by the proximal policy optimization algorithm, a type of on-policy DRL method. The parafoil dynamics are described using the six-degree-of-freedom model. Randomly distributed initial conditions are considered to account for the accumulated guidance error prior to terminal landing. Additionally, the Dryden wind disturbance is incorporated to account for the uncertainty of the wind field. The numerical results demonstrate that: i) The trained policy network effectively provides a smooth control profile for the autonomous parafoil system; ii) the policy network exhibits the potential to provide real-time command; iii) The integrated guidance and control algorithm based on DRL successfully enables precise terminal landing of the parafoil system, with a mean touchdown error smaller than 100m. The findings from this study will benefit the design of guidance and control algorithms for future autonomous parafoil systems employed in payload recovery missions or space exploration missions.

Parafoil Trajectory Tracking Control Based on Data Expansion ADRC

Optimal homing trajectory design for parafoil systems using sensitivity analysis approach

Sliding mode control of trajectory tracking for underactuated aerostat

Active disturbance rejection control (ADRC)-based autonomous homing control of powered parafoils

Trajectory Tracking Control for Flapping-wing UAV Based on Model-Free Predictive Control

Trajectory Generation and Tracking Control for Flapping Wing Robot Three-Dimensional Flight

Path Following Control of Parafoil System Based on SGLOS and Improved ADRC Tuned by MSMPA

Sideslip Angle Estimation Based Active Disturbance Rejection 3D Trajectory Tracking Control for Powered Parafoil System and Hardware-in-the-loop Simulation Verification

Precision Landing of Autonomous Parafoil System Via Deep Reinforcement Learning

Trajectory tracking control of powered parafoil system based on sliding mode control in a complex environment

Synchronize the Parafoil and the Vessel: A Hierarchical Distributed Nonlinear Model Predictive Control Approach

Trajectory Optimization for Collaborative Recovery of Parafoil Systems Using Unmanned Vessel

Research on Intelligent Collaboration and Obstacle Avoidance Control of Multiple Parafoils System

Dynamic-model-based closed-loop guidance and control for heavy parafoil system precision landing

Precise Trajectory Tracking for UAV Based on Active Disturbance Rejection Control.

Trajectory Tracking of Robot Based on Adaptive Theory

Trajectory-tracking Hybrid Controller Based on ADRC and Adaptive Control Forunmanned Helicopters

A Generalized Predictive Control-Based Path Following Method for Parafoil Systems in Wind Environments

Trajectory tracking control of a quadrotor UAV under external disturbances based on linear ADRC

Adaptive event-triggered control for quadrotor aircraft with output constraints

Trajectory Tracking Control of Pneumatic Servo System: A Variable Gain ADRC Approach