Abstract:The stratospheric airship, as a near-space vehicle, is increasingly utilized in scientific exploration and Earth observation due to its long endurance and regional observation capabilities. However, due to the complex characteristics of the stratospheric wind field environment, trajectory planning for stratospheric airships is a significant challenge. Unlike lower atmospheric levels, the stratosphere presents a wind field characterized by significant variability in wind speed and direction, which can drastically affect the stability of the airship's trajectory. Recent advances in deep reinforcement learning (DRL) have presented promising avenues for trajectory planning. DRL algorithms have demonstrated the ability to learn complex control strategies autonomously by interacting with the environment. In particular, the proximal policy optimization (PPO) algorithm has shown effectiveness in continuous control tasks and is well suited to the non-linear, high-dimensional problem of trajectory planning in dynamic environments. This paper proposes a trajectory planning method for stratospheric airships based on the PPO algorithm. The primary contributions of this paper include establishing a continuous action space model for stratospheric airship motion; enabling more precise control and adjustments across a broader range of actions; integrating time-varying wind field data into the reinforcement learning environment; enhancing the policy network's adaptability and generalization to various environmental conditions; and enabling the algorithm to automatically adjust and optimize flight paths in real time using wind speed information, reducing the need for human intervention. Experimental results show that, within its wind resistance capability, the airship can achieve long-duration regional station-keeping, with a maximum station-keeping time ratio (STR) of up to 0.997.

Model-Free Control for Stratospheric Airship Based on Reinforcement Learning

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Sail-rudder Collaborative Control of Unmanned Sailboat Based on Reinforcement Learning

Three-Dimensional Path-Following Control of a Robotic Airship with Reinforcement Learning

Mode-Free Altitude Control for Airship Based on Q-Learning and Cmac Network

Airship Control Based on Q-Learning Algorithm and Neural Network

Trajectory Planning Based on Continuous Decision Deep Reinforcement Learning for Stratospheric Airship

Autonomous Trajectory Planning Method for Stratospheric Airship Regional Station-Keeping Based on Deep Reinforcement Learning

Path planning of stratospheric airship in dynamic wind field based on deep reinforcement learning

Control System of Autonomous Airship Based on Siding Mode Control and Neural Network

Model Predictive Control for Path Following of Stratospheric Airship with Magnitude and Rate Constrains of Rudder

Trajectory control method of stratospheric airships based on model predictive control in wind field

Model-free Based Reinforcement Learning Control Strategy of Aircraft Attitude Systems

Station-keeping for High-Altitude Balloon with Reinforcement Learning

Direct-adaptive fuzzy predictive control for path following of stratospheric airship

Integration of Path Planning and Following Control for the Stratospheric Airship with Forecasted Wind Field Data.

Hovering Control for an Underactuated Stratospheric Airship

Hovering Control for a Stratospheric Airship in Unknown Wind

A Distributed Adaptive Mixed Self-/Event-triggered Formation Control Approach for Multiple Stratospheric Airships with Relative State Constraints and Input Delay

Command-Filtered Backstepping Control for A Multi-Vectored Thrust Stratospheric Airship

Attitude Control Strategy of Airship Based on Active Disturbance Rejection Controller