Abstract:The stratospheric airship, as a near-space vehicle, is increasingly utilized in scientific exploration and Earth observation due to its long endurance and regional observation capabilities. However, due to the complex characteristics of the stratospheric wind field environment, trajectory planning for stratospheric airships is a significant challenge. Unlike lower atmospheric levels, the stratosphere presents a wind field characterized by significant variability in wind speed and direction, which can drastically affect the stability of the airship's trajectory. Recent advances in deep reinforcement learning (DRL) have presented promising avenues for trajectory planning. DRL algorithms have demonstrated the ability to learn complex control strategies autonomously by interacting with the environment. In particular, the proximal policy optimization (PPO) algorithm has shown effectiveness in continuous control tasks and is well suited to the non-linear, high-dimensional problem of trajectory planning in dynamic environments. This paper proposes a trajectory planning method for stratospheric airships based on the PPO algorithm. The primary contributions of this paper include establishing a continuous action space model for stratospheric airship motion; enabling more precise control and adjustments across a broader range of actions; integrating time-varying wind field data into the reinforcement learning environment; enhancing the policy network's adaptability and generalization to various environmental conditions; and enabling the algorithm to automatically adjust and optimize flight paths in real time using wind speed information, reducing the need for human intervention. Experimental results show that, within its wind resistance capability, the airship can achieve long-duration regional station-keeping, with a maximum station-keeping time ratio (STR) of up to 0.997.

Mode-Free Altitude Control for Airship Based on Q-Learning and Cmac Network

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

A Hybrid Control Method for an Unmanned Scale Helicopter Attitude

Adaptive Attitude Control For An Unmanned Scale Helicopter In Hover

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

Modeling and control of unmanned finless airship with robotic arms

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Robust Adaptive General Formation Control of a Class of Networked Quadrotor Aircraft

Learning-based adaptive neural control for safer navigation of unmanned surface vehicle with variable mass

Coordinated Symmetrical Altitude Position and Attitude Control for Stratospheric Airship Subject to Strong Aerodynamic Uncertainties

Neural Longitudinal Control of Hypersonic Vehicles with Constrained Aerodynamic Surfaces

Adaptive Multi-Surface Sliding Mode Control with Radial Basis Function Neural Networks and Reinforcement Learning for Multirotor Slung Load Systems

A Novel Adaptive Backstepping Sliding Mode Control for a Lightweight Autonomous Underwater Vehicle with Input Saturation

Unified Backstepping Sliding Mode Framework for Airship Control Design

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

A Learning-based Intelligent Control Method for Hypersonic Flight Vehicle

Autonomous Hovering Control and Test for Micro Air Vehicle

Autonomous Trajectory Planning Method for Stratospheric Airship Regional Station-Keeping Based on Deep Reinforcement Learning

Hierarchical Meta-learning-based Adaptive Controller

Adaptive Neural Network Iterative Sliding Mode Course Tracking Control for Unmanned Surface Vessels

Observer based incremental backstepping terminal sliding-mode control with learning rate for a multi-vectored propeller airship