Abstract:Autonomous ballooning allows for energy-efficient long-range missions but introduces significant challenges for planning and control algorithms, due to their single degree of actuation: vertical rate control through either buoyancy or vertical thrust. Lateral motion is typically due to the wind; thus, balloon flight is both nonholonomic and often stochastic. Finally, wind is very challenging to sense remotely, and estimates are often available only via low-temporal-and-spatial-frequency predictions from large-scale weather models and direct in situ measurements. In this work, reinforcement learning (RL) is used to generate a control policy for an autonomous balloon navigating between 3D positions in a time- and spatially varying wind field. The agent uses its position and velocity, the relative position of the target, and an estimate of the surrounding wind field to command a target altitude. The wind information contains local measurements and an encoding of global wind predictions from a large-scale numerical weather prediction (NWP) model around the current balloon location. The RL algorithm used in this work, the soft actor–critic (SAC), is trained with a reward favoring paths that reach as close as possible to the target, with minimum time and actuation costs. We evaluate our approach first in simulation and then with a controlled indoor experiment, where we generate an artificial wind field and reach a median distance of 23.4 cm from the target within a volume of 3.5 × 3.5 × 3.5 m over 30 trials. Finally, using a fully autonomous custom designed outdoor prototype capable of controlling altitude, long-range communication, redundant localization, and onboard computation, we validate our approach in a real-world setting. Over six flights, the agent navigates to predefined target positions, with an average target distance error of 360 m after traveling approximately 10 km within a volume of 22 × 22 × 3.2 km.

A method of 3-D region controlling for scientific balloon long-endurance flight in the real wind

Modeling and Control of the Pneumatic Constant Pressure System for Zero Gravity Simulation

Seasonal and geographic viability of high altitude balloon navigation

Longitudinal Control for Balloon-Borne Launched Solar Powered UAVs in Near-Space

Ascending Performance of Scientific Balloons with Buoyant Gas–Air Mixture Inflation for Designated Ceiling Height

Study on predictive control algorithm for horizon control

Development of integrated computer environment for numerical optimization and simulation toward autonomous parafoil delivery

Modelling And High-Precision Constant Pressure Control Of The Pneumatic Suspension System

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

Control System Design and Flight Testing for a Miniature Unmanned Helicopter

Analysis of Wind Field Response Characteristics of Tethered Balloon Systems

Application of Mass Particle Methods in the Shape Design for Scientific Balloons

Reinforcement Learning for Outdoor Balloon Navigation: A Successful Controller for an Autonomous Balloon

Station-Keeping Control of Stratospheric Balloons Based on Simultaneous Optimistic Optimization in Dynamic Wind

The Influence of Ice Accretion on the Thermodynamic Performance of a Scientific Balloon: A Simulation Study

Dynamics and control of a high-altitude balloon with slung load

High-altitude long-duration latex balloon venting valves

Design of the Controller for a Ground Simulation System of Spatial Microgravity Environment

Numerical simulation of postlaunching behaviors for a “balloon-borne UAV system”

A Study of Optimal Configuration and Control of A Multichamber Balloon for Intraaortic Balloon Pumping

Project of high altitude balloon launched micro glider: Aircraft design, control and flight test