Abstract:Autonomous ballooning allows for energy-efficient long-range missions but introduces significant challenges for planning and control algorithms, due to their single degree of actuation: vertical rate control through either buoyancy or vertical thrust. Lateral motion is typically due to the wind; thus, balloon flight is both nonholonomic and often stochastic. Finally, wind is very challenging to sense remotely, and estimates are often available only via low-temporal-and-spatial-frequency predictions from large-scale weather models and direct in situ measurements. In this work, reinforcement learning (RL) is used to generate a control policy for an autonomous balloon navigating between 3D positions in a time- and spatially varying wind field. The agent uses its position and velocity, the relative position of the target, and an estimate of the surrounding wind field to command a target altitude. The wind information contains local measurements and an encoding of global wind predictions from a large-scale numerical weather prediction (NWP) model around the current balloon location. The RL algorithm used in this work, the soft actor–critic (SAC), is trained with a reward favoring paths that reach as close as possible to the target, with minimum time and actuation costs. We evaluate our approach first in simulation and then with a controlled indoor experiment, where we generate an artificial wind field and reach a median distance of 23.4 cm from the target within a volume of 3.5 × 3.5 × 3.5 m over 30 trials. Finally, using a fully autonomous custom designed outdoor prototype capable of controlling altitude, long-range communication, redundant localization, and onboard computation, we validate our approach in a real-world setting. Over six flights, the agent navigates to predefined target positions, with an average target distance error of 360 m after traveling approximately 10 km within a volume of 22 × 22 × 3.2 km.

A Roadmap For Scientific Ballooning 2020-2030

The Pico Balloon Archive: Establishing the First Super Pressure Balloon Satellite Network for Atmospheric Research

Particle Astrophysics in NASA's Long Duration Balloon Program

Exoplanet Exploration Program Analysis Group (ExoPAG) Report to Paul Hertz Regarding Large Mission Concepts to Study for the 2020 Decadal Survey

Astro2020 APC White Paper: SmallSats for Astrophysics

An Overview of High-Altitude Balloon Experiments at the Indian Institute of Astrophysics

Model Predictive Loitering and Trajectory Tracking of Suspended Payloads in Cable-Driven Balloons Using UGVs

Trajectories of Rubber Balloons used in Balloon Releases: Theory and Application

Trajectories of long duration balloons launched from McMurdo Station in Antarctica

Reinforcement Learning for Outdoor Balloon Navigation: A Successful Controller for an Autonomous Balloon

From SuperBIT to GigaBIT: Informing next-generation balloon-borne telescope design with Fine Guidance System flight data

Enduring Quests-Daring Visions (NASA Astrophysics in the Next Three Decades)

The Balloon-Borne Large Aperture Submillimeter Telescope Observatory

Ocean Worlds Exploration and the Search for Life

UK Astronomy Science and Technology Roadmap: STFC Astronomy Advisory Panel Roadmap 2022

POEMMA-Balloon with Radio: a balloon-born multi-messenger multi-detector observatory

GNSS Radio Occultation on Aerial Platforms with Commercial Off-The-Shelf Receivers

Early Career Perspectives For the NASA SMD Bridge Program

Airships: A New Horizon for Science

TIFR Zero-Pressure balloon program crosses a milestone

The Fluorescence Camera of the POEMMA-Balloon with Radio (PBR): Design and Scientific goals