Abstract:Abstract. Spatially representative estimates of surface energy exchange from field measurements are required for improving and validating Earth system models and satellite remote sensing algorithms. The scarcity of flux measurements can limit understanding of ecohydrological responses to climate warming, especially in remote regions with limited infrastructure. Direct field measurements often apply the eddy covariance method on stationary towers, but recently, drone-based measurements of temperature, humidity, and wind speed have been suggested as a viable alternative to quantify the turbulent fluxes of sensible (H) and latent heat (LE). A data assimilation framework to infer uncertainty-aware surface flux estimates from sparse and noisy drone-based observations is developed and tested using a turbulence-resolving large eddy simulation (LES) as a forward model to connect surface fluxes to drone observations. The proposed framework explicitly represents the sequential collection of drone data, accounts for sensor noise, includes uncertainty in boundary and initial conditions, and jointly estimates the posterior distribution of a multivariate parameter space. Assuming typical flight times and observational errors of light-weight, multi-rotor drone systems, we first evaluate the information gain and performance of different ensemble-based data assimilation schemes in experiments with synthetically generated observations. It is shown that an iterative ensemble smoother outperforms both the non-iterative ensemble smoother and the particle batch smoother in the given problem, yielding well-calibrated posterior uncertainty with continuous ranked probability scores of 12 W m−2 for both H and LE, with standard deviations of 37 W m−2 (H) and 46 W m−2 (LE) for a 12 min vertical step profile by a single drone. Increasing flight times, using observations from multiple drones, and further narrowing the prior distributions of the initial conditions are viable for reducing the posterior spread. Sampling strategies prioritizing space–time exploration without temporal averaging, instead of hovering at fixed locations while averaging, enhance the non-linearities in the forward model and can lead to biased flux results with ensemble-based assimilation schemes. In a set of 18 real-world field experiments at two wetland sites in Norway, drone data assimilation estimates agree with independent eddy covariance estimates, with root mean square error values of 37 W m−2 (H), 52 W m−2 (LE), and 58 W m−2 (H+LE) and correlation coefficients of 0.90 (H), 0.40 (LE), and 0.83 (H+LE). While this comparison uses the simplifying assumptions of flux homogeneity, stationarity, and flat terrain, it is emphasized that the drone data assimilation framework is not confined to these assumptions and can thus readily be extended to more complex cases and other scalar fluxes, such as for trace gases in future studies.

Using reinforcement learning to improve drone-based inference of greenhouse gas fluxes

Guiding drones by information gain

Navigating the Smog: A Cooperative Multi-Agent RL for Accurate Air Pollution Mapping through Data Assimilation

Inferring surface energy fluxes using drone data assimilation in large eddy simulations

Adaptive Informative Path Planning Using Deep Reinforcement Learning for UAV-based Active Sensing

Autonomous Single-Image Drone Exploration With Deep Reinforcement Learning and Mixed Reality

Using Reinforcement Learning to Improve Airspace Structuring in an Urban Environment

Deep Reinforcement Learning for Carbon Emissions Detection Based on Pseudo-Count Exploration

AirRL: A Reinforcement Learning Approach to Urban Air Quality Inference

Short vs. Long-term Coordination of Drones: When Distributed Optimization Meets Deep Reinforcement Learning

Learning to Fly via Deep Model-Based Reinforcement Learning

RAIN: Reinforcement Algorithms for Improving Numerical Weather and Climate Models

Deep reinforcement learning for drone navigation using sensor data

Navigation in a simplified Urban Flow through Deep Reinforcement Learning

UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach

Learning to Seek: Autonomous Source Seeking with Deep Reinforcement Learning Onboard a Nano Drone Microcontroller

LiDAR-based drone navigation with reinforcement learning

Multi-objective reinforcement learning for autonomous drone navigation in urban areas with wind zones

Reinforcement Learning-Based Drone Simulators: Survey, Practice, and Challenge

A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Platform