Ensemble flow reconstruction in the atmospheric boundary layer from spatially limited measurements through latent diffusion models

Alex Rybchuk,Malik Hassanaly,Nicholas Hamilton,Paula Doubrawa,Mitchell J. Fulton,Luis A. Martínez-Tossas
DOI: https://doi.org/10.1063/5.0172559
2023-12-12
Abstract:Due to costs and practical constraints, field campaigns in the atmospheric boundary layer typically only measure a fraction of the atmospheric volume of interest. Machine learning techniques have previously successfully reconstructed unobserved regions of flow in canonical fluid mechanics problems and two-dimensional geophysical flows, but these techniques have not yet been demonstrated in the three-dimensional atmospheric boundary layer. Here, we conduct a numerical analogue of a field campaign with spatially limited measurements using large-eddy simulation. We pose flow reconstruction as an inpainting problem, and reconstruct realistic samples of turbulent, three-dimensional flow with the use of a latent diffusion model. The diffusion model generates physically plausible turbulent structures on larger spatial scales, even when input observations cover less than 1% of the volume. Through a combination of qualitative visualization and quantitative assessment, we demonstrate that the diffusion model generates meaningfully diverse samples when conditioned on just one observation. These samples successfully serve as initial conditions for a large-eddy simulation code. We find that diffusion models show promise and potential for other applications for other turbulent flow reconstruction problems.
Atmospheric and Oceanic Physics,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to reconstruct the three - dimensional turbulent field from limited spatial measurement data in the atmospheric boundary layer. Due to cost and practical limitations, field investigations in the atmospheric boundary layer can usually only measure a small part of the large - volume gas of interest. Traditional machine - learning techniques have successfully reconstructed unobserved areas in classical fluid - mechanics problems and two - dimensional geophysical flows, but these techniques have not yet been verified in the three - dimensional atmospheric boundary layer. In this paper, by using large - eddy simulation (LES) to construct a numerically - simulated field investigation, a fluid - reconstruction method based on the latent diffusion model (LDM) is proposed to solve this problem. Specifically, the paper explores the following three key challenges: 1. **Probabilistic Reconstruction**: Different from most deterministic fluid - reconstruction studies, this paper attempts to perform reconstruction in a probabilistic manner, that is, generating multiple possible states instead of a single deterministic state. 2. **Handling Spatially - Limited Measurements**: The method proposed in the paper can reconstruct the entire three - dimensional flow field with only a small amount of observational data (less than 1% of the volume). 3. **Converting from Scalar Measurements to All Three Velocity Components**: Many observational systems (such as Doppler lidar) can only measure one velocity component (for example, the streamwise velocity \( u \)), while the method in this paper can reconstruct all three velocity components \( (u, v, w) \) from these limited observational data. Through these efforts, the paper demonstrates the potential of LDM in dealing with the real - world problem of atmospheric - boundary - layer fluid - reconstruction and provides a basis for further applications.