Abstract:Abstract. Atmospheric inverse modeling describes the process of estimating greenhouse gas fluxes or air pollution emissions at the Earth's surface using observations of these gases collected in the atmosphere. The launch of new satellites, the expansion of surface observation networks, and a desire for more detailed maps of surface fluxes has yielded numerous computational and statistical challenges for standard inverse modeling frameworks that were often originally designed with much smaller data sets in mind. In this article, we discuss computationally efficient methods for large-scale atmospheric inverse modeling and focus on addressing some of the main computational and practical challenges. We develop generalized hybrid projection methods, which are iterative methods for solving large-scale inverse problems, and specifically we focus on the case of estimating surface fluxes. These algorithms confer several advantages. They are efficient, in part because they converge quickly, they exploit efficient matrix-vector multiplications, and do not require inverting any matrices. These methods are also robust because they can accurately reconstruct surface fluxes, they are automatic since regularization or covariance matrix parameters and stopping criteria can be determined as part of the iterative algorithm, and they are flexible because they can be paired with many different types of atmospheric models. We demonstrate the benefits of generalized hybrid methods with a case study from NASA's Orbiting Carbon Observatory 2 (OCO-2) satellite. We then address the more challenging problem of solving the inverse model when the mean of the surface fluxes is not known a priori; we do so by reformulating the problem, thereby extending the applicability of hybrid projection methods to include hierarchical priors. We further show that by exploiting mathematical relations provided by the generalized hybrid method, we can efficiently calculate an approximate posterior variance, thereby providing uncertainty information.

Computer Model Emulation with High-Dimensional Functional Output in Large-Scale Observing System Uncertainty Experiments

Neural Network Emulation of Spatio-temporal Data Using Linear and Nonlinear Dimensionality Reduction

Emulation of Multivariate Simulators Using Thin-Plate Splines with Application to Atmospheric Dispersion

Hierarchical Bayesian Emulation of the Expected Net Present Value Utility Function via a Multi-Model Ensemble Member Decomposition

As Simple as Possible but No Simpler: Optimizing the Performance of Neural Net Emulators for Galaxy SED Fitting

A Geospatial Functional Model For OCO-2 Data with Application on Imputation and Land Fraction Estimation

Bayesian Emulation for Computer Models with Multiple Partial Discontinuities

A Forecast Test for Reducing Dynamical Dimensionality of Model Emulators

Solving High-Dimensional Inverse Problems with Auxiliary Uncertainty via Operator Learning with Limited Data

Deep Gaussian Process Emulation and Uncertainty Quantification for Large Computer Experiments

ROSE: A reduced-order scattering emulator for optical models

Model calibration using ESEm v1.0.0 -- an open, scalable Earth System Emulator

Validation of the forecast skill of the Global Modeling and Assimilation Office Observing System Simulation Experiment

Evolving Bayesian Emulators for Structured Chaotic Time Series, with Application to Large Climate Models

A feature mapping strategy of metamodelling for nonlinear stochastic dynamical systems with low to high-dimensional input uncertainties

Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification

Opportunistic Emulation of Computationally Expensive Simulations via Deep Learning

Evaluating the Accuracy of Gaussian Approximations in VSWIR Imaging Spectroscopy Retrievals

A Fast and Calibrated Computer Model Emulator: An Empirical Bayes Approach

Computationally efficient methods for large-scale atmospheric inverse modeling

A Neural Emulator for Uncertainty Estimation of Fire Propagation