Abstract:Inverse models arise in various environmental applications, ranging from atmospheric modeling to geosciences. Inverse models can often incorporate predictor variables, similar to regression, to help estimate natural processes or parameters of interest from observed data. Although a large set of possible predictor variables may be included in these inverse or regression models, a core challenge is to identify a small number of predictor variables that are most informative of the model, given limited observations. This problem is typically referred to as model selection. A variety of criterion-based approaches are commonly used for model selection, but most follow a two-step process: first, select predictors using some statistical criteria, and second, solve the inverse or regression problem with these predictor variables. The first step typically requires comparing all possible combinations of candidate predictors, which quickly becomes computationally prohibitive, especially for large-scale problems. In this work, we develop a one-step approach for linear inverse modeling, where model selection and the inverse model are performed in tandem. We reformulate the problem so that the selection of a small number of relevant predictor variables is achieved via a sparsity-promoting prior. Then, we describe hybrid iterative projection methods based on flexible Krylov subspace methods for efficient optimization. These approaches are well-suited for large-scale problems with many candidate predictor variables. We evaluate our results against traditional, criteria-based approaches. We also demonstrate the applicability and potential benefits of our approach using examples from atmospheric inverse modeling based on NASA's Orbiting Carbon Observatory-2 (OCO-2) satellite.

Efficient iterative methods for hyperparameter estimation in large-scale linear inverse problems

Efficient generalized Golub-Kahan based methods for dynamic inverse problems

Efficient hyperparameter estimation in Bayesian inverse problems using sample average approximation

Generalized hybrid iterative methods for large-scale Bayesian inverse problems

Inexact Generalized Golub-Kahan Methods for Large-Scale Bayesian Inverse Problems

Bayesian Inference and Deep Learning for Inverse Problems

Optimization-Based MCMC Methods for Nonlinear Hierarchical Statistical Inverse Problems

Convergence of Gaussian Process Regression with Estimated Hyper-Parameters and Applications in Bayesian Inverse Problems

Projected Newton method for large-scale Bayesian linear inverse problems

Computational Methods for Large-Scale Inverse Problems: A Survey on Hybrid Projection Methods

A computational framework for infinite-dimensional Bayesian inverse problems. Part I: The linearized case, with application to global seismic inversion

Change of Measure for Bayesian Field Inversion with Hierarchical Hyperparameters Sampling

A greedy sensor selection algorithm for hyperparameterized linear Bayesian inverse problems with correlated noise models

A data-driven and model-based accelerated Hamiltonian Monte Carlo method for Bayesian elliptic inverse problems

Optimal design of large-scale nonlinear Bayesian inverse problems under model uncertainty

Posterior Contraction for Empirical Bayesian Approach to Inverse Problems under Non-Diagonal Assumption

A joint reconstruction and model selection approach for large-scale linear inverse modeling (msHyBR v2)

Adaptive operator learning for infinite-dimensional Bayesian inverse problems

Variance-based sensitivity of Bayesian inverse problems to the prior distribution

Efficient Bayesian Physics Informed Neural Networks for inverse problems via Ensemble Kalman Inversion

Towards a variational principle for motivated vehicle motion