Abstract:The use of the ensemble smoother (ES) instead of the ensemble Kalman filter increases the nonlinearity of the update step during data assimilation and the need for iterative assimilation methods. A previous version of the iterative ensemble smoother based on Gauss–Newton formulation was able to match data relatively well but only after a large number of iterations. A multiple data assimilation method (MDA) was generally more efficient for large problems but lacked ability to continue “iterating” if the data mismatch was too large. In this paper, we develop an efficient, iterative ensemble smoother algorithm based on the Levenberg–Marquardt (LM) method of regularizing the update direction and choosing the step length. The incorporation of the LM damping parameter reduces the tendency to add model roughness at early iterations when the update step is highly nonlinear, as it often is when all data are assimilated simultaneously. In addition, the ensemble approximation of the Hessian is modified in a way that simplifies computation and increases stability. We also report on a simplified algorithm in which the model mismatch term in the updating equation is neglected. We thoroughly evaluated the new algorithm based on the modified LM method, LM-ensemble randomized maximum likelihood (LM-EnRML), and the simplified version of the algorithm, LM-EnRML (approx), on three test cases. The first is a highly nonlinear single-variable problem for which results can be compared against the true conditional pdf. The second test case is a one-dimensional two-phase flow problem in which the permeability of 31 grid cells is uncertain. In this case, Markov chain Monte Carlo results are available for comparison with ensemble-based results. The third test case is the Brugge benchmark case with both 10 and 20 years of history. The efficiency and quality of results of the new algorithms were compared with the standard ES (without iteration), the ensemble-based Gauss–Newton formulation, the standard ensemble-based LM formulation, and the MDA. Because of the high level of nonlinearity, the standard ES performed poorly on all test cases. The MDA often performed well, especially at early iterations where the reduction in data mismatch was quite rapid. The best results, however, were always achieved with the new iterative ensemble smoother algorithms, LM-EnRML and LM-EnRML (approx).

Study of Correlation Effects in the High Formal Oxidation State Compound Sr$_2$CoO$_4$

A fast, single-iteration ensemble Kalman smoother for sequential data assimilation

Ensemble transport smoothing. Part I: Unified framework

Ensemble transport smoothing. Part II: Nonlinear updates

Flexible Iterative Ensemble Smoother for Calibration of Perfect and Imperfect Models

Adaptive Multifidelity Data Assimilation for Nonlinear Subsurface Flow Problems

A Localized Ensemble Kalman Smoother

Ensemble Randomized Maximum Likelihood Method as an Iterative Ensemble Smoother

Fast Bivariate Penalized Splines: the Sandwich Smoother

Sampling error mitigation through spectrum smoothing: first experiments with ensemble transform Kalman filters and Lorenz models

Iterative ensemble smoothers for data assimilation in coupled nonlinear multiscale models

Accurate Smoothing Methods for State Estimation of Continuous-Discrete Nonlinear Dynamic Systems

Variable structure multiple model fixed-interval smoothing

Levenberg–Marquardt forms of the iterative ensemble smoother for efficient history matching and uncertainty quantification

Revising the stochastic iterative ensemble smoother

An Adaptive Online Smoother with Closed-Form Solutions and Information-Theoretic Lag Selection for Conditional Gaussian Nonlinear Systems

Smoothing and parameter estimation by soft-adherence to governing equations

Analysis of iterative ensemble smoothers for solving inverse problems

Fast Distributed Smoothing of Relative Measurements.

Doubly Robust Smoothing of Dynamical Processes via Outlier Sparsity Constraints

Data Assimilation by Use of the Iterative Ensemble Smoother for 2D Facies Models