Abstract:The use of the ensemble smoother (ES) instead of the ensemble Kalman filter increases the nonlinearity of the update step during data assimilation and the need for iterative assimilation methods. A previous version of the iterative ensemble smoother based on Gauss–Newton formulation was able to match data relatively well but only after a large number of iterations. A multiple data assimilation method (MDA) was generally more efficient for large problems but lacked ability to continue “iterating” if the data mismatch was too large. In this paper, we develop an efficient, iterative ensemble smoother algorithm based on the Levenberg–Marquardt (LM) method of regularizing the update direction and choosing the step length. The incorporation of the LM damping parameter reduces the tendency to add model roughness at early iterations when the update step is highly nonlinear, as it often is when all data are assimilated simultaneously. In addition, the ensemble approximation of the Hessian is modified in a way that simplifies computation and increases stability. We also report on a simplified algorithm in which the model mismatch term in the updating equation is neglected. We thoroughly evaluated the new algorithm based on the modified LM method, LM-ensemble randomized maximum likelihood (LM-EnRML), and the simplified version of the algorithm, LM-EnRML (approx), on three test cases. The first is a highly nonlinear single-variable problem for which results can be compared against the true conditional pdf. The second test case is a one-dimensional two-phase flow problem in which the permeability of 31 grid cells is uncertain. In this case, Markov chain Monte Carlo results are available for comparison with ensemble-based results. The third test case is the Brugge benchmark case with both 10 and 20 years of history. The efficiency and quality of results of the new algorithms were compared with the standard ES (without iteration), the ensemble-based Gauss–Newton formulation, the standard ensemble-based LM formulation, and the MDA. Because of the high level of nonlinearity, the standard ES performed poorly on all test cases. The MDA often performed well, especially at early iterations where the reduction in data mismatch was quite rapid. The best results, however, were always achieved with the new iterative ensemble smoother algorithms, LM-EnRML and LM-EnRML (approx).

Acceleration of the EM and ECM algorithms using the Aitken δ2 method for log-linear models with partially classified data

Acceleration of the EM Algorithm

Acceleration of the EM algorithm using the vector epsilon algorithm

The ECME Algorithm: A Simple Extension of EM and ECM with Faster Monotone Convergence

Maximum-Likelihood-Estimation Via the Ecm Algorithm - A General Framework

Damped Anderson acceleration with restarts and monotonicity control for accelerating EM and EM-like algorithms

Fast ML Estimation for the Mixture of Factor Analyzers Via an ECM Algorithm

A Mixed Evolutionary Algorithm to Solve the O-D Matrix Estimation Problem

An accelerated optimization algorithm for the elastic-net extreme learning machine

Accelerating L1-penalized expectation maximization algorithm for latent variable selection in multidimensional two-parameter logistic models

Asymptotic Convergence Properties of the EM Algorithm with Respect to the Overlap in the Mixture

Parameter Expansion to Accelerate Em: the Px-Em Algorithm

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Tuning extreme learning machine by an improved electromagnetism-like mechanism algorithm for classification problem.

MAXIMUM-LIKELIHOOD-ESTIMATION VIA THE ECM ALGORITHM - COMPUTING THE ASYMPTOTIC VARIANCE

The use of the EM algorithm for regularization problems in high-dimensional linear mixed-effects models

The Double-Accelerated Stochastic Method for Regularized Empirical Risk Minimization

Levenberg–Marquardt forms of the iterative ensemble smoother for efficient history matching and uncertainty quantification

A Tutorial on MM Algorithms

On the global and componentwise rates of convergence of the EM algorithm

A Faster Maximum-Likelihood Modulation Classification in Flat Fading Non-Gaussian Channels