Abstract:The expectation–maximization (EM) algorithm is a well‐known iterative algorithm for finding maximum likelihood estimates from incomplete data and is used in several statistical models with latent variables and missing data. The algorithm also exhibits a monotonic increase in a likelihood function and satisfies parameter constraints for its convergence. The popularity of the EM algorithm can be attributed to its stable convergence, simple implementation and flexibility in interpreting data incompleteness. Despite these computational advantages, the algorithm is linear convergent and suffers from very slow convergence when a statistical model has many parameters and a high proportion of missing data. Various algorithms have been proposed to accelerate the convergence of the EM algorithm. We introduce the acceleration of the EM algorithm using root‐finding and vector extrapolation algorithms. The root‐finding algorithms include Aitken's method and the Newton–Raphson, quasi‐Newton and conjugate gradient algorithms. These algorithms with faster convergence rates allow the EM algorithm to be sped up. The vector extrapolation algorithms transform the sequence of estimates from the EM algorithm into a fast convergent sequence and can accelerate the convergence without modifying the EM algorithm. We describe the derivation of these acceleration algorithms and attempt to apply them to two examples. This article is categorized under: Statistical and Graphical Methods of Data Analysis > EM Algorithm Approaches to how to accelerate the convergence of the EM algorithm.

RSEM: an Accelerated Algorithm on Repeated EM

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Stochastic Expectation Maximization with Variance Reduction.

Stochastic EM methods with Variance Reduction for Penalised PET Reconstructions

Multi-view EM Algorithm and Its Application to Color Image Segmentation.

Acceleration of the EM Algorithm

Deterministic Approximate EM Algorithm; Application to the Riemann Approximation EM and the Tempered EM

String-Averaging Expectation-Maximization for Maximum Likelihood Estimation in Emission Tomography

Acceleration of the EM algorithm using the vector epsilon algorithm

EM Algorithms for Gaussian Mixtures with Split-and-merge Operation

Regularized EM algorithm

EM-Net: Gaze Estimation with Expectation Maximization Algorithm

Communication-efficient distributed EM algorithm

Entropy Regularization, Automatic Model Selection, And Unsupervised Image Segmentation

Big Learning Expectation Maximization

Learning Gaussian mixture model with a maximization-maximization algorithm for image classification

Statistical Machine Learning EM algorithm Lecture Notes 13 : EM algorithm

Using Em to Obtain Asymptotic Variance - Covariance Matrices - the Sem Algorithm

REMA: A Rich Elastic Mixed Attention Module for Single Image Super-Resolution

Learning Mixtures of Experts with EM

Maximum-Likelihood-Estimation Via the Ecm Algorithm - A General Framework