Abstract:Hidden Markov Models (HMM) model a sequence of observations that are dependent on a hidden (or latent) state that follow a Markov chain. These models are widely used in diverse fields including ecology, speech recognition, and genetics.Parameter estimation in HMM is typically performed using the Baum-Welch algorithm, a special case of the Expectation-Maximisation (EM) algorithm. While this method guarantee the convergence to a local maximum, its convergence rates is usually slow.Alternative methods, such as the direct maximisation of the likelihood using quasi-Newton methods (such as L-BFGS-B) can offer faster convergence but can be more complicated to implement due to challenges to deal with the presence of bounds on the space of parameters.We propose a novel hybrid algorithm, QNEM, that combines the Baum-Welch and the quasi-Newton algorithms. QNEM aims to leverage the strength of both algorithms by switching from one method to the other based on the convexity of the likelihood function.We conducted a comparative analysis between QNEM, the Baum-Welch algorithm, an EM acceleration algorithm called SQUAREM (Varadhan, 2008, Scand J Statist), and the L-BFGS-B quasi-Newton method by applying these algorithms to four examples built on different models. We estimated the parameters of each model using the different algorithms and evaluated their performances.Our results show that the best-performing algorithm depends on the model considered. QNEM performs well overall, always being faster or equivalent to L-BFGS-B. The Baum-Welch and SQUAREM algorithms are faster than the quasi-Newton and QNEM algorithms in certain scenarios with multiple optimum. In conclusion, QNEM offers a promising alternative to existing algorithms.

Semiparametric Hidden Markov Model with Non-Parametric Regression

Statistical inference for the nonparametric and semiparametric hidden Markov model via the composite likelihood approach

Measuring and Enhancing the Transferability of Hidden Markov Models for Dynamic Travel Behavioral Analysis

Regime Switching Model Estimation: Spectral Clustering Hidden Markov Model

Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models

Variational Nonparametric Bayesian Hidden Markov Model

Bayesian Nonparametric Hidden Semi-Markov Models

Hidden Markov models with multivariate bounded asymmetric student's t-mixture model emissions

Real-time Estimation of Quality-Related Variable for Dynamic and Non-Gaussian Process Based on Semisupervised Bayesian HMM

Parameter estimation of hidden Markov models: comparison of EM and quasi-Newton methods with a new hybrid algorithm

An adaptive simulated annealing EM algorithm for inference on non-homogeneous hidden Markov models

Machine learning embedded EM algorithms for semiparametric mixture regression models

A Bayesian multilevel hidden Markov model with Poisson-lognormal emissions for intense longitudinal count data

Bayesian Approximations to Hidden Semi-Markov Models for Telemetric Monitoring of Physical Activity

hmmTMB: Hidden Markov models with flexible covariate effects in R

Hidden Markov Model Framework Using Independent Component Analysis Mixture Model

Density Ratio Hidden Markov Models

Parallel EM Algorithm on Hadoop for Large-Scale Hidden Markov Model Parameter Estimation

Principles of Non-stationary Hidden Markov Model and Its Applications to Sequence Labeling Task

Variance-Reduced Stochastic Optimization for Efficient Inference of Hidden Markov Models

Semiparametric Mixture Regression with Unspecified Error Distributions