Abstract:Hidden Markov Models (HMM) model a sequence of observations that are dependent on a hidden (or latent) state that follow a Markov chain. These models are widely used in diverse fields including ecology, speech recognition, and genetics.Parameter estimation in HMM is typically performed using the Baum-Welch algorithm, a special case of the Expectation-Maximisation (EM) algorithm. While this method guarantee the convergence to a local maximum, its convergence rates is usually slow.Alternative methods, such as the direct maximisation of the likelihood using quasi-Newton methods (such as L-BFGS-B) can offer faster convergence but can be more complicated to implement due to challenges to deal with the presence of bounds on the space of parameters.We propose a novel hybrid algorithm, QNEM, that combines the Baum-Welch and the quasi-Newton algorithms. QNEM aims to leverage the strength of both algorithms by switching from one method to the other based on the convexity of the likelihood function.We conducted a comparative analysis between QNEM, the Baum-Welch algorithm, an EM acceleration algorithm called SQUAREM (Varadhan, 2008, Scand J Statist), and the L-BFGS-B quasi-Newton method by applying these algorithms to four examples built on different models. We estimated the parameters of each model using the different algorithms and evaluated their performances.Our results show that the best-performing algorithm depends on the model considered. QNEM performs well overall, always being faster or equivalent to L-BFGS-B. The Baum-Welch and SQUAREM algorithms are faster than the quasi-Newton and QNEM algorithms in certain scenarios with multiple optimum. In conclusion, QNEM offers a promising alternative to existing algorithms.

Hidden Markov Models Training Using Hybrid Baum Welch - Variable Neighborhood Search Algorithm

A Hybrid Speech Recognition Training Method for HMM Based on Genetic Algorithm and Baum Welch Algorithm

Parameter estimation of hidden Markov models: comparison of EM and quasi-Newton methods with a new hybrid algorithm

Refined Learning of Hidden Markov Models with a Modified Baum-Welch Algorithm and Informative Components

A tutorial of techniques for improving standard Hidden Markov Model algorithms

Two Phases Hybrid Algorithm for DHMM Training

A New Hybrid Hmm/Ann Model For Speech Recognition

Bridging the Usability Gap: Theoretical and Methodological Advances for Spectral Learning of Hidden Markov Models

Optimizing Hidden Markov Model with Baum-Welch Algorithm for Vehicle Driver's Intention Recognition

Speech Recognition Algorithm Based on Neural Network and Hidden Markov Model

Discrete Channel Modelling Based on Genetic Algorithm and Simulated Annealing for Training Hidden Markov Model

Automatic Speech Recognition : A Study and Performance Evaluation on Neural Networks and Hidden Markov Models

Self-adaptive Design of Hidden Markov Models

Optimal state and branch sequence based parameter estimation of continuous hidden Markov model

Exploring More Representative States of Hidden Markov Model in Optical Character Recognition: A Clustering-Based Model Pre-Training Approach

Behavior Recognition Method of Robust User Based on Improved HMM

Key Technology Research for Speech Recognition

Optimized Hidden Markov Model based on Constrained Particle Swarm Optimization

A Training Method For Hidden Markov Model With Maximum Model Distance And Genetic Algorithm

The adjusted Viterbi training for hidden Markov models

A New Algorithm for Hidden Markov Models Learning Problem