Abstract:Methods for refined learning of hidden Markov models (HMMs) have been studied for decades, taking either structural or parametric perspectives. This paper discusses using informative components of state parameters to refine the training of HMMs. While the purpose of HMM learning is to decompose a high-dimensional observation space into latent states, we may still end up with high dimensional state models. A problem with such high dimensional state models is that if they are learned with limited amounts of training data, this will bias the likelihood during training, particularly when there are outliers in the observation sequence. We propose a modified Baum-Welch algorithm to estimate the HMM parameters over informative components selected with nearly sufficient statistics, using relative entropy tolerance. Our method produces a modified likelihood estimation in reduced dimensions, which decreases the computation complexity and preserves near-optimality of the HMM that is constructed. Two variations on the algorithm are discussed, one that deals with general state model and another that considers a special Gaussian case. The approach is evaluated with a problem of using pen tip trajectory for handwriting character verification and recognition. Two data sets are studied, one with low dimensionality and the other with high dimensionality. A comparison is performed of the results of using HMMs trained without and with informative state components. For both data sets, we found that our approach yields improvements in performance. The error rate varies with relative entropy change is also evaluated.

Behavior Recognition Method of Robust User Based on Improved HMM

ATM Abnormal Human Behavior Detection Model Based on State-Dependent Judgement Optimization HMM Algorithm

Optimizing Hidden Markov Model with Baum-Welch Algorithm for Vehicle Driver's Intention Recognition

Context-Aware Mouse Behavior Recognition Using Hidden Markov Models

Refined Learning of Hidden Markov Models with a Modified Baum-Welch Algorithm and Informative Components

Hidden Markov Models Training Using Hybrid Baum Welch - Variable Neighborhood Search Algorithm

Self-adaptive Design of Hidden Markov Models

A kind of improving HMM model and using in the visual speech recognition

Feature Selection and Multivariate Gaussian Probability Distribution for User Behavior Recognition

Method for Masquerade Intrusion Detection Based on HMM and Genetic Algorithm

Multiuser Detection Using Hidden Markov Model.

Identifying the Confidence Level of Activity Recognition Via HMM

Recognition of Abnormal Interactions Based on Coupled Hidden Markov Models

Switching GMM-HMM for Complex Human Activity Modeling and Recognition

Detecting Unknown Behaviors by Pre-defined Behaviours: An Bayesian Non-parametric Approach

A HMM Based On-line Chinese Character Recognition System and Improved Training Algorithm

An Improved HMM for Robust Speaker Recognition

A New Genetically Optimized GMM for Speaker Recognition

Using Hidden Markov Model to Predict Human Actions with Swarm Intelligence

Face Recognition Based On Flda, Cpca And Improved Hmm

A study on improved hidden Markov models and applications to speech recognition