Abstract:Most likely state sequence reconstruction is a new application for stochastic processes such as Hidden Markov Models (HMMs) and Hidden Semi-Markov Models (HSMMs). Current commercial speech recognizers (such as ViaVoice, HTK, and recognition engines from Microsoft) typically perform relatively well in controlled environments. When signal to noise ratio is not favorable, mis-recognitions usually occur. Methods for overcoming this problem typically employ enhancement or recovery of the acoustic features of individual frames of damaged speech during recognition. In this research, damaged frames are assigned an unknown state symbol during recognition. The damaged state sequence contained in this partially recognized stream of frames is then statistically reconstructed using Markov models. Such a stream of frames is available from most recognizers when performing recognition and segmentation of the incoming speech during semi-continuous speech recognition (semi-CSR). Using this stream of frames and the statistics of the language, replacements for damaged states are selected from a database, inserted into the state sequence, and replayed to perform reconstruction. HMMs have a regeneration time (memory) on the order of a single frame and thus are relatively unsuited for reconstruction of states or state sequences containing more than a few contiguous damaged frames. HSMMs have a regeneration time that is on the order of a single state, and thus are capable of reconstructing multiple damaged frames within a state. Ergodic (fully connected) HSMMs not trained for any specific state sequence have difficulty reconstructing contiguous damaged states. This research describes a Generalized HSMM (GHSMM) reconstructs unknown frames, states, and state sequences in a stream of partially recognized frames produced by semi-CSR. GHSMMs are applicable to any state sequence that can be described in a Markovian fashion and which possesses a state sequence similarity measure. This similarity measure motivates a non-stationary transition matrix that adds the regeneration time of a state sequence to the HSMM. Because of this, GHSMMs can reconstruct the output of any recognizer, can correct both intermittent noise damage and incorrect recognition caused by recognizer imperfections, and in cases achieve state sequence reconstruction rates exceeding 90% correct.

State-Sharing Sparse Hidden Markov Models for Personalized Sequences

DPHMM: Customizable Data Release with Differential Privacy Via Hidden Markov Model.

Music Sequence Prediction with Mixture Hidden Markov Models

HOMMIT: A Sequential Recommendation for Modeling Interest-Transferring via High-Order Markov Model

Shared state space model for background information extraction and time series prediction

Hidden Markov Model Fused with Staying Time for Personalized Recommendation

A Privacy Preserving Markov Model for Sequence Classification.

Student's T-Hidden Markov Model for Unsupervised Learning Using Localized Feature Selection.

Characterizing A Database of Sequential Behaviors with Latent Dirichlet Hidden Markov Models

Ensemble Methods for Sequence Classification with Hidden Markov Models

Understanding Urban Dynamics Via State-Sharing Hidden Markov Model

Mixture Hidden Markov Models for Sequence Data: The seqHMM Package in R

Using Hierarchical Hidden Markov Models to Perform Sequence-Based Classification of Protein Structure

Self-adaptive Design of Hidden Markov Models

Characterizing Activity Sequences Using Profile Hidden Markov Models.

Diversified Hidden Markov Models for Sequential Labeling

General Hidden Semi-Markov Model

A spectral algorithm for learning hidden Markov models

A hidden semi-Markov model with missing data and multiple observation sequences for mobility tracking

Continuous Time Hidden Markov Model for Longitudinal Data

A Spherical Hidden Markov Model for Semantics-Rich Human Mobility Modeling