Abstract:Labeling of sequential data is a prevalent meta-problem for a wide range of real world applications. While the first-order Hidden Markov Models (HMM) provides a fundamental approach for unsupervised sequential labeling, the basic model does not show satisfying performance when it is directly applied to real world problems, such as part-of-speech tagging (PoS tagging) and optical character recognition (OCR). Aiming at improving performance, important extensions of HMM have been proposed in the literatures. One of the common key features in these extensions is the incorporation of proper prior information. In this paper, we propose a new extension of HMM, termed diversified Hidden Markov Models (dHMM), which utilizes a diversity-encouraging prior over the statetransition probabilities and thus facilitates more dynamic sequential labellings. Specifically, the diversity is modeled by a continuous determinantal point process prior, which we apply to both unsupervised and supervised scenarios. Learning and inference algorithms for dHMM are derived. Empirical evaluations on benchmark datasets for unsupervised PoS tagging and supervised OCR confirmed the effectiveness of dHMM, with competitive performance to the state-of-the-art.

Training second-order hidden Markov models with multiple observation sequences

New Learning Algorithms for Third-Order 2-D Hidden Markov Models

Second-order Hidden Markov Models Based on the Fuzzy C-Means and Fuzzy Entropy

The learning algorithms of coupled discrete hidden Markov models

Hidden Markov Models with Multiple Observers

Training fuzzy third-order hidden Markov models for matrix data.

Multiuser Detection Using Hidden Markov Model.

An analytic solution for estimating two-dimensional hidden Markov models

An New Method Used in HMM for Modeling Frame Correlation.

Hidden Markov Models with States Depending on Observations

Two Phases Hybrid Algorithm for DHMM Training

Parametric Estimate of Second-Order Hidden Markov Models Relation with the Observations

Event Recognition with Time Varying Hidden Markov Model

The Training Algorithm of Fuzzy Coupled Hidden Markov Models

A Training Algorithms of Third-order Hidden Markov Model Based on FCM-FE

The Learning Algorithm of the Second Order HMM and Its Relationship with the First Order HMM

Diversified Hidden Markov Models for Sequential Labeling

Improvement of hidden Markov model (HMM) for speech recognition

Principles of Non-stationary Hidden Markov Model and Its Applications to Sequence Labeling Task

Markov Observation Models

A hidden semi-Markov model with missing data and multiple observation sequences for mobility tracking