Abstract:We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission distributions are linearly independent. We introduce a new procedure for estimating this order by investigating the rank of some well-chosen integral operator which relies on the distribution of a pair of consecutive observations. This method circumvents the usual limits of the spectral method when it is used for estimating the order of an HMM: it avoids the choice of the basis functions; it does not require any knowledge of an upper-bound on the order of the HMM (for the spectral method, such an upper-bound is defined by the number of basis functions); it permits to easily handle different types of data (including continuous data, circular data or multivariate continuous data) with a suitable choice of kernel. The method relies on the fact that the order of the HMM can be identified from the distribution of a pair of consecutive observations and that this order is equal to the rank of some integral operator (\emph{i.e.} the number of its singular values that are non-zero). Since only the empirical counter-part of the singular values of the operator can be obtained, we propose a data-driven thresholding procedure. An upper-bound on the probability of overestimating the order of the HMM is established. Moreover, sufficient conditions on the bandwidth used for kernel density estimation and on the threshold are stated to obtain the consistency of the estimator of the order of the HMM. The procedure is easily implemented since the values of all the tuning parameters are determined by the sample size.

Exact Computation of Kullback-Leibler Distance for Hidden Markov Trees and Models

Upper and lower bounds for approximation of the Kullback-Leibler divergence between Hidden Markov models

A New Distance Measure for Hidden Markov Models

Kullback-Leibler Divergence and Akaike Information Criterion in General Hidden Markov Models

The adjusted Viterbi training for hidden Markov models

Asymptotic properties of the maximum likelihood estimator for Hidden Markov Models indexed by binary trees

Learning Hidden Markov Models Using Conditional Samples

A Method for Determination on HMM Distance Threshold

Fast Forwards-Backwards Algorithm of Generalized Hidden Markov Model

Statistical Inference in Hidden Markov Models using $k$-segment Constraints

Bayesian estimation of the Kullback-Leibler divergence for categorical sytems using mixtures of Dirichlet priors

Density Ratio Hidden Markov Models

A Concise Information-Theoretic Derivation of the Baum-Welch algorithm

Hidden Markov Models derived from Behavior Trees

Probability Distance Based Compression of Hidden Markov Models

Bayesian estimation of the Kullback-Leibler divergence for categorical systems using mixtures of Dirichlet priors

Estimation of the Order of Non-Parametric Hidden Markov Models using the Singular Values of an Integral Operator

Clustering hidden Markov models with variational HEM

On the accuracy of the Viterbi alignment

Estimating Heterogeneous Treatment Effects: Mutual Information Bounds and Learning Algorithms.

Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions