Abstract:We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission distributions are linearly independent. We introduce a new procedure for estimating this order by investigating the rank of some well-chosen integral operator which relies on the distribution of a pair of consecutive observations. This method circumvents the usual limits of the spectral method when it is used for estimating the order of an HMM: it avoids the choice of the basis functions; it does not require any knowledge of an upper-bound on the order of the HMM (for the spectral method, such an upper-bound is defined by the number of basis functions); it permits to easily handle different types of data (including continuous data, circular data or multivariate continuous data) with a suitable choice of kernel. The method relies on the fact that the order of the HMM can be identified from the distribution of a pair of consecutive observations and that this order is equal to the rank of some integral operator (\emph{i.e.} the number of its singular values that are non-zero). Since only the empirical counter-part of the singular values of the operator can be obtained, we propose a data-driven thresholding procedure. An upper-bound on the probability of overestimating the order of the HMM is established. Moreover, sufficient conditions on the bandwidth used for kernel density estimation and on the threshold are stated to obtain the consistency of the estimator of the order of the HMM. The procedure is easily implemented since the values of all the tuning parameters are determined by the sample size.

HMM Parameters Estimation with Inequality Constraints

Mixed H∞ and passivity based state estimation for fuzzy neural networks with Markovian-type estimator gain change.

On Parameter Identifiability of Linear Multivariable Systems with Communication Access Constraints

Regime Switching Model Estimation: Spectral Clustering Hidden Markov Model

Parameter Identification for Fractional Ornstein–Uhlenbeck Processes Based on Discrete Observation

Parameter Estimation Via Unlabeled Sensing Using Distributed Sensors

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Adding Constraints to Bayesian Inverse Problems.

Approaches in Using Expectation Maximization Algorithm for Maximum Likelihood Estimation of the Parameters of a Constrained State Space Model with an External Input Series

Modeling and State Estimation for Dynamic Systems With Linear Equality Constraints

Parameters Estimation of Hinging Hyperplanes Using Median Squared Error Criterion

Parameter Estimation for Hidden Markov Models with Intractable Likelihoods

Parameter Estimability Analysis for Process System with Finite Measurement Information

Parameter estimation of hidden Markov models: comparison of EM and quasi-Newton methods with a new hybrid algorithm

Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models

State Estimation with Nonlinear Inequality Constraints Based on Unscented Transformation

Static Parameter Estimation for ABC Approximations of Hidden Markov Models

Estimation of the Order of Non-Parametric Hidden Markov Models using the Singular Values of an Integral Operator

Constrained Dynamic Systems: Generalized Modeling and State Estimation.

Parameter Estimation and Model Testing for Markov Processes Via Conditional Characteristic Functions

Conditional Density Estimation with HMM Based Support Vector Machines