Are information criteria good enough to choose the right the number of regimes in hidden Markov models?
Bouchra R. Nasri,Bruno N. Rémillard,Mamadou Y. Thioub
DOI: https://doi.org/10.1080/00949655.2024.2409381
IF: 1.225
2024-10-19
Journal of Statistical Computation and Simulation
Abstract:Selecting the number of regimes in Hidden Markov models is an important problem. Many criteria are used to do so, such as Akaike information criterion (AIC), Bayesian information criterion (BIC), integrated completed likelihood (ICL), deviance information criterion (DIC), and Watanabe-Akaike information criterion (WAIC), to name a few. In this article, we introduced goodness-of-fit tests for general Hidden Markov models with covariates, where the distribution of the observations is arbitrary, i.e. continuous, discrete, or a mixture of both. A selection procedure is proposed based on this goodness-of-fit test. The main aim of this article is to compare the classical information criterion with the new criterion when the outcome is either continuous, discrete or zero-inflated. Numerical experiments assess the finite sample performance of the goodness-of-fit tests, and comparisons between the different criteria are made.
statistics & probability,computer science, interdisciplinary applications