Abstract:The Hidden Markov Model (HMM) is a crucial probabilistic modeling technique for sequence data processing and statistical learning that has been extensively utilized in various engineering applications. Traditionally, the EM algorithm is employed to fit HMMs, but currently, academics and professionals exhibit augmenting enthusiasm in Bayesian inference. In the Bayesian context, Markov Chain Monte Carlo (MCMC) methods are commonly used for inferring HMMs, but they can be computationally demanding for high-dimensional covariate data. As a rapid substitute, variational approximation has become a noteworthy and effective approximate inference approach, particularly in recent years, for representation learning in deep generative models. However, there has been limited exploration of variational inference for HMMs with high-dimensional covariates. In this article, we develop a mean-field Variational Bayesian method with the double-exponential shrinkage prior to fit high-dimensional HMMs whose hidden states are of discrete types. The proposed method offers the advantage of fitting the model and investigating specific factors that impact the response variable changes simultaneously. In addition, since the proposed method is based on the Variational Bayesian framework, the proposed method can avoid huge memory and intensive computational cost typical of traditional Bayesian methods. In the simulation studies, we demonstrate that the proposed method can quickly and accurately estimate the posterior distributions of the parameters with good performance. We analyzed the Beijing Multi-Site Air-Quality data and predicted the PM2.5 values via the fitted HMMs.

Variational Nonparametric Bayesian Hidden Markov Model

Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models

Bayesian Nonparametric Hidden Semi-Markov Models

Hidden Markov Model Framework Using Independent Component Analysis Mixture Model

Topological Hidden Markov Models

Disentangled Sticky Hierarchical Dirichlet Process Hidden Markov Model

Variational Bayes inference for hidden Markov diagnostic classification models

Process Trends Analysis Via Wavelet-Domain Hidden Markov Models

Self-adaptive Design of Hidden Markov Models

Clustering hidden Markov models with variational HEM

Dynamic Variational Bayesian Student's T Mixture Regression With Hidden Variables Propagation for Industrial Inferential Sensor Development

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Hidden Markov model using Dirichlet process for de-identification

Variance-Reduced Stochastic Optimization for Efficient Inference of Hidden Markov Models

The Expectation-Maximization Algorithm for Continuous-time Hidden Markov Models

Statistical inference for the nonparametric and semiparametric hidden Markov model via the composite likelihood approach

Density Ratio Hidden Markov Models

Variational inference for coupled Hidden Markov Models applied to the joint detection of copy number variations

Determine the Number of States in Hidden Markov Models via Marginal Likelihood

Variational Inference For Nonparametric Subspace Dictionary Learning With Hierarchical Beta Process

A Bayesian multilevel hidden Markov model with Poisson-lognormal emissions for intense longitudinal count data