Abstract:The hidden Markov model (HMM) is widely utilized in natural language processing, speech recognition, autonomous vehicular systems, and healthcare for tasks such as clustering, pattern recognition, predictive modeling, anomaly detection, and time-series forecasting. However, HMMs can be sensitive to initial states, compromising clustering reliability. To address this issue, we propose an innovative integration of an HMM with hybrid distance metric learning and a modified Bayesian Gaussian mixture model (BGMM) to enhance clustering performance and robustness. A significant challenge in HMM applications is determining the optimal number of hidden states. We address this using a k-fold cross-validation strategy. Implementing our Bayesian Gaussian Hidden Markov Mixture Clustering Model (BGH2MCM) on five diverse datasets, we categorize the observed data sequences according to underlying hidden state sequences. This approach yields superior outcomes to conventional techniques such as K-means, agglomerative clustering, density-based spatial clustering of applications with noise (DBSCAN), and the BGMM. We evaluate the efficiency of our model using silhouette, Davies–Bouldin, and Calinski–Harabasz scores, accuracy metrics, and computation time. Our results demonstrate that the BGH2MCM consistently achieves better clustering quality and computational efficiency, showing an average computation time 23% lower than agglomerative clustering with HMM, 22% less than DBSCAN with HMM, and 14% lower than K-means with the HMM and a BGMM-HMM across all datasets. This study highlights the potential of our BGH2MCM to improve data mining and knowledge discovery practices from complex, real-world datasets.

Regularization of Hidden Markov Models Embedded into Reproducing Kernel Hilbert Space

Generalization Properties of Hyper-Rkhs and Its Applications

Regularized Regression Problem in hyper-RKHS for Learning Kernels

Kernel Bayesian Inference with Posterior Regularization

Generalized Mahalanobis depth in the reproducing kernel Hilbert space

Learning Hidden Markov Models for Linear Gaussian Systems with Applications to Event-based State Estimation

Topological Hidden Markov Models

Learning Hidden Markov Models When the Locations of Missing Observations are Unknown

Training Discriminative HMM by Optimal Allocation of Gaussian Kernels

Learning Hidden Markov Models Using Conditional Samples

Statistical Inference in Hidden Markov Models using $k$-segment Constraints

Learning Nonlinear Generative Models of Time Series With a Kalman Filter in RKHS

Forward-Backward Latent State Inference for Hidden Continuous-Time semi-Markov Chains

Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models

Multi-Kernel Probability Distribution Regressions

Clustering hidden Markov models with variational HEM

Nonparametric estimation of Hawkes processes with RKHSs

Variational Nonparametric Bayesian Hidden Markov Model

Refined Learning of Hidden Markov Models with a Modified Baum-Welch Algorithm and Informative Components

Scalable Hybrid HMM with Gaussian Process Emission for Sequential Time-series Data Clustering

Enhanced Bayesian Gaussian hidden Markov mixture clustering for improved knowledge discovery