Abstract:The hidden Markov model (HMM) is widely utilized in natural language processing, speech recognition, autonomous vehicular systems, and healthcare for tasks such as clustering, pattern recognition, predictive modeling, anomaly detection, and time-series forecasting. However, HMMs can be sensitive to initial states, compromising clustering reliability. To address this issue, we propose an innovative integration of an HMM with hybrid distance metric learning and a modified Bayesian Gaussian mixture model (BGMM) to enhance clustering performance and robustness. A significant challenge in HMM applications is determining the optimal number of hidden states. We address this using a k-fold cross-validation strategy. Implementing our Bayesian Gaussian Hidden Markov Mixture Clustering Model (BGH2MCM) on five diverse datasets, we categorize the observed data sequences according to underlying hidden state sequences. This approach yields superior outcomes to conventional techniques such as K-means, agglomerative clustering, density-based spatial clustering of applications with noise (DBSCAN), and the BGMM. We evaluate the efficiency of our model using silhouette, Davies–Bouldin, and Calinski–Harabasz scores, accuracy metrics, and computation time. Our results demonstrate that the BGH2MCM consistently achieves better clustering quality and computational efficiency, showing an average computation time 23% lower than agglomerative clustering with HMM, 22% less than DBSCAN with HMM, and 14% lower than K-means with the HMM and a BGMM-HMM across all datasets. This study highlights the potential of our BGH2MCM to improve data mining and knowledge discovery practices from complex, real-world datasets.

Mixed data Deep Gaussian Mixture Model: A clustering model for mixed datasets

Gaussian mixture density modeling and decomposition with weighted likelihood

Gaussian Mixture Model Clustering with Incomplete Data

Mixture of GANs for Clustering.

Gaussian mixture model with an extended ultrametric covariance structure

Deep Clustering by Gaussian Mixture Variational Autoencoders With Graph Embedding

Laplacian Regularized Gaussian Mixture Model for Data Clustering

Clustering Mixed-Type Data via Dirichlet Process Mixture Model with Cluster-Specific Covariance Matrices

A General Transfer Learning-based Gaussian Mixture Model for Clustering

Model-based clustering based on sparse finite Gaussian mixtures

Enabling Mixed Effects Neural Networks for Diverse, Clustered Data Using Monte Carlo Methods

Gaussian Mixture Model with Local Consistency

Handling missing data in model-based clustering

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

Enhanced Bayesian Gaussian hidden Markov mixture clustering for improved knowledge discovery

A new hybrid discriminative/generative model using the full-covariance multivariate generalized Gaussian mixture models

Mixed and missing data: a unified treatment with latent graphical models

Spatiotemporal clustering using Gaussian processes embedded in a mixture model

A Nonparametric Model for Multi-Manifold Clustering with Mixture of Gaussians and Graph Consistency