Abstract:The hidden Markov model (HMM) is widely utilized in natural language processing, speech recognition, autonomous vehicular systems, and healthcare for tasks such as clustering, pattern recognition, predictive modeling, anomaly detection, and time-series forecasting. However, HMMs can be sensitive to initial states, compromising clustering reliability. To address this issue, we propose an innovative integration of an HMM with hybrid distance metric learning and a modified Bayesian Gaussian mixture model (BGMM) to enhance clustering performance and robustness. A significant challenge in HMM applications is determining the optimal number of hidden states. We address this using a k-fold cross-validation strategy. Implementing our Bayesian Gaussian Hidden Markov Mixture Clustering Model (BGH2MCM) on five diverse datasets, we categorize the observed data sequences according to underlying hidden state sequences. This approach yields superior outcomes to conventional techniques such as K-means, agglomerative clustering, density-based spatial clustering of applications with noise (DBSCAN), and the BGMM. We evaluate the efficiency of our model using silhouette, Davies–Bouldin, and Calinski–Harabasz scores, accuracy metrics, and computation time. Our results demonstrate that the BGH2MCM consistently achieves better clustering quality and computational efficiency, showing an average computation time 23% lower than agglomerative clustering with HMM, 22% less than DBSCAN with HMM, and 14% lower than K-means with the HMM and a BGMM-HMM across all datasets. This study highlights the potential of our BGH2MCM to improve data mining and knowledge discovery practices from complex, real-world datasets.

Canonical Sequence Extraction And Hmm Model Building Based On Hierarchical Clustering

Hierarchical Clustering Matching for Features with Repetitive Patterns in Visual Odometry

DBHC: Discrete Bayesian HMM Clustering

Exploring More Representative States of Hidden Markov Model in Optical Character Recognition: A Clustering-Based Model Pre-Training Approach

Clustering hidden Markov models with variational HEM

Characterizing A Database of Sequential Behaviors with Latent Dirichlet Hidden Markov Models

A New Text Clustering Method Using Hidden Markov Model

Hidden Markov Models on Variable Blocks with a Modal Clustering Algorithm and Applications

Mixture Hidden Markov Models for Sequence Data: The seqHMM Package in R

A Hmm Based Operational Gesture Recognition Method

A Method for Determination on HMM Distance Threshold

Enhanced Bayesian Gaussian hidden Markov mixture clustering for improved knowledge discovery

Ensemble Methods for Sequence Classification with Hidden Markov Models

Marginalized Beam Search Algorithms for Hierarchical HMMs

Video Sequences Foreground Enhancement Using Hidden Markov Model

HMM-based operational gesture recognition method

Diversified Hidden Markov Models for Sequential Labeling

A tutorial of techniques for improving standard Hidden Markov Model algorithms

<title>HMM-based operational gesture recognition method</title>

Disentangled Sticky Hierarchical Dirichlet Process Hidden Markov Model

A Novel Short Merged Off-line Handwritten Chinese Character String Segmentation Algorithm Using Hidden Markov Model