Abstract:Hidden Markov models (HMMs) are popular methods for continuous sequential data modeling and classification tasks. In such applications, the observation emission densities of the HMM hidden states are generally continuous, can vary from one model to the other, and are typically modeled by elliptically contoured distributions, namely Gaussians or Student's t-distributions. In this context, this paper proposes a novel HMM with Bounded Asymmetric Student's t-Mixture Model (BASMM) emissions. Our new BASMMHMM is introduced in the light of the added robustness guaranteed by the BASMM in comparison to other popular emission distributions such as the Gaussian Mixture Model (GMM). In fact, GMMs generally have a limited performance with outliers in the data sets (observations) that the HMM is fitted to. Also, GMMs cannot sufficiently model skewed populations, which are typical in many fields, such as financial or signal processing-related data sets. An excellent alternative to solve this problem is found in Student's t-mixture models. They have similar behaviour and shape to GMMs, but with heavier tails. This allows to have more tolerance towards data sets that span extensive ranges and include outliers. Asymmetry and bounded support are also important features that can further extend the model's flexibility and fit the imperfections of real-world data. This leads us to explore the effectiveness of the BASMM as an observation emission distribution in HMMs, hence the proposed BASMMHMM. We will also demonstrate the improved robustness of our model by presenting the results of three different experiments: occupancy estimation, stock price prediction, and human activity recognition.

Conditional Density Estimation with HMM Based Support Vector Machines

Regime Switching Model Estimation: Spectral Clustering Hidden Markov Model

Nonparametric Density Estimation of Hierarchical Probabilistic Graph Models for Assumption-Free Monitoring

A Robust Infinite Gaussian Mixture Model and Its Application in Fault Detection of Nonlinear Multimode Processes

Large Dimensional Time-Varying GMM Estimation: A New Approach

Semisupervised Robust Modeling of Multimode Industrial Processes for Quality Variable Prediction Based on Student's T Mixture Model.

Real-time Estimation of Quality-Related Variable for Dynamic and Non-Gaussian Process Based on Semisupervised Bayesian HMM

Density Estimation Based on Support Vector Machines

Mixture of Coupled HMMs for Robust Modeling of Multivariate Healthcare Time Series

Hidden Markov models with multivariate bounded asymmetric student's t-mixture model emissions

Using Support Vector Machines for Mining Regression Classes in Large Data Sets

Modelling financial time series based on heavy-tailed market microstructure models with scale mixtures of normal distributions

Dynamic Variational Bayesian Student's T Mixture Regression With Hidden Variables Propagation for Industrial Inferential Sensor Development

Probabilistic Classification by Density Estimation Using Gaussian Mixture Model and Masked Autoregressive Flow

Conditional Density Estimation via Weighted Logistic Regressions

Improved Hidden Markov Model and Its Application in Financial Forecasting

Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models

Error Prediction of CMM Using a Hybrid Model Based on Neural Network Quantile Regression and Kernel Density Estimation

A hybrid nonparametric multivariate density estimator with applications to risk management

Hybrid Variable Monitoring Mixture Model for Anomaly Detection in Industrial Processes.

Hidden Markov model-based modeling and prediction for implied volatility surface1