Abstract:Markov models are often used to capture the temporal patterns of sequential data for statistical learning applications. While the Hidden Markov modeling-based learning mechanisms are well studied in literature, we analyze a symbolic-dynamics inspired approach. Under this umbrella, Markov modeling of time-series data consists of two major steps -- discretization of continuous attributes followed by estimating the size of temporal memory of the discretized sequence. These two steps are critical for the accurate and concise representation of time-series data in the discrete space. Discretization governs the information content of the resultant discretized sequence. On the other hand, memory estimation of the symbolic sequence helps to extract the predictive patterns in the discretized data. Clearly, the effectiveness of signal representation as a discrete Markov process depends on both these steps. In this paper, we will review the different techniques for discretization and memory estimation for discrete stochastic processes. In particular, we will focus on the individual problems of discretization and order estimation for discrete stochastic process. We will present some results from literature on partitioning from dynamical systems theory and order estimation using concepts of information theory and statistical learning. The paper also presents some related problem formulations which will be useful for machine learning and statistical learning application using the symbolic framework of data analysis. We present some results of statistical analysis of a complex thermoacoustic instability phenomenon during lean-premixed combustion in jet-turbine engines using the proposed Markov modeling method.

Hidden Markov decision trees

Markov-switching decision trees

Optimal state space reconstruction via Monte Carlo decision tree search

Hidden Markov graphical models with state-dependent generalized hyperbolic distributions

Hidden Markov Models derived from Behavior Trees

Towards Learning Segmented Temporal Sequences: A Decision Tree Approach

An efficient solution to Hidden Markov Models on trees with coupled branches

A Hidden Markov Model-based fuzzy modeling of multivariate time series

Time-penalised trees (TpT): introducing a new tree-based data mining algorithm for time-varying covariates

Variational learning for switching state-space models

Modelling multivariate extreme value distributions via Markov trees

Markov Modeling of Time-Series Data using Symbolic Analysis

Asymptotic properties of the maximum likelihood estimator for Hidden Markov Models indexed by binary trees

Variational Temporal Abstraction

Comparative Analysis of the Hidden Markov Model and LSTM: A Simulative Approach

Decision making in stochastic extensive form I: Stochastic decision forests

Are you going to the party: depends, who else is coming? [Learning hidden group dynamics via conditional latent tree models]

Forecasting with Hyper-Trees

Tree-based Methods for Clustering Time Series Using Domain-Relevant Attributes

A Hidden Markov Ensemble Algorithm Design for Time Series Analysis

Dynamical Systems Trees