Abstract:Markov models are often used to capture the temporal patterns of sequential data for statistical learning applications. While the Hidden Markov modeling-based learning mechanisms are well studied in literature, we analyze a symbolic-dynamics inspired approach. Under this umbrella, Markov modeling of time-series data consists of two major steps -- discretization of continuous attributes followed by estimating the size of temporal memory of the discretized sequence. These two steps are critical for the accurate and concise representation of time-series data in the discrete space. Discretization governs the information content of the resultant discretized sequence. On the other hand, memory estimation of the symbolic sequence helps to extract the predictive patterns in the discretized data. Clearly, the effectiveness of signal representation as a discrete Markov process depends on both these steps. In this paper, we will review the different techniques for discretization and memory estimation for discrete stochastic processes. In particular, we will focus on the individual problems of discretization and order estimation for discrete stochastic process. We will present some results from literature on partitioning from dynamical systems theory and order estimation using concepts of information theory and statistical learning. The paper also presents some related problem formulations which will be useful for machine learning and statistical learning application using the symbolic framework of data analysis. We present some results of statistical analysis of a complex thermoacoustic instability phenomenon during lean-premixed combustion in jet-turbine engines using the proposed Markov modeling method.

Statistical analysis of multivariate discrete-valued time series

Statistical Monitoring of Dynamic Multivariate Processes Part 1. Modeling Autocorrelation and Cross-correlation

Wasserstein multivariate auto-regressive models for modeling distributional time series

Multivariate extreme values for dynamical systems

A Class of Time-Varying Vector Moving Average Models: Nonparametric Kernel Estimation and Application

A latent space model for multivariate count data time series analysis

Dynamic dependence networks: Financial time series forecasting and portfolio decisions (with discussion)

Bayesian Forecasting of Many Count-Valued Time Series

Spatial and Spatiotemporal Volatility Models: A Review

An integer-valued time series model for multivariate surveillance

A Survey of Estimation Methods for Sparse High-dimensional Time Series Models

Copula-Based Markov Models for Time Series

Clustering Discrete-Valued Time Series

Analysis of the multivariate time series in an observation window

Dependent and Independent Time Series

Encoding Temporal Markov Dynamics in Graph for Visualizing and Mining Time Series

Dependent Matérn Processes for Multivariate Time Series

Linear, Machine Learning and Probabilistic Approaches for Time Series Analysis

Multivariate Distributions in Non-Stationary Complex Systems I: Random Matrix Model and Formulae for Data Analysis

Markov Modeling of Time-Series Data using Symbolic Analysis