Abstract:In the field of medical diagnosis and patient monitoring, effective pattern recognition in neurological time-series data is essential. Traditional methods predominantly based on statistical or probabilistic learning and inference often struggle with multivariate, multi-source, state-varying, and noisy data while also posing privacy risks due to excessive information collection and modeling. Furthermore, these methods often overlook critical statistical information, such as the distribution of data points and inherent uncertainties. To address these challenges, we introduce an information theory-based pipeline that leverages specialized features to identify patterns in neurological time-series data while minimizing privacy risks. We incorporate various entropy methods based on the characteristics of different scenarios and entropy. For stochastic state transition applications, we incorporate Shannon's entropy, entropy rates, entropy production, and the von Neumann entropy of Markov chains. When state modeling is impractical, we select and employ approximate entropy, increment entropy, dispersion entropy, phase entropy, and slope entropy. The pipeline's effectiveness and scalability are demonstrated through pattern analysis in a dementia care dataset and also an epileptic and a myocardial infarction dataset. The results indicate that our information theory-based pipeline can achieve average performance improvements across various models on the recall rate, F1 score, and accuracy by up to 13.08 percentage points, while enhancing inference efficiency by reducing the number of model parameters by an average of 3.10 times. Thus, our approach opens a promising avenue for improved, efficient, and critical statistical information-considered pattern recognition in medical time-series data.

Entropy Measures for Stochastic Processes with Applications in Functional Anomaly Detection

Nonparametric M-estimation for Functional Stationary Ergodic Data

Measures of Entropy From Data Using Infinitely Divisible Kernels

Anomaly Detection: Review and preliminary Entropy method tests

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

Entropy alternatives for equilibrium and out of equilibrium systems

Functional Kernel Density Estimation: Point and Fourier Approaches to Time Series Anomaly Detection

Entropy Estimators for Markovian Sequences: A Comparative Analysis

Ensemble Entropy Metric for Hyperspectral Anomaly Detection

Anomaly Detection based on Markov Data: A Statistical Depth Approach

Confidence Intervals and Hypothesis Testing for the Permutation Entropy with an application to Epilepsy

Characterizing Complex Spatiotemporal Patterns from Entropy Measures

Kernel Estimation of the Extropy Function under α-Mixing Dependent Data

Parameterization of the Stochastic Model for Evaluating Variable Small Data in the Shannon Entropy Basis

Generalized Entropies, Variance and Applications

Δ-Entropy: Definition, Properties and Applications in System Identification with Quantized Data

Kernel Mean Embedding of Probability Measures and its Applications to Functional Data Analysis

Variance Norms for Kernelized Anomaly Detection

A novel entropy recurrence quantification analysis

Analyzing entropy features in time-series data for pattern recognition in neurological conditions