Multiscale Entropy Analysis: A New Method to Detect Determinism in a Time Series

A. Sarkar,P. Barat

DOI: https://doi.org/10.48550/arXiv.physics/0604040

2006-04-06

Abstract:In this letter we show that the Multiscale Entropy (MSE) analysis can detect the determinism in a time series.

Data Analysis, Statistics and Probability

What problem does this paper attempt to address?

Using the modified sample entropy to detect determinism

Hong-Bo Xie,Jing-Yi Guo,Yong-Ping Zheng

DOI: https://doi.org/10.1016/j.physleta.2010.07.058

IF: 2.707

2010-08-01

Physics Letters A

Abstract:A modified sample entropy (mSampEn), based on the nonlinear continuous and convex function, has been proposed and proven to be superior to the standard sample entropy (SampEn) in several aspects. In this Letter, we empirically investigate the ability of the mSampEn statistic combined with surrogate data method to detect determinism. The effects of the datasets length and noise on the proposed method to differentiate between deterministic and stochastic dynamics are tested on several benchmark time series. The noise performance of the mSampEn statistic is also compared with the singular value decomposition (SVD) and symplectic geometry spectrum (SGS) based methods. The results indicate that the mSampEn statistic is a robust index for detecting determinism in short and noisy time series.

physics, multidisciplinary
Time Series Analysis Using Composite Multiscale Entropy

Shuen-De Wu,Chiu-Wen Wu,Shiou-Gwo Lin,Chun-Chieh Wang,Kung-Yen Lee

DOI: https://doi.org/10.3390/e15031069

IF: 2.738

2013-03-18

Entropy

Abstract:Multiscale entropy (MSE) was recently developed to evaluate the complexity of time series over different time scales. Although the MSE algorithm has been successfully applied in a number of different fields, it encounters a problem in that the statistical reliability of the sample entropy (SampEn) of a coarse-grained series is reduced as a time scale factor is increased. Therefore, in this paper, the concept of a composite multiscale entropy (CMSE) is introduced to overcome this difficulty. Simulation results on both white noise and 1/f noise show that the CMSE provides higher entropy reliablity than the MSE approach for large time scale factors. On real data analysis, both the MSE and CMSE are applied to extract features from fault bearing vibration signals. Experimental results demonstrate that the proposed CMSE-based feature extractor provides higher separability than the MSE-based feature extractor.

physics, multidisciplinary
Analysis of complex time series using refined composite multiscale entropy

Shuen-De Wu,Chiu-Wen Wu,Shiou-Gwo Lin,Kung-Yen Lee,Chung-Kang Peng

DOI: https://doi.org/10.1016/j.physleta.2014.03.034

IF: 2.707

2014-04-01

Physics Letters A

Abstract:Multiscale entropy (MSE) is an effective algorithm for measuring the complexity of a time series that has been applied in many fields successfully. However, MSE may yield an inaccurate estimation of entropy or induce undefined entropy because the coarse-graining procedure reduces the length of a time series considerably at large scales. Composite multiscale entropy (CMSE) was recently proposed to improve the accuracy of MSE, but it does not resolve undefined entropy. Here we propose a refined composite multiscale entropy (RCMSE) to improve CMSE. For short time series analyses, we demonstrate that RCMSE increases the accuracy of entropy estimation and reduces the probability of inducing undefined entropy.

physics, multidisciplinary
Multivariate refined composite multiscale entropy analysis

Anne Humeau-Heurtier

DOI: https://doi.org/10.1016/j.physleta.2016.02.029

IF: 2.707

2016-04-01

Physics Letters A

Abstract:Multiscale entropy (MSE) has become a prevailing method to quantify signals complexity. MSE relies on sample entropy. However, MSE may yield imprecise complexity estimation at large scales, because sample entropy does not give precise estimation of entropy when short signals are processed. A refined composite multiscale entropy (RCMSE) has therefore recently been proposed. Nevertheless, RCMSE is for univariate signals only. The simultaneous analysis of multi-channel (multivariate) data often over-performs studies based on univariate signals. We therefore introduce an extension of RCMSE to multivariate data. Applications of multivariate RCMSE to simulated processes reveal its better performances over the standard multivariate MSE.

physics, multidisciplinary
Scaling detection in time series: Diffusion entropy analysis

Nicola Scafetta,Paolo Grigolini

DOI: https://doi.org/10.1103/physreve.66.036130

IF: 2.707

2002-09-25

Physical Review E

Abstract:The methods currently used to determine the scaling exponent of a complex dynamic process described by a time series are based on the numerical evaluation of variance. This means that all of them can be safely applied only to the case where ordinary statistical properties hold true even if strange kinetics are involved. We illustrate a method of statistical analysis based on the Shannon entropy of the diffusion process generated by the time series, called diffusion entropy analysis (DEA). We adopt artificial Gauss and Lévy time series, as prototypes of ordinary and anomalous statistics, respectively, and we analyze them with the DEA and four ordinary methods of analysis, some of which are very popular. We show that the DEA determines the correct scaling exponent even when the statistical properties, as well as the dynamic properties, are anomalous. The other four methods produce correct results in the Gauss case but fail to detect the correct scaling in the case of Lévy statistics.

physics, fluids & plasmas, mathematical
Information-theoretical analysis of statistical measures for multiscale dynamics

Naoki Asuke,Tomoki Yamagami,Takatomo Mihana,André Röhm,Ryoichi Horisaki,Makoto Naruse

DOI: https://doi.org/10.1063/5.0141099

2023-01-05

Abstract:Multiscale entropy (MSE) has been widely used to examine nonlinear systems involving multiple time scales, such as biological and economic systems. Conversely, Allan variance has been used to evaluate the stability of oscillators, such as clocks and lasers, ranging from short to long time scales. Although these two statistical measures were developed independently for different purposes in different fields in the literature, their interest is to examine multiscale temporal structures of physical phenomena under study. We show that, from an information-theoretical perspective, they share some foundations and exhibit similar tendencies. We experimentally confirmed that similar properties of the MSE and Allan variance can be observed in low-frequency fluctuations (LFF) in chaotic lasers and physiological heartbeat data. Furthermore, we calculated the condition under which this consistency between the MSE and Allan variance exists, which is related to certain conditional probabilities. Heuristically, physical systems in nature including the aforementioned LFF and heartbeat data mostly satisfy this condition, and hence the MSE and Allan variance demonstrate similar properties. As a counterexample, an artificially constructed random sequence is demonstrated, for which the MSE and Allan variance exhibit different trends.

Chaotic Dynamics
Graph-Based Multivariate Multiscale Dispersion Entropy: Efficient Implementation and Applications to Real-World Network Data

John Stewart Fabila-Carrasco,Chao Tan,Javier Escudero

2024-05-01

Abstract:We introduce Multivariate Multiscale Graph-based Dispersion Entropy (mvDEG), a novel, computationally efficient method for analyzing multivariate time series data in graph and complex network frameworks, and demonstrate its application in real-world data. mvDEG effectively combines temporal dynamics with topological relationships, offering enhanced analysis compared to traditional nonlinear entropy methods. Its efficacy is established through testing on synthetic signals, such as uncorrelated and correlated noise, showcasing its adeptness in discerning various levels of dependency and complexity.

Combinatorics,Computational Engineering, Finance, and Science,Chaotic Dynamics
Fourier phase index for extracting signatures of determinism and nonlinear features in time series

Alberto Isaac Aguilar-Hernández,David Michel Serrano-Solis,Wady A. Ríos-Herrera,José Fernando Zapata-Berruecos,Gloria Vilaclara,Gustavo Martínez-Mekler,Markus F. Müller

DOI: https://doi.org/10.1063/5.0160555

2024-01-01

Abstract:Detecting determinism and nonlinear properties from empirical time series is highly nontrivial. Traditionally, nonlinear time series analysis is based on an error-prone phase space reconstruction that is only applicable for stationary, largely noise-free data from a low-dimensional system and requires the nontrivial adjustment of various parameters. We present a data-driven index based on Fourier phases that detects determinism at a well-defined significance level, without using Fourier transform surrogate data. It extracts nonlinear features, is robust to noise, provides time-frequency resolution by a double running window approach, and potentially distinguishes regular and chaotic dynamics. We test this method on data derived from dynamical models as well as on real-world data, namely, intracranial recordings of an epileptic patient and a series of density related variations of sediments of a paleolake in Tlaxcala, Mexico.

mathematics, applied,physics, mathematical
Simplicial complex entropy for time series analysis

L. Guzman-Vargas,A. Zabaleta-Ortega,A. Guzman-Saenz

2023-10-15

Abstract:The complex behavior of many systems in nature requires the application of robust methodologies capable of identifying changes in their dynamics. In the case of time series (which are sensed values of a system during a time interval), several methods have been proposed to evaluate their irregularity. However, for some types of dynamics such as stochastic and chaotic, new approaches are required that can provide a better characterization of them. In this paper we present the simplicial complex approximate entropy (SCAE), which is based on the conditional probability of the occurrence of elements of a simplicial complex. Our results show that this entropy measure provides a wide range of values with details not easily identifiable with standard methods. In particular, we show that our method is able to quantify the irregularity in simulated random sequences and those from low-dimensional chaotic dynamics. Furthermore, it is possible to consistently differentiate cardiac interbeat sequences from healthy subjects and from patients with heart failure, as well as to identify changes between dynamical states of coupled chaotic maps. Our results highlight the importance of the structures revealed by the simplicial complexes, which holds promise for applications of this approach in various contexts.

Data Analysis, Statistics and Probability,Computational Physics
Two-dimensional multiscale entropy analysis: Applications to image texture evaluation

Luiz E.V. Silva,Juliano J. Duque,Joaquim C. Felipe,Luiz O. Murta,Anne Humeau-Heurtier,Luiz O. Murta Jr

DOI: https://doi.org/10.1016/j.sigpro.2018.02.004

IF: 4.729

2018-06-01

Signal Processing

Abstract:Complexity measures, defined as measures of irregularity over time scales, are the subject of a growing number of studies as the information they reveal can find utility in a large field of applications. One of the most popular complexity measures is the multiscale entropy. Nevertheless, more and more algorithms dedicated to complexity analyses are proposed to improve the existing ones. However, such measures are available only for one-dimensional time series. For bidimensional data (images), no equivalent algorithm has been proposed to analyze irregularity over spatial scales. We herein introduce a new framework that extends the one-dimensional multiscale entropy (MSE1D) to the bidimensional case (MSE2D). Moreover, a variant of MSE2D is also ModMSE2D). The two new algorithms are tested as new texture analysis frameworks. They are applied to simulated and real data. Our results show that, compared with other existing texture analysis algorithms, MSE2D and ModMSE2D are suitable and powerful tools for image analysis and classification according to their texture patterns. While MSE2D is computationally faster than ModMSE2D, ModMSE2D is more robust to small image sizes. The two methods present interesting performances, and can be as useful as their unidimensional versions in two-dimensional applications.

engineering, electrical & electronic
Multiscale distribution entropy analysis of short epileptic EEG signals

Dae Hyeon Kim,Jin-Oh Park,Dae-Young Lee,Young-Seok Choi

DOI: https://doi.org/10.3934/mbe.2024245

2024-01-01

Mathematical Biosciences and Engineering

Abstract:This paper proposes an information-theoretic measure for discriminating epileptic patterns in short-term electroencephalogram (EEG) recordings. Considering nonlinearity and nonstationarity in EEG signals, quantifying complexity has been preferred. To decipher abnormal epileptic EEGs, i.e., ictal and interictal EEGs, via short-term EEG recordings, a distribution entropy (DE) is used, motivated by its robustness on the signal length. In addition, to reflect the dynamic complexity inherent in EEGs, a multiscale entropy analysis is incorporated. Here, two multiscale distribution entropy (MDE) methods using the coarse-graining and moving-average procedures are presented. Using two popular epileptic EEG datasets, i.e., the Bonn and the Bern-Barcelona datasets, the performance of the proposed MDEs is verified. Experimental results show that the proposed MDEs are robust to the length of EEGs, thus reflecting complexity over multiple time scales. In addition, the proposed MDEs are consistent irrespective of the selection of short-term EEGs from the entire EEG recording. By evaluating the Man-Whitney U test and classification performance, the proposed MDEs can better discriminate epileptic EEGs than the existing methods. Moreover, the proposed MDE with the moving-average procedure performs marginally better than one with the coarse-graining. The experimental results suggest that the proposed MDEs are applicable to practical seizure detection applications.

mathematical & computational biology
Symbol Dynamics, Information theory and Complexity of Economic time series

Geoffrey Ducournau

DOI: https://doi.org/10.48550/arXiv.2105.04131

2021-05-10

Statistical Finance

Abstract:We propose to examine the predictability and the complexity characteristics of the Standard&Poor500 dynamics behaviors in a coarse-grained way using the symbolic dynamics method and under the prism of the Information theory through the concept of entropy and uncertainty. We believe that experimental measurement of entropy as a way of examining the complexity of a system is more relevant than more common tests of universality in the transition to chaos because it does not make any prior prejudices on the underlying causes associated with the system dynamics, whether deterministic or stochastic. We regard the studied economic time series as being complex and propose to express it in terms of the amount of information this last is producing on different time scales and according to various scaling parameters.
A novel entropy recurrence quantification analysis

G. Corso,T. L. Prado,G. Z. dos S. Lima,S. R. Lopes

DOI: https://doi.org/10.48550/arXiv.1707.00944

2017-07-04

Other Statistics

Abstract:The growing study of time series, especially those related to nonlinear systems, has challenged the methodologies to characterize and classify dynamical structures of a signal. Here we conceive a new diagnostic tool for time series based on the concept of information entropy, in which the probabilities are associated to microstates defined from the recurrence phase space. Recurrence properties can properly be studied using recurrence plots, a methodology based on binary matrices where trajec- tories in phase space of dynamical systems are evaluated against other embedded trajectory. Our novel entropy methodology has several advantages compared to the traditional recurrence entropy defined in the literature, namely, the correct evaluation of the chaoticity level of the signal, the weak dependence on parameters, correct evaluation of periodic time series properties and more sensitivity to noise level of time series. Furthermore, the new entropy quantifier developed in this manuscript also fixes inconsistent results of the traditional recurrence entropy concept, reproducing classical results with novel insights.
Improvement of Statistical Performance of Ordinal Multiscale Entropy Techniques Using Refined Composite Downsampling Permutation Entropy

Antonio Dávalos,Meryem Jabloun,Philippe Ravier,Olivier Buttelli

DOI: https://doi.org/10.3390/e23010030

2020-12-28

Abstract:Multiscale Permutation Entropy (MPE) analysis is a powerful ordinal tool in the measurement of information content of time series. MPE refinements, such as Composite MPE (cMPE) and Refined Composite MPE (rcMPE), greatly increase the precision of the entropy estimation by modifying the original method. Nonetheless, these techniques have only been proposed as algorithms, and are yet to be described from the theoretical perspective. Therefore, the purpose of this article is two-fold. First, we develop the statistical theory behind cMPE and rcMPE. Second, we propose an alternative method, Refined Composite Downsampling Permutation Entropy (rcDPE) to further increase the entropy estimation's precision. Although cMPE and rcMPE outperform MPE when applied on uncorrelated noise, the results are higher than our predictions due to inherent redundancies found in the composite algorithms. The rcDPE method, on the other hand, not only conforms to our theoretical predictions, but also greatly improves over the other methods, showing the smallest bias and variance. By using MPE, rcMPE and rcDPE to classify faults in bearing vibration signals, rcDPE outperforms the multiscaling methods, enhancing the difference between faulty and non-faulty signals, provided we apply a proper anti-aliasing low-pass filter at each time scale.
Detecting Chaos in Pseudoperiodic Time Series Without Embedding.

J Zhang,X Luo,M Small

DOI: https://doi.org/10.1103/physreve.73.016216

IF: 2.707

2006-01-01

Physical Review E

Abstract:A different method is proposed to detect deterministic structure from a pseudoperiodic time series. By using the correlation coefficient as a measure of the distance between cycles, we are exempt from phase-space reconstruction and further construct a hierarchy of pseudocycle series that, in turn, preserve less determinism than the original time series. Appropriate statistics are then devised to reveal the temporal and spatial correlation encoded in this hierarchy of the pseudocycle series, which allows for a reliable detection of determinism and chaos in the original time series. We demonstrate that this method can reliably identify chaos in the presence of noise of different sources for both artificial data and experimental time series.
Modified multiscale sample entropy and cross-sample entropy based on horizontal visibility graph

Guancen Lin,Aijing Lin

DOI: https://doi.org/10.1016/j.chaos.2022.112802

2022-11-10

Chaos, Solitons and Fractals

Abstract:As a crucial method of the feature extraction, the complexity measurement has a wide range of applications in the field of nonlinear time series research. This paper presents an innovative multiscale sample entropy for measuring the complexity of time series based on the horizontal visibility graph. The modified multiscale sample entropy has been proven to be robust on two artificial time series, and is capable of reducing the undefined entropy generated as a result of the increase in scale. We apply the modified multiscale sample entropy to the diagnosis of epilepsy. Using a novel data processing algorithm that combines frequency bands with decomposition, feature vectors are constructed for Electroencephalography (EEG) signals through the proposed entropy calculation algorithm, and different classes of subjects are categorized based on K-Nearest Neighbors, Support Vector Machine, and Artificial Neural Network. In the meantime, we propose an improved horizontal visibility graph-based multiscale cross-sample entropy method to measure the synchronization between two time series. It shows robustness in artificial data and decreases the appearance of undefined entropy to a certain extent. It is possible to extract the characteristics of sleep EEG signals and divide the subjects' sleep stages using this method. Furthermore, this paper introduces the surrogate data test and the proposed methods have the ability to detect the nonlinearity and synchronization in simulations and in real-world experiments. Experimental results demonstrate that the two proposed frameworks are effective in monitoring human health and in assessing physical status through EEG signals.
Detecting dynamical complexity changes in time series using the base-scale entropy

Li Jin,Ning Xin-Bao,Wu Wei,Ma Xiao-Fei

DOI: https://doi.org/10.1088/1009-1963/14/12/010

2005-01-01

Chinese Physics

Abstract:Timely detection of dynamical complexity changes in natural and man-made systems has deep scientific and practical meanings. We introduce a complexity measure for time series: the base-scale entropy. The definition directly applies to arbitrary real-word data. We illustrate our method on a practical speech signal and in a theoretical chaotic system. The results show that the simple and easily calculated measure of base-scale entropy can be effectively used to detect qualitative and quantitative dynamical changes.
Multiscale permutation entropy for two-dimensional patterns

Cristina Morel,Anne Humeau-Heurtier

DOI: https://doi.org/10.1016/j.patrec.2021.06.028

IF: 4.757

2021-10-01

Pattern Recognition Letters

Abstract:Complexity measures are important to understand and analyze systems with one dimensional data. However, extension of these methods to images (two dimensional data) are much less usual. Bidimensional multiscale sample entropy (MSE2D) has recently been proposed as a new complexity measure for texture evaluation. However, MSE2D leads to undefined or unreliable values for small-sized textures and requires a long computation time. This is why we herein propose the bidimensional multiscale permutation entropy (MPE2D) to evaluate the complexity of 2D patterns. MPE2D is applied to different synthesized textures, to softwood samples, and to study the texture of breast histopathology images. The results show that MPE2D is a valuable tool for texture analysis and that it is computationally noticeably faster than MSE2D.

computer science, artificial intelligence
Generalized multivariate multiscale sample entropy for detecting the complexity in complex systems

Yi Yin,Xi Wang,Qiang Li,Pengjian Shang

DOI: https://doi.org/10.1016/j.physa.2019.123814

2020-05-01

Abstract:Using the first moment in coarse-graining the original time series in different time scales will lose some important information of the complexity. In this paper, we propose the generalized multivariate multiscale sample entropy (GMMSE) to analyze the complexity for multivariate time series. Before empirical analysis, numerical simulation is conducted by applying <math>GMMSE1</math> (mean), <math>GMMSE2</math> (variance), <math>GMMSE3</math> (skewness) to the autoregressive fractionally integrated moving average (ARFIMA) processes. The simulated results illustrate that <math>GMMSE2</math> is more appropriate to analyze the complexity of ARFIMA time series. Then we apply GMMSE method to traffic multivariate time series and discuss their complexities over different time scales. Comparing the <math>GMMSE1</math>, <math>GMMSE2</math> and <math>GMMSE3</math> results for different detectors, <math>GMMSE2</math> and <math>GMMSE3</math> can clearly differentiate the detectors with different complexity and reflect the characteristics and similarities of the complexity of traffic data between different locations. Besides, both the effect of traffic accident and the effect of the weekday and weekend patterns containing in traffic signals on the complexity can be detected by <math>GMMSE2</math> and <math>GMMSE3</math> methods. <math>GMMSE2</math> and <math>GMMSE3</math> are capable of providing more important information and knowledge concerning the complexity of traffic time series and will bring enhanced understanding of the properties of traffic system.
Detecting temporal scaling with modified diffusion entropy analysis

Garland Culbreth,Jacob Baxley,David Lambert

2023-11-20

Abstract:We present a modification to the diffusion entropy analysis method for detecting temporal scaling. Diffusion entropy analysis detects temporal scaling in a data set by converting a time-series into a diffusion trajectory and using the entropy of that trajectory to measure the temporal scaling in the data. We modify this by performing an event detection step to construct the diffusion trajectory. The new modified diffusion entropy analysis offers substantial improvements over the original method, especially for noisy data. We describe the method's purpose, how it works step-by-step, its application, and future development.

Adaptation and Self-Organizing Systems

Multiscale Entropy Analysis: A New Method to Detect Determinism in a Time Series

Using the modified sample entropy to detect determinism

Time Series Analysis Using Composite Multiscale Entropy

Analysis of complex time series using refined composite multiscale entropy

Multivariate refined composite multiscale entropy analysis

Scaling detection in time series: Diffusion entropy analysis

Information-theoretical analysis of statistical measures for multiscale dynamics

Graph-Based Multivariate Multiscale Dispersion Entropy: Efficient Implementation and Applications to Real-World Network Data

Fourier phase index for extracting signatures of determinism and nonlinear features in time series

Simplicial complex entropy for time series analysis

Two-dimensional multiscale entropy analysis: Applications to image texture evaluation

Multiscale distribution entropy analysis of short epileptic EEG signals

Symbol Dynamics, Information theory and Complexity of Economic time series

A novel entropy recurrence quantification analysis

Improvement of Statistical Performance of Ordinal Multiscale Entropy Techniques Using Refined Composite Downsampling Permutation Entropy

Detecting Chaos in Pseudoperiodic Time Series Without Embedding.

Modified multiscale sample entropy and cross-sample entropy based on horizontal visibility graph

Detecting dynamical complexity changes in time series using the base-scale entropy

Multiscale permutation entropy for two-dimensional patterns

Generalized multivariate multiscale sample entropy for detecting the complexity in complex systems

Detecting temporal scaling with modified diffusion entropy analysis