Cumulative Diversity Pattern Entropy (cden): A High-Performance, Almost-Parameter-Free Complexity Estimator for Nonstationary Time Series

Yalin Wang,Minghui Liu,Yao Guo,Feng Shu,Chen,Wei Chen

DOI: https://doi.org/10.1109/tii.2022.3233652

IF: 12.3

2023-01-01

IEEE Transactions on Industrial Informatics

Abstract:Tedious parameter settings and poor performances seriously affect the entropy estimation's effectiveness in time series analysis. To solve these limits, we propose a conceptually novel definition, cumulative diversity pattern entropy (CDEn), focusing on eliminating parameter selections and improving quantization accuracy, stability, and robustness. The CDEn algorithm consists of three steps: 1) improved phase-space reconstruction (IPSR) with constant embedding dimension $m= 2$ and time delay $\tau =1$ ; 2) diversity pattern partition generated by the cosine similarity between adjacent vectors; and 3) entropy calculation based on the normalized cumulative probability distribution. Numerical experiments are performed using 7 synthetic datasets and 15 baseline entropy methods for comparative validation. The results confirm CDEn's best description of chaotic/stochastic dynamics with the highest quantization accuracy and the lowest error rate of 2.04%. The coefficient of variation (CV) results also verify CDEn's excellent quantization stability with CV lower than 10 −2 . The relative change rate results demonstrate that CDEn achieves the best robustness to data length and noise. Finally, the entropy algorithms are applied to a real-world dataset, i.e., neonatal sleep EEG analysis. The results further confirm that suggested CDEn outperforms the state-of-the-art entropy methods, with the minimum outliers and best statistical significance (highest mean of effect size, 1.22) in characterizing the neurodynamics of different sleep stages.