Abstract:Complexity measures and sparsity measures are capable of detecting and characterizing underlying dynamic changes in machine condition monitoring. Previous studies have developed Shannon entropy and Kullback-Leibler (KL) divergence and their generalization, namely Renyi entropy and Renyi divergence, but their theoretical properties as a function of sparsity and their transitions from complexity measures to sparsity measures are not fully explored and discussed. This paper continues conducting theoretical and experimental investigations on Renyi entropy and Renyi divergence and exploring their theoretical properties and transitions to enrich the domain of complexity and sparsity measures and their applications to machine condition monitoring. Specifically, this paper theoretically proves and verifies that Renyi entropy has a similar "bilateral reduction" effect exhibited by other complexity measures including correlation dimension, approximate entropy, fuzzy entropy and sample entropy. Inspired by relative entropy, which is a special case of KL divergence and a sparsity measure, and the relationship between KL divergence and Renyi divergence, in this paper, we attempt to generalize relative entropy by adding an order of alpha, to convert a series of complexity measures from Renyi entropy to a series of sparsity measures, which answers how to realize transitions from complexity measures to sparsity measures. More importantly, this paper is helpful to provide a guideline for correct uses of Renyi entropy, Renyi divergence, and generalized relative entropy for the quantification of impulsive transients caused by machine faults for machine condition monitoring.

SOME NEW RESULTS ON RÉNYI ENTROPY OF RESIDUAL LIFE AND INACTIVITY TIME

On Stochastic Dependence in Residual Lifetime and Inactivity Time with Some Applications

Stochastic Comparison of Residual Life and Inactivity Time at a Random Time

Some new results involving residual Renyi's information measure for $ k $-record values

Further Results Involving Residual and Past Extropy with their Applications

Some Results about Mit Order and Imit Class of Life Distributions

Generalized Entropies, Variance and Applications

Generalized Relative Entropy: New Look at Rényi Entropy and Its Exploration from Complexity Measures to Sparsity Measures with Applications in Machine Condition Monitoring

MONOTONICITY PROPERTIES OF RESIDUAL LIFETIMES OF PARALLEL SYSTEMS AND INACTIVITY TIMES OF SERIES SYSTEMS WITH HETEROGENEOUS COMPONENTS

On Weighted Residual and Past Entropies

Some reliability properties of extropy for residual and past lifetime random variables

STOCHASTIC COMPARISONS ON RESIDUAL LIFE AND INACTIVITY TIME OF SERIES AND PARALLEL SYSTEMS

Stochastic properties of two general versions of the residual lifetime at random times

Entrance Time and Rényi Entropy

On extropy of past lifetime distribution

Non parametric estimation of residual-past entropy, mean residual-past lifetime, residual-past inaccuracy measure and asymptotic limits

Properties of the Shannon, Rényi and other entropies: dependence in parameters, robustness in distributions and extremes

Non-Hermitian Generalization of Rényi Entropy

Some New Results Involving the NBU(2) Class of Life Distributions

Relative Entropy via Distribution of Observables

Residual Inaccuracy Extropy and its properties