Abstract:In general, information contains both of the physical attributes and the psychological attributes. For these two kind attributes of information, this paper discussed the incompleteness of the axioms system of the current information entropy theories. It is necessary to add the condition of boundedness to the axioms system when it is used to measure the uncertainty of psychological information. A new family of information entropy using a convex-concave function is introduced for satisfying the psychological attributes of information. And based on the psychological information entropy function, the divergence measures between two probability distributions of psychological information defined as Wang-Huang divergences are formulated. For the boundedness attributes of the psychological information entropy function and not requiring the condition of absolute continuity to be satisfied by the probability distributions involved, Wang-Huang divergences are totally different with the Kullback-Leiber divergences. The new measures are well characterized by the properties of non-negativity, finiteness. More importantly, their close relationship with the variation and the probability of misclassification error are established in terms of bounds illustrated in numerical examples. These bounds are crucial in many applications of divergence measures such as in the quality and reliability engineering applications.

Tsallis eXtropy

On Tsallis extropy with an application to pattern recognition

Further properties of Tsallis extropy and some of its related measures

Nonextensive Belief Entropy

Plausibility Extropy: The Complementary Dual of Plausibility Entropy

Belief Extropy: Measure Uncertainty from Negation

Continuous Tsallis and Renyi extropy with pharmaceutical market application

Tsallis Value-at-risk: Generalized Entropic Value-at-risk

Tsallis entropy of uncertain sets and its application to portfolio allocation

Residual and Past Discrete Tsallis and Renyi Extropy with an Application to Softmax Function

Extropy: Characterizations and dynamic versions

Axioms and uniqueness theorem for Tsallis entropy

Dynamic Tsallis entropy for simple model systems

Exponential entropy of uncertain sets and its applications to learning curve and portfolio optimization

The unified extropy and its versions in classical and Dempster–Shafer theories

A Note on Mathai's Entropy Measure

Qualms concerning Tsallis's condition of pseudo-additivity as a definition of non-extensivity

Stationary and dynamical properties of information entropies in nonextensive systems

On the exact variance of Tsallis entropy in a random pure state

Psychological Information Entropy and Its Applications to Reliability Engineering

Uncertainty Measure Based on Tsallis Entropy in Evidence Theory