Abstract:The refinement axiom for entropy has been provocative in providing foundations of information theory, recognised as thoughtworthy in the writings of both Shannon and Jaynes. A resolution to their concerns has been provided recently by the discovery that the entropy measure of a probability distribution has a dual measure, a complementary companion designated as "extropy". We report here the main results that identify this fact, specifying the dual equations and exhibiting some of their structure. The duality extends beyond a simple assessment of entropy, to the formulation of relative entropy and the Kullback symmetric distance between two forecasting distributions. This is defined by the sum of a pair of directed divergences. Examining the defining equation, we notice that this symmetric measure can be generated by two other explicable pairs of functions as well, neither of which is a Bregman divergence. The Kullback information complex is constituted by the symmetric measure of entropy/extropy along with one of each of these three function pairs. It is intimately related to the total logarithmic score of two distinct forecasting distributions for a quantity under consideration, this being a complete proper score. The information complex is isomorphic to the expectations that the two forecasting distributions assess for their achieved scores, each for its own score and for the score achieved by the other. Analysis of the scoring problem exposes a Pareto optimal exchange of the forecasters' scores that both are willing to engage. Both would support its evaluation for assessing the relative quality of the information they provide regarding the observation of an unknown quantity of interest. We present our results without proofs, as these appear in source articles that are referenced. The focus here is on their content, unhindered. The mathematical syntax of probability we employ relies upon the operational subjective constructions of Bruno de Finetti.

Entropy, neutro-entropy and anti-entropy for neutrosophic information

Shannon Entropy for Neutrosophic Information

Neutrosophic information in the framework of multi-valued representation

Neutrosophic Set is a Generalization of Intuitionistic Fuzzy Set, Inconsistent Intuitionistic Fuzzy Set (Picture Fuzzy Set, Ternary Fuzzy Set), Pythagorean Fuzzy Set, q-Rung Orthopair Fuzzy Set, Spherical Fuzzy Set, etc

Introduction to Neutrosophic Measure, Neutrosophic Integral, and Neutrosophic Probability

Similarity, Cardinality and Entropy for Bipolar Fuzzy Set in the Framework of Penta-valued Representation

Shannon entropy for imprecise and under-defined or over-defined information

Entropy and Syntropy in the Context of Five-Valued Logics

Complex-valued Renyi Entropy

Interval Neutrosophic Sets

New inclusion relation of neutrosophic sets with applications and related lattice structure

Gray Level Image Threshold Using Neutrosophic Shannon Entropy

On Single Valued Neutrosophic Relations.

The Duality of Entropy/Extropy, and Completion of the Kullback Information Complex

New Trends in Neutrosophic Theory and Applications

Non-Hermitian Generalization of Rényi Entropy

Shannon entropy for intuitionistic fuzzy information

Markov Categories and Entropy

An Introduction to Single-Valued Neutrosophic Primal Theory

Entropy measures and granularity measures for interval and set-valued information systems