Measure of Information Content of Basic Belief Assignments

Dezert Jean,Tchamova Albena,Han Deqiang

DOI: https://doi.org/10.1007/978-3-031-17801-6_12

2022-01-01

Abstract:In this paper, we present a measure of Information Content (IC) of Basic Belief Assignments (BBAs), and we show how it can be easily calculated. This new IC measure is interpreted as the dual of the effective measure of uncertainty (i.e. generalized entropy) of BBAs developed recently.

What problem does this paper attempt to address?

A Modified Belief Entropy in Dempster-Shafer Framework

Deyun Zhou,Yongchuan Tang,Wen Jiang

DOI: https://doi.org/10.1371/journal.pone.0176832

IF: 3.7

2017-01-01

PLoS ONE

Abstract:How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What's more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method.
An Improved Belief Entropy and Its Application in Decision-Making

Deyun Zhou,Yongchuan Tang,Wen Jiang

DOI: https://doi.org/10.1155/2017/4359195

IF: 2.3

2017-01-01

Complexity

Abstract:Uncertainty measure in data fusion applications is a hot topic; quite a few methods have been proposed to measure the degree of uncertainty in Dempster-Shafer framework. However, the existing methods pay little attention to the scale of the frame of discernment (FOD), which means a loss of information. Due to this reason, the existing methods cannot measure the difference of uncertain degree among different FODs. In this paper, an improved belief entropy is proposed in Dempster-Shafer framework. The proposed belief entropy takes into consideration more available information in the body of evidence (BOE), including the uncertain information modeled by the mass function, the cardinality of the proposition, and the scale of the FOD. The improved belief entropy is a new method for uncertainty measure in Dempster-Shafer framework. Based on the new belief entropy, a decision-making approach is designed. The validity of the new belief entropy is verified according to some numerical examples and the proposed decision-making approach.
A Method of Inducing Ordered Basic Belief Assignment and Its Application in Risk Assessment of Tailing Dam

Xiaoxi Wang

2014-01-01

Abstract:For poor risk assessment effect resulted from D-S evidence theory unable to handle exponential power information in assessment model of tailing dam,a flexible similarity measure and an inducing ordered basic belief assignment for uncertain information were put forward. A flexible similarity measure was proposed by non-1 feature of core values in generalized fuzzy number and variability of boundary power in adaptive fuzzy number. According to the difference of variation coefficients for monitoring information,ordered matrix was induced in order to produce basic belief function. Taking practical date of tailing dam as an example,the validity of an inducing ordered basic belief assignment method is proved by D-S combination rule.
Belief measures conditioned on random set

Yongchuan Tang,Jiacheng Zheng,Yangguang Liu,Shouqian Sun

DOI: https://doi.org/10.1109/ICSMC.2004.1400675

2004-01-01

Abstract:Conditioning is the generally agreed-upon method for updating a priori knowledge representable by a probability distribution when one learns that an event is certainly true. When one learns that the observation is uncertain, the rule of cross-entropy minimization can be used to handle the updating of a priori probability distribution. This paper examines how to update a priori knowledge which is representable by a random set, when one learns that the observation is representable by another random set. In order to resolve this problem, firstly, for each a priori probability distribution, a conditioning rule to define a posterior probability distribution conditioned on the observed random set is derived from the rule of cross-entropy minimization, this conditioning rule is called as the generalized Jeffrey's rule in this paper. The derived posterior probability is compatible with the observed random set and 'close' to the original priori probability distribution. Secondly, based on the general Jeffrey's rule, a new belief measure conditioned on random set is derived and its relationship with the knowledge updating is discussed. At last, the convergence of the sequence of probability distributions by applying the generalized Jeffrey's rule is discussed in this paper.
An Improved Belief Entropy to Measure Uncertainty of Basic Probability Assignments Based on Deng Entropy and Belief Interval

Yonggang Zhao,Duofa Ji,Xiaodong Yang,Liguo Fei,Changhai Zhai

DOI: https://doi.org/10.3390/e21111122

IF: 2.738

2019-01-01

Entropy

Abstract:It is still an open issue to measure uncertainty of the basic probability assignment function under Dempster-Shafer theory framework, which is the foundation and preliminary work for conflict degree measurement and combination of evidences. This paper proposes an improved belief entropy to measure uncertainty of the basic probability assignment based on Deng entropy and the belief interval, which takes the belief function and the plausibility function as the lower bound and the upper bound, respectively. Specifically, the center and the span of the belief interval are employed to define the total uncertainty degree. It can be proved that the improved belief entropy will be degenerated to Shannon entropy when the the basic probability assignment is Bayesian. The results of numerical examples and a case study show that its efficiency and flexibility are better compared with previous uncertainty measures.
Generalizing Information to the Evolution of Rational Belief

Jed A Duersch,Thomas A Catanach,Jed A. Duersch,Thomas A. Catanach

DOI: https://doi.org/10.3390/e22010108

IF: 2.738

2020-01-16

Entropy

Abstract:Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome’s plausibility. Information measures based on Shannon’s concept of entropy include realization information, Kullback–Leibler divergence, Lindley’s information in experiment, cross entropy, and mutual information. We derive a general theory of information from first principles that accounts for evolving belief and recovers all of these measures. Rather than simply gauging uncertainty, information is understood in this theory to measure change in belief. We may then regard entropy as the information we expect to gain upon realization of a discrete latent random variable. This theory of information is compatible with the Bayesian paradigm in which rational belief is updated as evidence becomes available. Furthermore, this theory admits novel measures of information with well-defined properties, which we explored in both analysis and experiment. This view of information illuminates the study of machine learning by allowing us to quantify information captured by a predictive model and distinguish it from residual information contained in training data. We gain related insights regarding feature selection, anomaly detection, and novel Bayesian approaches.

physics, multidisciplinary
New basic belief assignment approximations based on optimization

Deqiang Han,Jean Dezert,Chongzhao Han

2012-01-01

Abstract:The theory of belief function, also called Dempster-Shafer evidence theory, has been proved to be a very useful representation scheme for expert and other knowledge based systems. However, the computational complexity of evidence combination will become large with the increasing of the frame of discernment's cardinality. To reduce the computational cost of evidence combination, the idea of basic belief assignment (bba) approximation was proposed, which can reduce the complexity of the given bba's. To realize a good bba approximation, the approximated bba should be similar (in some sense) to the original bba. In this paper, we use the distance of evidence together with the difference between the uncertainty degree of approximated bba and that of the original one to construct a comprehensive measure, which can represent the similarity between the approximated bba and the original one. By using such a comprehensive measure as the objective function and by designing some constraints, the bba approximation is converted to an optimization problem. Comparative experiments are provided to show the rationality of the construction of comprehensive similarity measure and that of the constraints designed.
A Matrix Method of Basic Belief Assignment's Negation in Dempster-Shafer Theory

Ziyuan Luo,Yong Deng

DOI: https://doi.org/10.1109/TFUZZ.2019.2930027

IF: 12.253

2020-01-01

IEEE Transactions on Fuzzy Systems

Abstract:Negation is a new perspective to represent knowledge. The negation of probability distribution has been proposed, and it has a lot of interesting properties, which can reach a maximum entropy. Because of the defects of the classical probability theory in the expression of uncertainty, the basic belief assignment (BBA) in the Dempster-Shafer theory (D-S theory) are widely used in decision theory. Thus, negation provides a new perspective for D-S theory to measure fuzziness. In this paper, a new definition of negation of BBA is presented. In the proposed negation, BBAs are represented as vectors, and negation is realized by matrix operators. This method has a good interpretation of the matrix operators and has the merit of simplifying the problem. With several different definitions of entropy to determinate the uncertainty of BBA, the proposed negation of BBA can reach a maximum belief entropy when the entropies satisfy a certain property.
Comparative Study of Contradiction Measures in the Theory of Belief Functions

Smarandache, F.,Deqiang Han,Martin, A.

DOI: https://doi.org/10.5281/zenodo.30141

IF: 18.6

2012-01-01

Information Fusion

Abstract:Uncertainty measures in the theory of belief functions are important for the uncertainty representation and reasoning. Many measures of uncertainty in the theory of belief functions have been introduced. The degree of discord (or conflict) inside a body of evidence is an important index for measuring uncertainty degree. Recently, distance of evidence is used to define a contradiction measure for quantifying the degree of discord inside a body of evidence. The contradiction measure is actually the weighted summation of the distance values between a given basic belief assignment (bba) and the categorical bba's defined on each focal element of the given bba redefined in this paper. It has normalized value and can well characterize the self-discord incorporated in bodies of evidence. We propose here, some numerical examples with comparisons among different uncertainty measures are provided, together with related analyses, to show the rationality of the proposed contradiction measure.
Generalised Measures of Multivariate Information Content

Conor Finn,Joseph T. Lizier

DOI: https://doi.org/10.3390/e22020216

2019-12-11

Abstract:The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of multivariate information content that can be accurately depicted using Venn diagrams for any number of random variables. These measures complement the existing measures of multivariate mutual information and are constructed by considering the algebraic structure of information sharing. It is shown that the distinct ways in which a set of marginal observers can share their information with a non-observing third party corresponds to the elements of a free distributive lattice. The redundancy lattice from partial information decomposition is then subsequently and independently derived by combining the algebraic structures of joint and shared information content.

Information Theory
A New Correlation Measure for Belief Functions and Their Application in Data Fusion

Zhuo Zhang,Hongfei Wang,Jianting Zhang,Wen Jiang

DOI: https://doi.org/10.3390/e25060925

IF: 2.738

2023-06-12

Entropy

Abstract:Measuring the correlation between belief functions is an important issue in Dempster–Shafer theory. From the perspective of uncertainty, analyzing the correlation may provide a more comprehensive reference for uncertain information processing. However, existing studies about correlation have not combined it with uncertainty. In order to address the problem, this paper proposes a new correlation measure based on belief entropy and relative entropy, named a belief correlation measure. This measure takes into account the influence of information uncertainty on their relevance, which can provide a more comprehensive measure for quantifying the correlation between belief functions. Meanwhile, the belief correlation measure has the mathematical properties of probabilistic consistency, non-negativity, non-degeneracy, boundedness, orthogonality, and symmetry. Furthermore, based on the belief correlation measure, an information fusion method is proposed. It introduces the objective weight and subjective weight to assess the credibility and usability of belief functions, thus providing a more comprehensive measurement for each piece of evidence. Numerical examples and application cases in multi-source data fusion demonstrate that the proposed method is effective.

physics, multidisciplinary
A Unified Information Measure for General Binary Relations

Changzhong Wang,Qiang He,Mingwen Shao,Yangyang Xu,Qinghua Hu

DOI: https://doi.org/10.1016/j.knosys.2017.07.017

IF: 8.139

2017-01-01

Knowledge-Based Systems

Abstract:Shannon's entropy and its variants have been applied to measure uncertainty in a variety of special binary relations. However, few studies have been conducted on uncertainty of general binary relations. In this study, we present a unified form of uncertainty measures for general binary relations. We redefine the concepts of entropy, joint entropy, conditional entropy, and mutual information. These uncertainty measures are generalizations of corresponding measures of special relations. We study the relationship between these measures and examine important properties. Finally, numerical experiments are performed to identify applications of the proposed uncertainty measures. Comparing with existing uncertainty measures, the proposed method not only addresses the uncertainty of heterogeneous data sets, but also exhibit better performance in attribute reduction. This study can provide a fundamental framework for uncertainty theories of special rough set models.
A measure of statistical complexity based on predictive information

Samer A. Abdallah,Mark D. Plumbley

DOI: https://doi.org/10.48550/arXiv.1012.1890

2010-12-09

Abstract:We introduce an information theoretic measure of statistical structure, called 'binding information', for sets of random variables, and compare it with several previously proposed measures including excess entropy, Bialek et al.'s predictive information, and the multi-information. We derive some of the properties of the binding information, particularly in relation to the multi-information, and show that, for finite sets of binary random variables, the processes which maximises binding information are the 'parity' processes. Finally we discuss some of the implications this has for the use of the binding information as a measure of complexity.

Statistics Theory,Information Theory,Data Analysis, Statistics and Probability
An Uncertainty Measure for Interval-valued Evidences

Wen Jiang,Shiyu Wang

DOI: https://doi.org/10.15837/ijccc.2017.5.2950

2017-09-10

Abstract:Interval-valued belief structure (IBS), as an extension of single-valued belief structures in Dempster-Shafer evidence theory, is gradually applied in many fields. An IBS assigns belief degrees to interval numbers rather than precise numbers, thereby it can handle more complex uncertain information. However, how to measure the uncertainty of an IBS is still an open issue. In this paper, a new method based on Deng entropy denoted as UIV is proposed to measure the uncertainty of the IBS. Moreover, it is proved that UIV meets some desirable axiomatic requirements. Numerical examples are shown in the paper to demonstrate the efficiency of UIV by comparing the proposed UIV with existing approaches.

computer science, information systems,automation & control systems
Modeling Belief Propensity Degree: Measures of Evenness and Diversity of Belief Functions

Qianli Zhou,Eloi Bosse,Yong Deng

DOI: https://doi.org/10.1109/tsmc.2022.3219996

2022-01-01

IEEE Transactions on Systems Man and Cybernetics Systems

Abstract:Based on Klir’s framework of uncertainty, the total uncertainty (also called ambiguity) of belief function is linear addition of discord and nonspecificity. Though uncertainty measures of belief function have been discussed widely, there is no measure that can satisfy the monotonicity and range consistency properties at the same time. In this article, we discuss uncertainty measure of belief function from the perspective of information fractal dimension. An uncertainty quantity called evenness and its measure Eve are proposed, which can represent the belief propensity degree of belief function. We first propose the measures of diversity (normalized nonspecificity) and the element evenness (normalized discord), and then fuse them to calculate Eve. The proposed method can not only measure the subnormal mass function but also interpret the different views of Klir and Smets on “Uncertainty.” In addition, we extend Klir’s framework of uncertainty based on the proposed information quantities.
Evidential distance measure in complex belief function theory

Fuyuan Xiao

DOI: https://doi.org/10.48550/arXiv.1907.00716

IF: 14.4

2019-06-27

Artificial Intelligence

Abstract:In this paper, an evidential distance measure is proposed which can measure the difference or dissimilarity between complex basic belief assignments (CBBAs), in which the CBBAs are composed of complex numbers. When the CBBAs are degenerated from complex numbers to real numbers, i.e., BBAs, the proposed distance will degrade into the Jousselme et al.'s distance. Therefore, the proposed distance provides a promising way to measure the differences between evidences in a more general framework of complex plane space.
Fractal-based Belief Entropy

Qianli Zhou,Yong Deng

DOI: https://doi.org/10.1016/j.ins.2021.12.032

IF: 8.1

2022-01-01

Information Sciences

Abstract:The total uncertainty measurement of basic probability assignment (BPA) in Dempster Shafer evidence theory (DSET) has always been an open issue. Although some scholars put forward various measurements and entropies of BPA, due to the existence of discord and non-specificity, there is no method can measure BPA reasonably. In order to utilize BPA to practical decision-making, pignistic probability transformation of BPA is a significant method. In the paper, we simulate the pignistic probability transformation (PPT) process based on the fractal idea, which describes PPT process in detail and shows the process of information volume changes during transformation intuitively. Based on transformation process, we propose a new belief entropy called fractal-based belief (FB) entropy. After verification, FB entropy is superior to all existing belief entropies in terms of total uncertainty measurement and physical model consistency.(c) 2021 Elsevier Inc. All rights reserved.
Basic Belief Assignment Approximations Using Degree of Non-Redundancy for Focal Element

Yi Yang,Deqiang Han,Jean Dezert

DOI: https://doi.org/10.1016/j.cja.2019.05.003

IF: 5.7

2019-01-01

Chinese Journal of Aeronautics

Abstract:Dempster-Shafer evidence theory, also called the theory of belief function, is widely used for uncertainty modeling and reasoning. However, when the size and number of focal elements are large, the evidence combination will bring a high computational complexity. To address this issue, various methods have been proposed including the implementation of more efficient combination rules and the simplifications or approximations of Basic Belief Assignments (BBAs). In this paper, a novel principle for approximating a BBA into a simpler one is proposed, which is based on the degree of non-redundancy for focal elements. More non-redundant focal elements are kept in the approximation while more redundant focal elements in the original BBA are removed first. Three types of degree of non-redundancy are defined based on three different definitions of focal element distance, respectively. Two different implementations of this principle for BBA approximations are proposed including a batch and an iterative type. Examples, experiments, comparisons and related analyses are provided to validate proposed approximation approaches.
Quantum Belief Function

Qianli Zhou,Guojing Tian,Yong Deng

2021-01-01

Abstract:The belief function in Dempster Shafer evidence theory can express more information than the traditional Bayesian distribution. It is widely used in approximate reasoning, decision-making and information fusion. However, its power exponential explosion characteristics leads to the extremely high computational complexity when handling large amounts of elements in classic computers. In order to solve the problem, we encode the basic belief assignment (BBA) into quantum states, which makes each qubit correspond to control an element. Besides the high eﬃciency, this quantum expression is very conducive to measure the similarity between two BBAs, and the measuring quantum algorithm we come up with has exponential acceleration theoretically compared to the corresponding classical algorithm. In addition, we simulate our quantum version of BBA on Qiskit platform, which ensures the rationality of our algorithm experimentally. We believe our results will shed some light on utilizing the characteristic of quantum computation to handle belief function more conveniently.
New construction approach of basic belief assignment function based on confusion matrix

Jing Zhu,Maolin Yan,Chenxi Wang,Lifang Hu

2012-01-01

Abstract:In the application of belief function theory, the first problem is the construction of the basic belief assignment. This study presents a new construction approach based on the confusion matrix. The method starts from the output of the confusion matrix and then designs construction strategy for basic belief assignment functions based on the expectation vector of the confusion matrix. Comparative tests of several other construction methods on the U.C.I database show that our proposed method can achieve higher target classification accuracy, lower computational complexity, which has a strong ability to promote the application. © Maxwell Scientific Organization, 2012.

Measure of Information Content of Basic Belief Assignments

A Modified Belief Entropy in Dempster-Shafer Framework

An Improved Belief Entropy and Its Application in Decision-Making

A Method of Inducing Ordered Basic Belief Assignment and Its Application in Risk Assessment of Tailing Dam

Belief measures conditioned on random set

An Improved Belief Entropy to Measure Uncertainty of Basic Probability Assignments Based on Deng Entropy and Belief Interval

Generalizing Information to the Evolution of Rational Belief

New basic belief assignment approximations based on optimization

A Matrix Method of Basic Belief Assignment's Negation in Dempster-Shafer Theory

Comparative Study of Contradiction Measures in the Theory of Belief Functions

Generalised Measures of Multivariate Information Content

A New Correlation Measure for Belief Functions and Their Application in Data Fusion

A Unified Information Measure for General Binary Relations

A measure of statistical complexity based on predictive information

An Uncertainty Measure for Interval-valued Evidences

Modeling Belief Propensity Degree: Measures of Evenness and Diversity of Belief Functions

Evidential distance measure in complex belief function theory

Fractal-based Belief Entropy

Basic Belief Assignment Approximations Using Degree of Non-Redundancy for Focal Element

Quantum Belief Function

New construction approach of basic belief assignment function based on confusion matrix