Fuzzy Entropy of Vague Sets and Its Construction

Fang Xu

2011-01-01

Computer Engineering and Applications Journal

Abstract:The drawbacks of existing fuzzy entropy of Vague set are pointed out.Through analyzing the voting model,the axiomatizing definition on fuzzy entropy of vague set is given,and a new fuzzy entropy of Vague set is proposed and its rationality and validity are proved in this paper.

What problem does this paper attempt to address?

Entropy Rules for Vague Sets with Corresponding Entropy Measures

Li Yan-Hong,Li Si-Zhi,Si Z. Li

DOI: https://doi.org/10.1109/FSKD.2007.271

2007-01-01

Abstract:This paper provides two types of entropy rules for vague sets with corresponding entropy measures. These measures are compared with previously presented measures with examples. The performance of proposed measures are evaluated analytically. Through analysis and examples it is shown that the proposed approaches work well in determining the fuzziness of vague sets.
Axiomatic framework of fuzzy entropy and hesitancy entropy in fuzzy environment

Ting-Ting Xu,Hui Zhang,Bo-Quan Li

DOI: https://doi.org/10.1007/s00500-020-05216-9

IF: 3.732

2020-08-03

Soft Computing

Abstract:Entropy is a vital concept to measure uncertainties, in order to measure the uncertainties of fuzzy sets (FSs), intuitionist fuzzy sets (IFSs) and Pythagorean fuzzy sets (PFSs) more fully, in this paper, the axiomatic definition of fuzzy entropy of FSs is modified, the entropy measures of IFSs and PFSs are categorized as fuzzy entropy and hesitancy entropy, and the axiomatic definitions of these two entropy measures are also revised. Further, the axiomatic definitions of two overall entropies are given based on fuzzy entropy and hesitancy entropy, and the expressions of overall entropy of IFSs and PFSs are constructed by special functions. Then, it is shown that three existing overall entropy formulas can be constructed by three particular functions, and their rationality is proved. Finally, the effectiveness and feasibility of the proposed method and overall entropy are illustrated by an example and two comparative analyses.

computer science, artificial intelligence, interdisciplinary applications
An Improved Belief Entropy and Its Application in Decision-Making

Deyun Zhou,Yongchuan Tang,Wen Jiang

DOI: https://doi.org/10.1155/2017/4359195

IF: 2.3

2017-01-01

Complexity

Abstract:Uncertainty measure in data fusion applications is a hot topic; quite a few methods have been proposed to measure the degree of uncertainty in Dempster-Shafer framework. However, the existing methods pay little attention to the scale of the frame of discernment (FOD), which means a loss of information. Due to this reason, the existing methods cannot measure the difference of uncertain degree among different FODs. In this paper, an improved belief entropy is proposed in Dempster-Shafer framework. The proposed belief entropy takes into consideration more available information in the body of evidence (BOE), including the uncertain information modeled by the mass function, the cardinality of the proposition, and the scale of the FOD. The improved belief entropy is a new method for uncertainty measure in Dempster-Shafer framework. Based on the new belief entropy, a decision-making approach is designed. The validity of the new belief entropy is verified according to some numerical examples and the proposed decision-making approach.
A collective decision model involving vague concepts and linguistic expressions.

Yongchuan Tang

DOI: https://doi.org/10.1109/TSMCB.2007.913125

2008-01-01

Abstract:In linguistic collective decision, the main objective is to select the best alternatives using linguistic evaluations provided by multiple experts. This paper presents a collective decision model, which is able to deal with complex linguistic evaluations. In this decision model, the linguistic evaluations are represented by linguistic expressions which are the logic formulas obtained by applying logic connectives to the set of basic linguistic labels. The vagueness of each linguistic expression is implicitly captured by a semantic similarity relation rather than a fuzzy set, since each linguistic expression determines a semantic similarity distribution on the set of basic linguistic labels. The basic idea of this collective decision model is to convert the semantic similarity distributions determined by linguistic expressions into probability distributions of the corresponding linguistic expressions. The main advantage of this proposed model is its capability to deal with complex linguistic evaluations and partial semantic overlapping among neighboring linguistic labels.
The entropy of fuzzy variables

Pingke Li,Baoding Liu

2005-01-01

Abstract:This paper deals with the degree of uncertainty associated with fuzzy variables. An information theoretical view is applied to characterize the uncertainty of fuzzy variables and the difference between measuring the uncertainty of fuzzy variables and fuzzy sets is indicated. Based on credibility measure, the entropy of fuzzy variables is formulated to quantify the uncertainty of fuzzy variables and its properties are investigated as well as some examples are given for illustration. In addition, the definition of quadratic entropy of fuzzy variables is provided as an alternative measure of uncertainty.
Fuzzy entropy and hesitancy entropy in probabilistic hesitant fuzzy information and their applications

Ting-Ting Xu,Hui Zhang,Bo-Quan Li

DOI: https://doi.org/10.1007/s00500-022-07309-z

IF: 3.732

2022-08-09

Soft Computing

Abstract:In recent years, the concept of probabilistic hesitant fuzzy sets (P-HFSs) has been proposed as an improvement of hesitant fuzzy sets (HFSs), which has the advantage of representing deeper uncertainty. In order to fully measure the uncertainty for probabilistic hesitant fuzzy information, in this study, the axiomatic definition of fuzzy entropy of individual elements in weak probabilistic hesitant fuzzy elements (WPHFEs) is proposed according to the distribution characteristics of fuzziness, and the axiomatic definitions of fuzzy entropy and hesitancy entropy of WPHFEs are established as well. On this basis, the axiomatic definition of overall entropy for WPHFEs is studied by combining fuzzy entropy and hesitancy entropy. Meanwhile, a new ranking method and decision-making method are given based on the proposed entropies. Finally, the practicability and effectiveness of the proposed methods are illustrated by an example and two comparative analyses.

computer science, artificial intelligence, interdisciplinary applications
A Survey of Entropy of Fuzzy Variables

Baoding Liu

2007-01-01

Abstract:Abstract Given a fuzzy variable, what is the degree of di‐culty of predicting the specifled value that the fuzzy variable will take? Entropy provides a measure to characterize the fuzziness. Given some constraints, there are usually multiple compatible membership functions. Which membership function shall we take? The maximum,entropy principle attempts to select the membership func- tion that maximizes the value of entropy. This paper provides a personal (not balanced) overview of entropy of fuzzy variables and fuzzy maximum,entropy principle. Three basic requirements for entropy of fuzzy variables are also introduced. Finally, the cross-entropy and quadratic entropy of fuzzy variables are documented. c ∞ 2007 World Academic Press, UK. All rights reserved. Keywords: fuzzy variable, credibility measure, entropy, maximum entropy principle
Maximum Entropy Principle For Fuzzy Variables

Xiang Li,Baoding Liu

DOI: https://doi.org/10.1142/S0218488507004595

2007-01-01

International Journal of Uncertainty Fuzziness and Knowledge-Based Systems

Abstract:The concept of fuzzy entropy is used to provide a quantitative measure of the uncertainty associated with every fuzzy variable. This paper proposes the maximum entropy principle for fuzzy variables, that is, out of all the membership functions satisfying given constraints, choose the one that has maximum entropy. The problem is what is the specific formulation of the maximum entropy membership function. The purpose of this paper is to solve this problem by Euler-Lagrange equation.
Entropy of Credibility Distributions for Fuzzy Variables

Pingke Li,Baoding Liu

DOI: https://doi.org/10.1109/TFUZZ.2007.894975

IF: 12.253

2008-01-01

IEEE Transactions on Fuzzy Systems

Abstract:This paper deals with the degree of uncertainty associated with fuzzy variables. Based on the notion of credibility measure, a definition of entropy is formulated from an information theoretical view and its properties are investigated. Finally, some comments are given on the construction of alternative definitions of entropy and axiomatic characterization.
Fuzzy Entropy: A More Comprehensible Perspective for Interval Shadowed Sets of Fuzzy Sets

Qinghua Zhang,Yuhong Chen,Jie Yang,Guoyin Wang

DOI: https://doi.org/10.1109/tfuzz.2019.2947224

IF: 12.253

2020-11-01

IEEE Transactions on Fuzzy Systems

Abstract:Shadowed sets, proposed by Pedrycz, provide a three-way approximation scheme for transforming the universe of a fuzzy set into three disjoint areas, i.e., elevated area, reduced area, and shadow area. To calculate a pair of decision-making thresholds, an analytic method was proposed by solving a minimization problem of the uncertainty arising from the three areas. However, some uncertainty will be lost in the process of constructing the shadowed set model using Pedrycz's method. Moreover, few references on how to measure the uncertainty of shadow sets exist. In this article, a comprehensible method for measuring the fuzzy entropy of a shadowed set, i.e., interval fuzzy entropy, is defined. Based on the interval fuzzy entropy, a new shadowed set model, namely, interval shadowed sets, is proposed. Compared with Pedrycz's model, the main difference is that the range of the shadow area in this model is $[beta,alpha ]$ $(0 leq beta < alpha leq 1)$ while not [0, 1]. By solving a fuzzy entropy loss-minimization problem, a pair of optimal thresholds, $alpha$ and $beta$, can be obtained. Finally, the results of the instance analysis of different types of representative membership functions and many experiments show that the fuzzy entropy loss of the interval shadowed set is lower than that of the traditional shadowed set of a fuzzy set. These results enrich shadowed set theory from a new perspective.

computer science, artificial intelligence,engineering, electrical & electronic
A (Basis for a) Philosophy of a Theory of Fuzzy Computation

Apostolos Syropoulos

DOI: https://doi.org/10.2478/kjps-2018-0009

2016-03-17

Abstract:Vagueness is a linguistic phenomenon as well as a property of physical objects. Fuzzy set theory is a mathematical model of vagueness that has been used to define vague models of computation. The prominent model of vague computation is the fuzzy Turing machine. This conceptual computing device gives an idea of what computing under vagueness means, nevertheless, it is not the most natural model. Based on the properties of this and other models of vague computing, it is aimed to formulate a basis for a philosophy of a theory of fuzzy computation.

Other Computer Science
A novel cross-entropy and entropy measures of IFSs and their applications

Junjun Mao,Dengbao Yao,Cuicui Wang

DOI: https://doi.org/10.1016/j.knosys.2013.04.011

2013-08-01

Abstract:In this paper we discussed novel cross-entropy and entropy models on intuitionism and fuzziness of intuitionistic fuzzy sets (IFSs). In order to measure the discrimination uncertain information, cross-entropy and symmetric cross-entropy are defined based on intuitionistic factor and fuzzy factor. In particular, the constructive principle of entropy is refined; relationship between cross-entropy and entropy is investigated, so we establish a novel intuitionistic fuzzy entropy formula that simultaneously takes into account intuitionistic entropy and fuzzy entropy. We also propose concepts of marginal rate of substitution (MRS) and elasticity of substitution (ES) to describe substitution effect between intuitionism and fuzziness. Moreover, we extend the cross-entropy and entropy models to general version, which could be adjusted by different parameters, and comparative analysis with other existed cross-entropy and entropy measures are presented. Finally, we give applications of pattern recognition and decision making to demonstrate the efficiency of the cross-entropy and entropy models.

computer science, artificial intelligence
Fuzzy Rough Sets Based on Fuzzy Quantification

Adnan Theerens,Chris Cornelis

DOI: https://doi.org/10.1016/j.fss.2023.108704

2022-12-07

Abstract:One of the weaknesses of classical (fuzzy) rough sets is their sensitivity to noise, which is particularly undesirable for machine learning applications. One approach to solve this issue is by making use of fuzzy quantifiers, as done by the vaguely quantified fuzzy rough set (VQFRS) model. While this idea is intuitive, the VQFRS model suffers from both theoretical flaws as well as from suboptimal performance in applications. In this paper, we improve on VQFRS by introducing fuzzy quantifier-based fuzzy rough sets (FQFRS), an intuitive generalization of fuzzy rough sets that makes use of general unary and binary quantification models. We show how several existing models fit in this generalization as well as how it inspires novel ones. Several binary quantification models are proposed to be used with FQFRS. We conduct a theoretical study of their properties, and investigate their potential by applying them to classification problems. In particular, we highlight Yager's Weighted Implication-based (YWI) binary quantification model, which induces a fuzzy rough set model that is both a significant improvement on VQFRS, as well as a worthy competitor to the popular ordered weighted averaging based fuzzy rough set (OWAFRS) model.

Artificial Intelligence,Machine Learning
Dominance-based Fuzzy Rough Set Approach for Incomplete Interval-Valued Data

Jianhua Dai,Yuejun Yan,Zhaowen Li,Beishui Liao

DOI: https://doi.org/10.3233/jifs-17178

2018-01-01

Journal of Intelligent & Fuzzy Systems

Abstract:Interval-valued information systems are general models of single-valued information systems. Interval-values appear to a way to describe the uncertainty that affects the observed objects. However, there are relatively few studies on incomplete interval-valued data. The aim of this paper is to present a dominance-based fuzzy rough set approach to incomplete interval-valued information systems. A fuzzy dominance relation which aims to describe the degree of dominance in terms of pairs of objects is proposed. Based on the proposed relation, we extend the definitions of fuzzy approximation operators and investigate the uncertainty measurement issue. A new form of fuzzy conditional entropy to measure attribute importance is presented. Meanwhile, a corresponding heuristic attribute reduction algorithm is constructed for incomplete interval-valued decision systems. Experiments show that the presented fuzzy conditional entropy and the proposed algorithm are effective.
Measures of General Fuzzy Rough Sets on a Probabilistic Space.

Chen Degang,Yang Wenxia,Li Fachao

DOI: https://doi.org/10.1016/j.ins.2008.03.020

IF: 8.1

2008-01-01

Information Sciences

Abstract:Fuzzy rough set is a generalization of crisp rough set, which deals with both fuzziness and vagueness in data. The measures of fuzzy rough sets aim to dig its numeral characters in order to analyze data effectively. In this paper we first develop a method to compute the cardinality of fuzzy set on a probabilistic space, and then propose a real number valued function for each approximation operator of the general fuzzy rough sets on a probabilistic space to measure its approximate accuracy. The functions of lower and upper approximation operators are natural generalizations of the belief function and plausibility function in Dempster–Shafer theory of evidence, respectively. By using these functions, accuracy measure, roughness degree, dependency function, entropy and conditional entropy of general fuzzy rough set are proposed, and the relative reduction of fuzzy decision system is also developed by using the dependency function and characterized by the conditional entropy. At last, these measure functions for approximation operators are characterized by axiomatic approaches.
Covering Vague Sets

Wenwu Zhu

2012-01-01

Computer Science

Abstract:Both covering-based rough sets and vague sets are the mathematical tools to deal with the uncertainty information.The former is the extension of the rough set theory and the latter of the fuzzy sets.Computing the lower and the upper approximations with the existing covering-based rough set models,some elements,which are actually not sure whether they completely belong to the given set,may be put into the lower approximation.Similarly,some elements,which maybe belong to the given set,are excluded from the upper approximation.By analyzing carefully the relationship between the element of the universe and the covering-elements,a covering vague set was established.This covering vague set can reflect the degree of membership of every element of universe to the given set from a new viewpoint.Furthermore,some relationships between the covering vague set and some important concepts of covering-based rough sets were studied.Finally,the properties of a covering vague set that when a covering coincides with a partition were discussed.
Distance-Based Knowledge Measure and Entropy for Interval-Valued Intuitionistic Fuzzy Sets

Chunfeng Suo,Xuanchen Li,Yongming Li

DOI: https://doi.org/10.3390/math11163468

IF: 2.4

2023-08-11

Mathematics

Abstract:The knowledge measure or uncertainty measure for constructing interval-valued intuitionistic fuzzy sets has attracted much attention. However, many uncertainty measures are measured by the entropy of interval-valued intuitionistic fuzzy sets, which cannot adequately reflect the knowledge of interval-valued intuitionistic fuzzy sets. In this paper, we not only extend the axiomatic definition of the knowledge measure of the interval-valued intuitionistic fuzzy set to a more general level but also establish a new knowledge measure function complying with the distance function combined with the technique for order preference by similarity to ideal solution (TOPSIS). Further, we investigate the properties of the proposed knowledge measure based on mathematical analysis and numerical examples. In addition, we create the entropy function by calculating the distance from the interval-valued fuzzy set to the most fuzzy point and prove that it satisfies the axiomatic definition. Finally, the proposed entropy is applied to the multi-attribute group decision-making problem with interval-valued intuitionistic fuzzy information. Experimental results demonstrate the effectiveness and practicability of the proposed entropy measure.

mathematics
Entropy measures and granularity measures for interval and set-valued information systems

Hong Wang,Hong-Bo Yue

DOI: https://doi.org/10.1007/s00500-015-1954-4

IF: 3.732

2015-12-09

Soft Computing

Abstract:In many practical situations, some of the attribute values for an object may be interval and set-valued. The interval and set-valued information systems have been introduced. According to the semantic relation of attribute values, interval and set-valued information systems can be classified into two categories, disjunctive (type 1) and conjunctive (type 2) systems. This paper mainly focuses on semantic interpretation of type 1. Then, a new fuzzy preference relation for interval and set-valued information systems is defined. Moreover, based on the new fuzzy preference relation, the concepts of fuzzy information entropy, fuzzy rough entropy, fuzzy knowledge granulation and fuzzy granularity measure are studied and relationships between entropy measures and granularity measures are investigated. Finally, an illustrative example to substantiate the theoretical arguments is given. These results may supply a further understanding of the essence of uncertainty in interval and set-valued information systems.

computer science, artificial intelligence, interdisciplinary applications
A General Model of Fuzziness Measure

FC Li,LQ Su,SX Lu

DOI: https://doi.org/10.1109/icmlc.2004.1382074

2004-01-01

Abstract:Fuzzy techniques are playing an increasing role in current intelligent computations and optimizations. How to reasonably describe and measure uncertain information has been becoming urgent in many practical domains such as artificial intelligence, computer techniques, optimizations and control in complex manufacturing systems. After analyzing the essence of fuzziness measures, this paper proposes the concept of fuzziness-synthesizing operator, and then obtains a general model for fuzziness measure with existing fuzziness measures as its special cases, by compounding the fuzziness-synthesizing operator and the fuzziness feature function. This helps us to find methods measuring fuzziness under distinct decision consciousness.
Rough Fuzzy Set Approximations in Fuzzy Formal Contexts

Ming-Wen Shao,Min Liu,Wen-Xiu Zhang

DOI: https://doi.org/10.1007/11908029_16

2006-01-01

Abstract:In the paper, we introduce a new kind of fuzzy formal concept derived from an adjoint pair of operations. Based on the discussed fuzzy formal concepts, a pair of rough fuzzy set approximations in fuzzy formal contexts is introduced. The properties of the proposed approximation operators are examined in details.

Fuzzy Entropy of Vague Sets and Its Construction

Entropy Rules for Vague Sets with Corresponding Entropy Measures

Axiomatic framework of fuzzy entropy and hesitancy entropy in fuzzy environment

An Improved Belief Entropy and Its Application in Decision-Making

A collective decision model involving vague concepts and linguistic expressions.

The entropy of fuzzy variables

Fuzzy entropy and hesitancy entropy in probabilistic hesitant fuzzy information and their applications

A Survey of Entropy of Fuzzy Variables

Maximum Entropy Principle For Fuzzy Variables

Entropy of Credibility Distributions for Fuzzy Variables

Fuzzy Entropy: A More Comprehensible Perspective for Interval Shadowed Sets of Fuzzy Sets

A (Basis for a) Philosophy of a Theory of Fuzzy Computation

A novel cross-entropy and entropy measures of IFSs and their applications

Fuzzy Rough Sets Based on Fuzzy Quantification

Dominance-based Fuzzy Rough Set Approach for Incomplete Interval-Valued Data

Measures of General Fuzzy Rough Sets on a Probabilistic Space.

Covering Vague Sets

Distance-Based Knowledge Measure and Entropy for Interval-Valued Intuitionistic Fuzzy Sets

Entropy measures and granularity measures for interval and set-valued information systems

A General Model of Fuzziness Measure

Rough Fuzzy Set Approximations in Fuzzy Formal Contexts