A new method of rough set attribute reduction based on system entropy

Li Weitao,Liu Qiongsun

DOI: https://doi.org/10.3969/j.issn.1674-7720.2011.09.028

2011-01-01

Abstract:This paper presents a new attribute significance and gives a kind of attribute reduction based on improved system entropy.Texts show that the perfect effect is acquired that the attribute reduction based on the attribute significance as heuristic information.

What problem does this paper attempt to address?

Reduct Algorithm Based on Information Entropy and Rough Set Theory

HAN Bin,WU Tie-jun,YANG Ming-hui

DOI: https://doi.org/10.3969/j.issn.1007-0249.2002.02.022

2002-01-01

Abstract:A new Information Entropy based reduct searching algorithm is proposed to tackle the problems involved in Rough set based reducting. Instead of Rough set reductingγcriterion, the new algorithm adopt information entropy as attribute selecting criterion. Using this algorithm, problems in prior criterion, such as sensitive to the data noise, unable to express the probability causality between attributes, can be solved. Two illustrated examples show that when there exists deterministic relationship between attributes, new algorithm can give the set of attributes expressing this relationship as the Rough set reductingγcriterion. When relationship between attributes is probability causative, or deterministic relationship is emerged by noise, Rough set reductingγcriterion becomes useless. However, in these cases, the proposed algorithm can give the correct answer needed.
Rough set based decision tree

Wei Jinmao,Dao Huang,Shuqin Wang,Zhuyang Ma

DOI: https://doi.org/10.1109/wcica.2002.1022144

2002-01-01

Abstract:Decision tree is widely used in machine learning. One important step in construction of a decision tree is how to select appropriate attributes as nodes of the tree. There are many approaches to selection of attributes. In this paper, we present a new approach to selection of attributes for construction of decision tree based on the rough set theory. Decision trees constructed by the presented approach tend to have simpler structure and higher classification accuracy from a statistical point of view than the entropy-based method under some conditions. Some data sets from UCI machine learning database repository are then used to test the two methods, which from application perspective instantiates the performance of rough set-based method. In the paper we also give an algorithm in a recursive form for the construction of decision tree.
New Attribute Reduction on Information Entropy

ZHANG Qinghua,XIAO Yu

DOI: https://doi.org/10.3778/j.issn.1673-9418.1206047

2013-01-01

Abstract:Fuzzy entropy and fuzziness are both important measurement methods of rough set uncertain measure. According to the formula of fuzzy entropy and new fuzziness of rough set uncertain measure, this paper proposes the concepts of revisionary conditional information entropy and relative fuzzy entropy in the decision information system, and proves the monotonicity of entropy by using two methods respectively in the process of attribute reduction. Then, this paper uses the algorithm of adding attributes for attribute reduction, and tests the recognition rate in RIDAS (rough set based intelligent data analysis system) platform. Finally, this paper compares and analyzes the experimental results between the two proposed information entropy and conditional information entropy, and provides a reference for the attribute reduction based on information entropy.
Novel algorithm for attribute reduction based on mutual-information gain ratio

Ping JIA,Jian-hua DAI,Yun-he PAN,Miao-liang ZHU

DOI: https://doi.org/10.3785/j.issn.1008-973X.2006.06.025

2006-01-01

Abstract:To obtain good relative attributes reduction in decision systems, an algorithm for attributes reduction based on mutual information gain ratio was proposed. Both the value distribution of selected attributes and the mutual information between selected conditional attributes and decision attribute were considered. A new attribute importance measure method was defined from the viewpoint of information theory, and the measure was used as the heuristic information in the proposed algorithm. The most important condition attribute was added to the selected attributes set from empty set. The algorithm was terminated when the mutual information between the selected attributes set and the decision attribute set is equal to that between the whole condition attributes set and the decision attribute set. The experimental results show that the algorithm can effectively reduce the decision system, and that the number of objects after the reduction is small.
Attribute Reduction Based on the Minimum Hybrid Entropy

Fa-Chao Li,Chao Gao,Chen-Xia Jin

DOI: https://doi.org/10.1109/icnc.2008.592

2008-01-01

Abstract:Fuzzy set theory and rough set theory are effective tools for dealing with incomplete and inaccurate knowledge of information systems. In this paper, for the difference of fuzzy equivalence relation matrix of the attributes in information system, we establish a minimum hybrid entropy method measuring the relation of the attributes, and propose a new attribute reduction method based on the minimum hybrid entropy. Finally, we make a comparison analysis by a concrete example, the results indicate our method is suitable for large scale database mining, and it possess many interesting advantages of easy operation and small computation complexity, so it can be widely used in many fields and has strong application value.
Information Entropy Based Reduct Searching Algorithm

B Han,TJ Wu

DOI: https://doi.org/10.1109/acc.2002.1025373

2002-01-01

Abstract:In this paper, a new reduct searching algorithm is proposed to benefit the applications of rough sets theory. The information entropy is introduced to the reduct searching algorithm, so that indeterministic causalities among attributes can be found and the reduct sensitivity to noise, occurring unavoidably when the approximation quality function /spl gamma/ is applied, can be removed. The theoretical analysis and an illustrated example show that the rule set induced by this algorithm uses less attributes than that by algorithms based on the rough set /spl gamma/ function. At the same time, the new algorithm gives a larger rule set coverage, especially when the data are polluted by noise or the causalities among the attributes are indeterministic. In practice, noise pollution of data and indeterministic causalities are usual situations, so this algorithm is more applicable than those based on the rough sets /spl gamma/ function.
Attribute Reduction Based on Improved Information Entropy

Baohua Liang,Fei Ruan,Yun Liu

DOI: https://doi.org/10.1117/12.2501786

2018-01-01

Abstract:Traditional information entropy algorithm only considers the size of knowledge granularity, algebraic view only considers the impact of attributes on the determined subsets in the domain. In order to find an objective and comprehensive measure about the importance of attributes, first of all, starting from the algebraic view, we propose the definition of approximate boundary viscosity. Secondly, according to the definition of relative fuzzy entropy, the concept of relative information entropy is proposed, which can effectively measure the importance of attributes. In order to further enhance the importance of attributes, a concept of enhanced information entropy with significant amplification is proposed based on relative information entropy. Thirdly, two new attribute reduction methods are proposed by combining the approximate boundary precision with the entropy of relative information entropy and enhanced information entropy. Making full use of the results of U/B when seeking U / (B∪b) , greatly reducing the time overhead of the system. Finally, through experimental analysis and comparison, the feasibility and validity of the proposed algorithm in reducing quality and classification accuracy are verified.
Constructing Rules Based on Rough Sets Theory and Information Entropy

韩斌,吴铁军

DOI: https://doi.org/10.3785/j.issn.1008-973x.2002.04.016

2002-01-01

Abstract:In practice, the Rough set theory based reduct is hardly used as the attributes are always indeterministic and data are polluted by noise. So we propose a new Information Entropy Based Reduct searching algorithm. The information entropy is introduced into the Reduct searching algorithm, so the statistical causalities between the attributes could be found and the Reduct's unavoidable sensitivity to the noise when the γ criterion is applied could be removed. Theoretical analysis and illustrated example showed that the rule based model resulting from this algorithm uses less attributes than those of model resulting from algorithms based on Rough sets γ criterion. At the same time, when the rules are applied, they get larger coverage, especially when noise and statistical causalities exist. In industrial applications, the data are always polluted by the noise and the causalities between the attributes are indeterministic, so this algorithm is more applicable than those based on Rough sets γ criterion.
Quick Attribute Reduction Algorithm with Hash

刘勇,熊蓉,褚健

DOI: https://doi.org/10.3724/sp.j.1016.2009.01493

2009-01-01

Chinese Journal of Computers

Abstract:This paper presents the concept and property of inconsistency from the inconsistent condition of decision system.It also presents the relationship between the positive region and inconsistent records.A hash based algorithm calculating positive region has been presented and its temporal complexity decreases to O(|U|).Based on the characteristics of inconsistency,a new attribute measure has been introduced,then a corresponding reduction algorithm with twice-hash is presented,and its temporal complexity is O(|C|2|U/C|),this paper also proves this algorithm is complete.The efficiency of the algorithms is proved by the experiments.
A novel attribute reduction approach using coverage-credibility-based rough decision entropy for interval-valued data

Xia Liu,Xianyong Zhang,Jiaxin Chen,Benwei Chen

DOI: https://doi.org/10.3233/jifs-239544

2024-04-27

Journal of Intelligent & Fuzzy Systems

Abstract:Attribute reduction is an important method in data analysis and machine learning, and it usually relies on algebraic and informational measures. However, few existing informational measures have considered the relative information of decision class cardinality, and the fusion application of algebraic and informational measures is also limited, especially in attribute reductions for interval-valued data. In interval-valued decision systems, this paper presents a coverage-credibility-based condition entropy and an improved rough decision entropy, further establishes corresponding attribute reduction algorithms for optimization and applicability. Firstly, the concepts of interval credibility, coverage and coverage-credibility are proposed, and thus, an improved condition entropy is defined by virtue of the integrated coverage-credibility. Secondly, the fused rough decision entropy is constructed by the fusion of improved condition entropy and roughness degree. By introducing the coverage-credibility, the proposed uncertainty measurements enhance the relative information of decision classes. In addition, the nonmonotonicity of the improved condition entropy and rough decision entropy is validated by theoretical proofs and experimental counterexamples, with respect to attribute subsets and thresholds. Then, the two rough decision entropies drive monotonic and nonmonotonic attribute reductions, and the corresponding reduction algorithms are designed for heuristic searches. Finally, data experiments not only verify the effectiveness and improvements of the proposed uncertainty measurements, but also illustrate the reduction algorithms optimization through better classification accuracy than four comparative algorithms.
A New Approach to Attribute Reduction of Decision Information Systems

Fachao Li,Jinning Yang

DOI: https://doi.org/10.1007/978-3-662-49370-0_59

2016-01-01

Abstract:Rough set theory is a theoretical tool for complete conclusions by incomplete information; its basic idea is using some partition to consider the description problem of concept on university. In this paper, we firstly introduce some usual attribute reduction methods. Secondly, we establish an effect-based roughness measure model, named as effect rough degree (ERD) by combining with a basic measure factor for roughness-lower (upper) accuracy of rough set. Finally, we propose an ERD-based attribute reduction method (abbreviated as ERD-RM) and then discuss the difference and relation between ERD-RM and the existing reduction methods. The theoretical analysis showed that the ERD-RM includes other reduction methods to a certain degree, and it also has basic difference with other existing methods.
Heuristic Reduction Algorithm Based on Attribute Importance

Jian Li

2012-01-01

Abstract:This article has done the research on attribute reduction of rough set theory.This paper is from the perspective of looking for attribute reduction,This paper first described the properties importance in the decision-making table and use the positive region which has been obtained,narrowed the scope of data processing,attribute reduction begin with core set,through adding the attributes which are the most important to properties nuclear,get the smallest relative reduction of properties.Thereby it reduced the time of demanding reduction.Finally,an example of a complete demonstration of the method,confirmed that the algorithm with the traditional method,in calculating the amount of the reduction at the same time can be more simple result The results proved that the correctness and feasibility of the algorithmis.
A Generalized Attributes Significance Measure Method

Fa Chao Li,Ming Li,Shuo Liu

DOI: https://doi.org/10.4028/www.scientific.net/amr.989-994.1551

2014-01-01

Advanced Materials Research

Abstract:Currently, rough set theory has been widely used in many fields. In rough set theory, how to measure the attributes significance of the data is a core content. In order to solve the problem that the existing attributes significance measure methods usually ignore the interaction among the attributes, the paper presents a measure method based on difference degree. When given a set, the proposed method first divides it into several subsets according to the value of condition attributes, and then computes the difference degree in the subsets. Secondly, the important attributes are selected based on the value of difference degree. Further the paper discussed some properties of the difference degree, and the experimental results shows the effectiveness of this method in the final.
Attribute Reduction Method Based on Inter-Class Separability*

Ya RAO,Xiuyi JIA,Tongjun LI,Lin SHANG

DOI: https://doi.org/10.3778/j.issn.1673-9418.1806017

2019-01-01

Abstract:Attribute reduction is one of the most important research issues in the rough set theory. In recent years, the attribute reduction problem under the rough set theory has attracted many scholars’attention. However, most of the attribute reduction methods are proposed based on the indiscernibility relations or the discernibility relations, and the performance of the attribute reduction only depends on the changes of the equal classes or the approximation sets, but the changes between different clusters of objects that do not have an equivalence relationship are ignored. Therefore, this paper proposes a notion of the inter-class separability. Compared with the equivalence class or the approximation sets, it can reflect the degree of distinction between different classes as the attributes change. This paper explains and defines the inter-class separability and the inter-class coincidence degree, and proposes an inter-class separability based attribute reduction method by considering the heuristic search strategy. Moreover, the experimental results indicate the efficiency of the proposed attribute reduction method.
Rough set theory and attribute reduction in interval-set information system

Xin Xie,Xianyong Zhang,Shiyu Zhang

DOI: https://doi.org/10.3233/jifs-210662

2022-04-28

Abstract:As an extension of traditional information systems, interval-set information systems have a strong expressive ability to describe uncertain information. Study of the rough set theory and the attribute reduction of interval-set information system are worth discussing. Here, the granularity structure of similar equivalence classes in an interval-set information system is mined, and an attribute reduction algorithm is constructed. The upper and lower approximation operators in the interval-set information system are defined. The accuracy and roughness are determined by these operators. At the same time, using rough sets, a concept of three branches of rough sets on the interval-set information system is constructed. The concepts of attribute dependency and attribute importance are induced by the positive number domain of the three branch domains, and they then lead to the attribute reduction algorithm. Experiments on the UCI datasets show that the uncertainty measure proposed in this paper is sensitive to the attributes and can effectively reduce redundant information of the interval-set information system.
Attribute Reduction Based on Information Quantity under Incomplete Information Systems

HUANG Bing,ZHOU Xian-zhong,ZhANG Rong-rong

DOI: https://doi.org/10.3321/j.issn:1000-6788.2005.04.008

2005-01-01

Abstract:Knowledge acquisition based on rough set theory is an important and difficult task under incomplete information systems. Information quantity and conditional information quantity are defined to express indispensable of attributes under incomplete information systems. A heuristic algorithm based on information quantity or conditional information quantity for reduction of attributes is presented, and the complexity of this algorithm is analyzed. Finally, the experimental results show that this algorithm can find the reduct of an incomplete information system.
Attribute reduction based on interval-set rough sets

Ren, Chunge

DOI: https://doi.org/10.1007/s00500-023-09540-8

IF: 3.732

2024-01-08

Soft Computing

Abstract:As an important extension of the rough set theory, interval-set rough sets provide an effective method to solve the problem that the objective sets cannot be accurately expressed in the rough approximation process and to induce classification rules from incomplete information systems. In practical information systems, the value of an object's decision attribute may be set-valued due to missing decision information or multiple decision values. However, this situation is not considered by any of the existing rough set models. Therefore, to properly deal with the information system where decision attributes are set-valued, we construct the interval-set rough set model on the information system and study attribute reductions of interval-set rough sets. First, we define the information system where decision attributes are set-valued as an extended set-valued decision information system (ESVDIS) and construct the interval-set rough set model on the ESVDIS. Second, the accuracy and the roughness are extended to the interval-set approximation accuracy and the interval-set approximation roughness, respectively. The two extended measures can be used to measure the uncertainty caused by rough approximations. In addition, the dependency degree of interval-set rough sets called the interval-set dependency degree is defined to estimate the significance of attribute subsets. By adopting the interval-set dependency degree, we propose the definition of attribute reduction based on interval-set rough sets and design a heuristic attribute reduction algorithm. Finally, the effectiveness of the proposed attribute reduction algorithm is demonstrated using 12 public data sets. Experimental results show that the model is applicable to some fields, such as missing decision information and group decision-making.

computer science, artificial intelligence, interdisciplinary applications
Approximate Accuracy Approaches to Attribute Reduction for Information Systems

Deshan Liu,Dapeng Wang,Deqin Yan,Yu Sang

DOI: https://doi.org/10.1155/2014/382967

2014-01-01

Abstract and Applied Analysis

Abstract:The key problem for attribute reduction to information systems is how to evaluate the importance of an attribute. The algorithms are challenged by the variety of data forms in information system. Based on rough sets theory we present a new approach to attribute reduction for incomplete information systems and fuzzy valued information systems. In order to evaluate the importance of an attribute effectively, a novel algorithm with rigorous theorem is proposed. Experiments show the effect of proposed algorithm.
Similarity-based Attribute Reduction in Rough Set Theory: a Clustering Perspective

Xiuyi Jia,Ya Rao,Lin Shang,Tongjun Li

DOI: https://doi.org/10.1007/s13042-019-00959-w

2019-01-01

International Journal of Machine Learning and Cybernetics

Abstract:Attribute reduction is one of the most important research issues in the rough set theory. The purpose of attribute reduction is to find a minimal attribute subset that satisfies some specific criteria, while the minimal attribute subset is called attribute reduct. In this paper, we define a similarity-based attribute reduct based on a clustering perspective. Each decision class is treated as a cluster, and the defined similarity-based attribute reduct can maintain or increase the discriminating ability of different clusters in the case of removing redundant attributes. In view of this, firstly, we define the intra-class similarity for objects in the same decision class and the inter-class similarity for objects between different decision classes. Secondly, we define a similarity-based attribute reduct by maximizing intra-class similarity and minimizing inter-class similarity in the rough set model. Thirdly, by considering the heuristic search strategy, we also design a corresponding reduction method for the proposed attribute reduct. The experimental results indicate that compared with other representative attribute reducts, our proposed attribute reduct can significantly improve the classification performance.
Attribute reduction based on fusion information entropy

Xia Ji,Jie Li,Sheng Yao,Peng Zhao

DOI: https://doi.org/10.1016/j.ijar.2023.108949

IF: 4.452

2023-05-31

International Journal of Approximate Reasoning

Abstract:The attribute reduction algorithm based on fuzzy rough set theory is a commonly used method for dealing with uncertain information. However, many existing attribute reduction algorithms do not consider the information provided by the upper approximation. In fact, the upper approximation contains some certain decision information and decision risks brought by uncertain information. Therefore, we propose an attribute reduction algorithm based on fusion information entropy (FIE) to make proper use of the upper approximation. Firstly, we define the concepts of kernel decision degree and general decision degree, and flexibly combine them using the precision decision index. This method overcomes the limitations of existing attribute reduction methods in considering the upper approximation information. Then, we introduce the concept of fusion information entropy and measure the importance of attribute subsets by analyzing the changes in fusion information entropy. Finally, we design the corresponding attribute reduction algorithm. Extensive comparative experiments on public datasets show that the FIE algorithm based on fusion information entropy achieves higher classification accuracy while retaining fewer attributes compared with other state-of-the-art reduction algorithms. These results confirm the effectiveness and superiority of the FIE method proposed in this paper.

computer science, artificial intelligence

A new method of rough set attribute reduction based on system entropy

Reduct Algorithm Based on Information Entropy and Rough Set Theory

Rough set based decision tree

New Attribute Reduction on Information Entropy

Novel algorithm for attribute reduction based on mutual-information gain ratio

Attribute Reduction Based on the Minimum Hybrid Entropy

Information Entropy Based Reduct Searching Algorithm

Attribute Reduction Based on Improved Information Entropy

Constructing Rules Based on Rough Sets Theory and Information Entropy

Quick Attribute Reduction Algorithm with Hash

A novel attribute reduction approach using coverage-credibility-based rough decision entropy for interval-valued data

A New Approach to Attribute Reduction of Decision Information Systems

Heuristic Reduction Algorithm Based on Attribute Importance

A Generalized Attributes Significance Measure Method

Attribute Reduction Method Based on Inter-Class Separability*

Rough set theory and attribute reduction in interval-set information system

Attribute Reduction Based on Information Quantity under Incomplete Information Systems

Attribute reduction based on interval-set rough sets

Approximate Accuracy Approaches to Attribute Reduction for Information Systems

Similarity-based Attribute Reduction in Rough Set Theory: a Clustering Perspective

Attribute reduction based on fusion information entropy