Reduct Algorithm Based on Information Entropy and Rough Set Theory
HAN Bin,WU Tie-jun,YANG Ming-hui
DOI: https://doi.org/10.3969/j.issn.1007-0249.2002.02.022
2002-01-01
Abstract:A new Information Entropy based reduct searching algorithm is proposed to tackle the problems involved in Rough set based reducting. Instead of Rough set reductingγcriterion, the new algorithm adopt information entropy as attribute selecting criterion. Using this algorithm, problems in prior criterion, such as sensitive to the data noise, unable to express the probability causality between attributes, can be solved. Two illustrated examples show that when there exists deterministic relationship between attributes, new algorithm can give the set of attributes expressing this relationship as the Rough set reductingγcriterion. When relationship between attributes is probability causative, or deterministic relationship is emerged by noise, Rough set reductingγcriterion becomes useless. However, in these cases, the proposed algorithm can give the correct answer needed.