Abstract:Feature selection effectively reduces the dimensionality of data. For feature selection, rough set theory offers a systematic theoretical framework based on consistency measures, of which information entropy is one of the most important significance measures of attributes. However, an information-entropy-based significance measure is computationally expensive and requires repeated calculations. Although many accelerating strategies have been proposed thus far, there remains a bottleneck when using an information-entropy-based feature selection algorithm to handle large-scale datasets with high dimensions. In this study, we introduce a classified nested equivalence class (CNEC)-based approach to calculate the information-entropy-based significance for feature selection using rough set theory. The proposed method extracts knowledge of the reducts of a decision table to reduce the universe and construct CNECs. By exploring the properties of different types of CNECs, we can not only accelerate both outer and inner significance calculation by discarding useless CNECs but also effectively decrease the number of inner significance calculations by using one type of CNECs. The use of CNECs is shown to significantly enhance three representative entropy-based feature selection algorithms that use rough set theory. The feature subset selected by the CNEC-based algorithms is the same as that selected by algorithms using the original definition of information entropies. Experiments conducted using 31 datasets from multiple sources, such as the UCI repository and KDD Cup competition, including large-scale and high-dimensional datasets, confirm the efficiency and effectiveness of the proposed method.

Constructing Rules Based on Rough Sets Theory and Information Entropy

Reduct Algorithm Based on Information Entropy and Rough Set Theory

Information Entropy Based Reduct Searching Algorithm

Dynamic Reduct Research Based on Rough Set Theory

Rough set based decision tree

Negative Rules and Reduction in Rough Sets Based on Similarity Relation

Rough Rule Extracting from Various Conditions: Incremental and Approximate Approaches for Inconsistent Data.

Discovering Knowledge of Association Rules Based on the United Entropy of Information and Rough Sets Theory

New Attribute Reduction on Information Entropy

Attribute Reduction Based on the Minimum Hybrid Entropy

Uncertainty Measures of Rules Based on Entropy and Variable Precision Rough Set

Evolutionary Computation and Rough Set-Based Hybrid Approach to Rule Generation

Discernibility System in Rough Sets.

Δ-Cut Decision-Theoretic Rough Set Approach: Model and Attribute Reductions.

Reducing Inconsistent Rules Based on Irregular Decision Table

Rough Entropy Based on Generalized Rough Sets Covering Reduction

Attribute Reduction Based on Improved Information Entropy

Knowledge Reduction in Decision-Theoretic Rough Set Model Based on Connection Degree

Accelerating information entropy-based feature selection using rough set theory with classified nested equivalence classes

Equivalent Representation Of Knowledge Reduction In A New Information View And An Algebra View

A practicable heuristic attributes reduction algorithm for ordered information systems