Abstract:Feature selection effectively reduces the dimensionality of data. For feature selection, rough set theory offers a systematic theoretical framework based on consistency measures, of which information entropy is one of the most important significance measures of attributes. However, an information-entropy-based significance measure is computationally expensive and requires repeated calculations. Although many accelerating strategies have been proposed thus far, there remains a bottleneck when using an information-entropy-based feature selection algorithm to handle large-scale datasets with high dimensions. In this study, we introduce a classified nested equivalence class (CNEC)-based approach to calculate the information-entropy-based significance for feature selection using rough set theory. The proposed method extracts knowledge of the reducts of a decision table to reduce the universe and construct CNECs. By exploring the properties of different types of CNECs, we can not only accelerate both outer and inner significance calculation by discarding useless CNECs but also effectively decrease the number of inner significance calculations by using one type of CNECs. The use of CNECs is shown to significantly enhance three representative entropy-based feature selection algorithms that use rough set theory. The feature subset selected by the CNEC-based algorithms is the same as that selected by algorithms using the original definition of information entropies. Experiments conducted using 31 datasets from multiple sources, such as the UCI repository and KDD Cup competition, including large-scale and high-dimensional datasets, confirm the efficiency and effectiveness of the proposed method.

A Weighting Approach for Features Based on Real Rough Set

Ranking Z-numbers with an improved ranking method for generalized fuzzy numbers.

An Aggressive Feature Selection Method Based on Rough Set Theory

An Efficient and Accurate Rough Set for Feature Selection, Classification and Knowledge Representation

A rough set based clustering algorithm and the information theoretical approach to refine clusters

Study on Web Text Feature Selection Based on Rough Set.

Feature Ranking in Rough Sets

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Study of the Method for Determining Weighting Coefficient of Coal Ash Slagging Fuzzy Combination Forecast Based on Rough Set Theory

An Innovative Rough Set Model Based on Fuzzy Covering for Ordered Decision Making

Combination Weighting Approach Based on Deviation Function and Joint-Entropy

A New Heuristic Reduct Algorithm Base on Rough Sets Theory

Accelerating information entropy-based feature selection using rough set theory with classified nested equivalence classes

A Rough Sets Based Approach to Feature Selection

A method for weight assignment by Dominance-based Rough Sets Approach

Iterative Weighted Cluster Ensemble Model Based on Rough Set Theory

Matrix-Based Incremental Feature Selection Method Using Weight-Partitioned Multigranulation Rough Set

Feature selection algorithm using neighborhood equivalence tolerance relation for incomplete decision systems

Decision Roughness Measurement and Application Research Based on Data Effect

A Comparative Study on Feature Weight in Text Categorization

Generalized Rough Set Model and Its Uncertainty Measure