Abstract:Feature selection effectively reduces the dimensionality of data. For feature selection, rough set theory offers a systematic theoretical framework based on consistency measures, of which information entropy is one of the most important significance measures of attributes. However, an information-entropy-based significance measure is computationally expensive and requires repeated calculations. Although many accelerating strategies have been proposed thus far, there remains a bottleneck when using an information-entropy-based feature selection algorithm to handle large-scale datasets with high dimensions. In this study, we introduce a classified nested equivalence class (CNEC)-based approach to calculate the information-entropy-based significance for feature selection using rough set theory. The proposed method extracts knowledge of the reducts of a decision table to reduce the universe and construct CNECs. By exploring the properties of different types of CNECs, we can not only accelerate both outer and inner significance calculation by discarding useless CNECs but also effectively decrease the number of inner significance calculations by using one type of CNECs. The use of CNECs is shown to significantly enhance three representative entropy-based feature selection algorithms that use rough set theory. The feature subset selected by the CNEC-based algorithms is the same as that selected by algorithms using the original definition of information entropies. Experiments conducted using 31 datasets from multiple sources, such as the UCI repository and KDD Cup competition, including large-scale and high-dimensional datasets, confirm the efficiency and effectiveness of the proposed method.

Fuzzy-rough feature selection based on λ-partition differentiation entropy

A Novel Feature Selection Method Based on Extreme Learning Machine and Fractional-Order Darwinian PSO.

A Fast Feature Selection Algorithm by Accelerating Computation of Fuzzy Rough Set-Based Information Entropy

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Feature Selection with Partition Differentiation Entropy for Large-Scale Data Sets.

Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy

A Fitting Model for Feature Selection with Fuzzy Rough Sets

Accelerating information entropy-based feature selection using rough set theory with classified nested equivalence classes

Fuzzy Rough Based Feature Selection By Using Random Sampling

An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution

Relative Fuzzy Rough Approximations for Feature Selection and Classification

A relative uncertainty measure for fuzzy rough feature selection

Feature selection based on robust fuzzy rough sets using kernel-based similarity and relative classification uncertainty measures

Feature Selection With Local Density-Based Fuzzy Rough Set Model for Noisy Data

Feature selection using relative dependency complement mutual information in fitting fuzzy rough set model

A Fast Feature Selection Approach Based on Rough Set Boundary Regions

Feature Subset Selection Based on Fuzzy Neighborhood Rough Sets

Different Classes' Ratio Fuzzy Rough Set Based Robust Feature Selection

Research on a heuristic algorithm of feature subset selection based on entropy

Fuzzy Multi-Neighborhood Entropy-Based Interactive Feature Selection for Unsupervised Outlier Detection