Abstract:Feature selection facilitates system processing, and it relies on knowledge granulation and uncertainty measurement. Focusing on ordered decision systems, the fuzzy dominance neighborhood (FDN) granulation and corresponding condition entropy have recently yielded an outstanding algorithm for feature selection, FDNCE-FS (fuzzy dominance neighborhood condition entropy-based feature selection). However, there is room for improvement. Accordingly, three-level improvements of knowledge granulation, information enrichment, and heterogeneity fusion are proposed here, and $2\times 2\times 2=8$ heuristic algorithms of feature selection are systematically established. First, FDN granulation is improved to fuzzy dominance three-way neighborhood (FD3N) granulation through three-way decision on fuzzy dominance degrees, and FD3N rough sets are modeled to offer better dependency. Second, the FDN condition entropy is improved to FD3N condition entropy by reinforcing the interaction factor and class information, and corresponding measure systems are constructed. Third, FD3N dependency is fused with four types of condition entropy to produce four combined measures, and eight uncertainty measures hierarchically emerge due to the three-level improvements. Fourth, these systematic measures have granulation nonmonotonicity, and they enable heuristic algorithms for feature selection; thus, the current FDNCE-FS method is improved to seven new selection algorithms: FHN-FS, RHN-FS, RFHN-FS, HTWN-FS, FHTWN-FS, RHTWN-FS, and RFHTWN-FS. Finally, the relevant FD3N granulation, uncertainty measurement, and feature selection are validated by data-based experiments, and the seven novel algorithms are shown to outperform FDNCE-FS in terms of classification performance. This study provides new insights into uncertainty modeling, information fusion, and feature selection through granular computing and three-way decision.

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Feature Subset Selection Approach Based on Fuzzy Rough Set for High-Dimensional Data

Systematic Feature Selection Based on Three-Level Improvements of Fuzzy Dominance Three-Way Neighborhood Rough Sets

Combining Fuzzy C-Means Clustering with Fuzzy Rough Feature Selection

Improved Clustering Approach Based on Fuzzy Feature Selection

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Research and Application of Improved K-Means Algorithm Based on Fuzzy Feature Selection

A Fitting Model for Feature Selection with Fuzzy Rough Sets

FCM_FS: A Simultaneous Clustering and Feature Selection Model for Classification

Supervised Feature Selection with a Stratified Feature Weighting Method

Unsupervised Hyperspectral Feature Selection Based on Fuzzy C-Means and Grey Wolf Optimizer

A Fuzzy Rough Set Approach to Hierarchical Feature Selection Based on Hausdorff Distance

Feature Selection Using Hierarchical Feature Clustering

Relative Fuzzy Rough Approximations for Feature Selection and Classification

A Fuzzy Rough Set-Based Feature Selection Method Using Representative Instances

A Sparse Fuzzy C-Means Algorithm Based on Sparse Clustering Framework

Hierarchical Fuzzy Filter Method for Unsupervised Feature Selection

Discriminatively embedded fuzzy K-Means clustering with feature selection strategy

An incremental approach to hierarchical feature selection by applying fuzzy rough set technique

An Approximate Markov Blanket Feature Selection Algorithm