Abstract:With increases in feature dimensions and the emergence of hierarchical class structures, hierarchical feature selection has become an important data preprocessing step in machine learning. A variety of effective feature selection methods based on granular computing and hierarchical information have been proposed. The fuzzy rough set method is an effective granular computing method for dealing with uncertainty. However, it is time-consuming because the distance calculations are only based on single samples. In this paper, we propose a fuzzy rough set approach using the Hausdorff distance of the sample set for hierarchical feature selection. This integrates the benefits of sample granularity and class hierarchical granularity. Firstly, the general feature selection task is decomposed into coarse-grained and fine-grained tasks according to the hierarchical structure of the data’s semantic labels. This allows a large and difficult classification task to be divided into several small and controllable subtasks. Then, the Hausdorff distance-based fuzzy rough set method is used to select the best feature subset in each coarse- and fine-grained subtask. Unlike single-sample-based distance calculation, Hausdorff distance calculation uses a sample set of different classes. The new model greatly reduces the computational complexity of classification. Finally, we use the top-down support vector machine classifier to experimentally verify the effectiveness of the proposed methods on five hierarchical datasets. Compared with five existing feature selection algorithms in terms of three evaluation metrics, the proposed method provides the highest average accuracy and much lower running time. In particular, on the F194 dataset, our method takes the least time to improve the F H indicator by 2 % compared with that of the second-best algorithm.

Feature Subset Selection Approach Based on Fuzzy Rough Set for High-Dimensional Data

Feature Subset Selection Based on Fuzzy Neighborhood Rough Sets

Incremental feature selection based on fuzzy rough sets

A Fitting Model for Feature Selection with Fuzzy Rough Sets

Instance and Feature Selection Using Fuzzy Rough Sets: A Bi-Selection Approach for Data Reduction

A Fuzzy Rough Set-Based Feature Selection Method Using Representative Instances

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Combining Fuzzy C-Means Clustering with Fuzzy Rough Feature Selection

Fuzzy Rough Based Feature Selection By Using Random Sampling

An incremental approach to hierarchical feature selection by applying fuzzy rough set technique

Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets

Fuzzy Rough Sets and Fuzzy Rough Neural Networks for Feature Selection: A Review

An Efficient and Accurate Rough Set for Feature Selection, Classification and Knowledge Representation

Feature Subset Selection Based on Variable Precision Neighborhood Rough Sets

Fuzzy-rough Set Based Attribute Reduction with a Simple Fuzzification Method

A Fuzzy Rough Set Approach to Hierarchical Feature Selection Based on Hausdorff Distance

Intuitionistic Fuzzy Entropy Feature Selection Algorithm Based on Adaptive Neighborhood Space Rough Set Model

Relative Fuzzy Rough Approximations for Feature Selection and Classification

A Novel Unsupervised Feature Selection for High-Dimensional Data Based on FCM and $k$ -Nearest Neighbor Rough Sets

A Novel Approach of Rough Set-Based Attribute Reduction Using Fuzzy Discernibility Matrix

Hybrid Attribute Reduction Based on a Novel Fuzzy-Rough Model and Information Granulation