Abstract:With increases in feature dimensions and the emergence of hierarchical class structures, hierarchical feature selection has become an important data preprocessing step in machine learning. A variety of effective feature selection methods based on granular computing and hierarchical information have been proposed. The fuzzy rough set method is an effective granular computing method for dealing with uncertainty. However, it is time-consuming because the distance calculations are only based on single samples. In this paper, we propose a fuzzy rough set approach using the Hausdorff distance of the sample set for hierarchical feature selection. This integrates the benefits of sample granularity and class hierarchical granularity. Firstly, the general feature selection task is decomposed into coarse-grained and fine-grained tasks according to the hierarchical structure of the data’s semantic labels. This allows a large and difficult classification task to be divided into several small and controllable subtasks. Then, the Hausdorff distance-based fuzzy rough set method is used to select the best feature subset in each coarse- and fine-grained subtask. Unlike single-sample-based distance calculation, Hausdorff distance calculation uses a sample set of different classes. The new model greatly reduces the computational complexity of classification. Finally, we use the top-down support vector machine classifier to experimentally verify the effectiveness of the proposed methods on five hierarchical datasets. Compared with five existing feature selection algorithms in terms of three evaluation metrics, the proposed method provides the highest average accuracy and much lower running time. In particular, on the F194 dataset, our method takes the least time to improve the F H indicator by 2 % compared with that of the second-best algorithm.

Incremental feature selection for large-scale hierarchical classification with the arrival of new samples

Fuzzy Rough Sets-Based Incremental Feature Selection for Hierarchical Classification

Uncertainty Measure-Based Incremental Feature Selection For Hierarchical Classification

An incremental approach to hierarchical feature selection by applying fuzzy rough set technique

Fuzzy Rough Set Based Feature Selection for Large-Scale Hierarchical Classification.

Incremental Subgraph Feature Selection for Graph Classification.

Incremental Classification of Remote Sensing Images with Feature Pyramid and Class Hierarchy

Feature selection via maximizing inter-class independence and minimizing intra-class redundancy for hierarchical classification.

Incremental Learning of Remote Sensing Target Classification with Class Hierarchy

Discernible Neighborhood Counting Based Incremental Feature Selection for Heterogeneous Data

Uncertainty-Aware Hierarchical Refinement for Incremental Implicitly-Refined Classification

Feature Selection-Based Hierarchical Deep Network for Image Classification

An Improved Feature Selection Algorithm for Ordinal Classification.

Hierarchical Feature Selection Based on Label Distribution Learning

Online Streaming Feature Selection for Multigranularity Hierarchical Classification Learning

Incremental feature selection based on fuzzy rough sets

A Fuzzy Rough Set Approach to Hierarchical Feature Selection Based on Hausdorff Distance

A Recursive Regularization Based Feature Selection Framework for Hierarchical Classification

Robust Hierarchical Feature Selection Driven by Data and Knowledge

Feature Selection Using Hierarchical Feature Clustering

Online Feature Selection for Hierarchical Classification Learning Based on Improved ReliefF.