Abstract:In hierarchical classification learning, the hierarchical feature selection algorithm plays an important role in overcoming the curse of dimensionality. Existing hierarchical feature selection algorithms, based on the granular computing framework, all use three basic search strategies to search for similar and dissimilar classes. These strategies compute the importance of features to the global label for feature selection. However, existing methods based on the sibling strategy can only stay at the fine-grained level for feature selection, often without considering that the fine-grained level is also continuously separated from the coarse-grained level. Thus, these methods do not take into account the features hidden below the coarse granularity, resulting in the selection of a top-heavy subset of features and the loss of many important features. Therefore, this paper proposes a Hierarchical Feature Selection Based on Neighborhood Interclass Spacing From Fine to Coarse (HFSNIS) algorithm, which aims to change the feature selection to the coarse-grained hierarchy. The framework of the HFSNIS algorithm is as follows: First, each fine-grained leaf node is coarsened to the coarsest hierarchy of granularity from fine to coarse, where the non-root ancestor node is located. Next, the search for similar and dissimilar nearest neighbors is performed at the coarsest granularity hierarchy. Finally, the features are filtered using the Neighborhood Interclass Spacing model to obtain a subset of features. Therefore, this HFSNIS algorithm based on the Coarsest Search Strategy (CSS) can reselect features that were previously ignored in the fine-grained hierarchy, resulting in a better feature subset. Finally, the proposed algorithm outperforms seven state-of-the-art feature selection algorithms on six datasets.

Hierarchical Feature Selection with Subtree Based Graph Regularization

Hierarchical Feature Selection with Recursive Regularization.

A Recursive Regularization Based Feature Selection Framework for Hierarchical Classification

Incremental Subgraph Feature Selection for Graph Classification.

Defragging Subgraph Features for Graph Classification.

Feature selection via maximizing inter-class independence and minimizing intra-class redundancy for hierarchical classification.

Fuzzy Rough Set Based Feature Selection for Large-Scale Hierarchical Classification.

Robust Hierarchical Feature Selection with a Capped ℓ2-Norm

Feature Selection Using Hierarchical Feature Clustering

Hierarchical Feature Selection Based on Label Distribution Learning

Uncertainty Measure-Based Incremental Feature Selection For Hierarchical Classification

Robust Hierarchical Feature Selection Driven by Data and Knowledge

Hierarchical feature selection based on neighborhood interclass spacing from fine to coarse

Subspace Learning-Based Graph Regularized Feature Selection

OFHR: Online Streaming Feature Selection With Hierarchical Structure Based on Relief

Online Streaming Feature Selection for Multigranularity Hierarchical Classification Learning

Fuzzy Rough Sets-Based Incremental Feature Selection for Hierarchical Classification

Hierarchical Feature Extraction Based on Discriminant Analysis

Feature Selection-Based Hierarchical Deep Network for Image Classification

Unsupervised Hierarchical Feature Selection on Networked Data.

Graph Regularized Feature Selection with Data Reconstruction