Abstract:In hierarchical classification learning, the hierarchical feature selection algorithm plays an important role in overcoming the curse of dimensionality. Existing hierarchical feature selection algorithms, based on the granular computing framework, all use three basic search strategies to search for similar and dissimilar classes. These strategies compute the importance of features to the global label for feature selection. However, existing methods based on the sibling strategy can only stay at the fine-grained level for feature selection, often without considering that the fine-grained level is also continuously separated from the coarse-grained level. Thus, these methods do not take into account the features hidden below the coarse granularity, resulting in the selection of a top-heavy subset of features and the loss of many important features. Therefore, this paper proposes a Hierarchical Feature Selection Based on Neighborhood Interclass Spacing From Fine to Coarse (HFSNIS) algorithm, which aims to change the feature selection to the coarse-grained hierarchy. The framework of the HFSNIS algorithm is as follows: First, each fine-grained leaf node is coarsened to the coarsest hierarchy of granularity from fine to coarse, where the non-root ancestor node is located. Next, the search for similar and dissimilar nearest neighbors is performed at the coarsest granularity hierarchy. Finally, the features are filtered using the Neighborhood Interclass Spacing model to obtain a subset of features. Therefore, this HFSNIS algorithm based on the Coarsest Search Strategy (CSS) can reselect features that were previously ignored in the fine-grained hierarchy, resulting in a better feature subset. Finally, the proposed algorithm outperforms seven state-of-the-art feature selection algorithms on six datasets.

Feature Selection Algorithm Based on Hellinger Distance

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

Improvement of Negative Selection Algorithm Based on Hamming Distance

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Feature Selection with Conditional Mutual Information Considering Feature Interaction

An Optimal Feature Subset Selection Method Based On Distance Discriminant And Distribution Overlapping

Feature Selection Based on Wasserstein Distance

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Model-free feature screening based on Hellinger distance for ultrahigh dimensional data

Heuristic feature selection method for clustering

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

An Approximate Markov Blanket Feature Selection Algorithm

A Contrast Based Feature Selection Algorithm for High-dimensional Data set in Machine Learning

Feature Selection via Maximizing Distances between Class Conditional Distributions

Feature Selection Based on Data Clustering

Feature selection based on dataset variance optimization using Hybrid Sine Cosine – Firehawk Algorithm (HSCFHA)

Feature Selection Based on a New Dependency Measure

Hierarchical feature selection based on neighborhood interclass spacing from fine to coarse

Accelerating information entropy-based feature selection using rough set theory with classified nested equivalence classes