Abstract:In hierarchical classification learning, the hierarchical feature selection algorithm plays an important role in overcoming the curse of dimensionality. Existing hierarchical feature selection algorithms, based on the granular computing framework, all use three basic search strategies to search for similar and dissimilar classes. These strategies compute the importance of features to the global label for feature selection. However, existing methods based on the sibling strategy can only stay at the fine-grained level for feature selection, often without considering that the fine-grained level is also continuously separated from the coarse-grained level. Thus, these methods do not take into account the features hidden below the coarse granularity, resulting in the selection of a top-heavy subset of features and the loss of many important features. Therefore, this paper proposes a Hierarchical Feature Selection Based on Neighborhood Interclass Spacing From Fine to Coarse (HFSNIS) algorithm, which aims to change the feature selection to the coarse-grained hierarchy. The framework of the HFSNIS algorithm is as follows: First, each fine-grained leaf node is coarsened to the coarsest hierarchy of granularity from fine to coarse, where the non-root ancestor node is located. Next, the search for similar and dissimilar nearest neighbors is performed at the coarsest granularity hierarchy. Finally, the features are filtered using the Neighborhood Interclass Spacing model to obtain a subset of features. Therefore, this HFSNIS algorithm based on the Coarsest Search Strategy (CSS) can reselect features that were previously ignored in the fine-grained hierarchy, resulting in a better feature subset. Finally, the proposed algorithm outperforms seven state-of-the-art feature selection algorithms on six datasets.

Hierarchical Feature Selection for Ranking.

Feature analysis methods for learning to rank

Learning to Rank Collections.

Query clustering for learning to rank models on web search

FSMRank: feature selection algorithm for learning to rank.

Hierarchical Feature Selection Based on Label Distribution Learning

Hierarchical feature selection based on neighborhood interclass spacing from fine to coarse

Exploiting Multiple Features for Learning to Rank in Expert Finding

A Recursive Regularization Based Feature Selection Framework for Hierarchical Classification

Unsupervised Feature Selection Algorithm Based on Dual Manifold Re-ranking

Feature Selection for Monotonic Classification

Exploiting Local Coherent Patterns for Unsupervised Feature Ranking

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Query Clustering Based on Query Requirements for Ranking

Selecting optimal training data for learning to rank

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Multi-Label Feature Selection Combining Three Types of Conditional Relevance

Subspace Learning for Feature Selection via Rank Revealing QR Factorization: Unsupervised and Hybrid Approaches with Non-negative Matrix Factorization and Evolutionary Algorithm

A New Svm-Rfe Approach Towards Ranking Problem

Hierarchical Feature Selection for Random Projection

A decomposition-based multi-objective immune algorithm for feature selection in learning to rank