Abstract:Unsupervised feature selection is one of the important techniques for unsupervised knowledge discovery, which aims to reduce the dimensionality of conditional feature sets as much as possible to improve the efficiency and accuracy of the algorithm. However, existing methods have the following two challenges: (1) They are mainly applicable to select numerical or nominal features and cannot effectively select heterogeneous features; (2) The relevance and redundancy are primarily considered to construct feature evaluation indexes, ignoring the interaction information of heterogeneous features. To solve the challenges mentioned above, this paper proposes an unsupervised heterogeneous feature selection method based on fuzzy multi-neighborhood entropy, which also considers the multi-correlation of features to select heterogeneous features. First, the fuzzy multi-neighborhood granule is constructed by considering the distribution characteristics of the data. Then, the concept of fuzzy entropy is introduced to define the fuzzy multi-neighborhood entropy and its associated uncertainty measures, and the relationship between them is discussed. Next, the relevance, redundancy, and interactivity among attributes are defined, and the idea of maximum relevance-minimum redundancy-maximum interactivity is used to construct the evaluation indexes of heterogeneous features. Finally, experiments are conducted on several publicly unbalanced datasets, and the results are in comparison with existing algorithms. The experimental results show that the proposed algorithm can select fewer heterogeneous features to improve the efficiency of outlier detection tasks. The code is publicly available online at https://github.com/BELLoney/MNIFS.

A Hybrid Method of Unsupervised Feature Selection Based on Ranking

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Hierarchical Fuzzy Filter Method for Unsupervised Feature Selection

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

Exploiting Local Coherent Patterns for Unsupervised Feature Ranking

Heuristic feature selection method for clustering

Unsupervised Feature Selection with Joint Clustering Analysis.

A Novel Unsupervised Feature Selection Method for Bioinformatics Data Sets Through Feature Clustering

A Feature Selection Framework Based on Supervised Data Clustering

Unsupervised Feature Selection for Balanced Clustering

Unsupervised Feature Selection Based on Feature Relevance

Supervised Feature Selection with a Stratified Feature Weighting Method

A Stratified Feature Ranking Method for Supervised Feature Selection.

A Novel Unsupervised Feature Selection for High-Dimensional Data Based on FCM and $k$ -Nearest Neighbor Rough Sets

Fuzzy Multi-Neighborhood Entropy-Based Interactive Feature Selection for Unsupervised Outlier Detection

Feature Selection Using Hierarchical Feature Clustering

A New Supervised Feature Selection Method for Pattern Classification.

A Clustering Ensemble Based Unsupervised Feature Selection Approach

Exploiting Word Cluster Information for Unsupervised Feature Selection