Abstract:Unsupervised feature selection is one of the important techniques for unsupervised knowledge discovery, which aims to reduce the dimensionality of conditional feature sets as much as possible to improve the efficiency and accuracy of the algorithm. However, existing methods have the following two challenges: (1) They are mainly applicable to select numerical or nominal features and cannot effectively select heterogeneous features; (2) The relevance and redundancy are primarily considered to construct feature evaluation indexes, ignoring the interaction information of heterogeneous features. To solve the challenges mentioned above, this paper proposes an unsupervised heterogeneous feature selection method based on fuzzy multi-neighborhood entropy, which also considers the multi-correlation of features to select heterogeneous features. First, the fuzzy multi-neighborhood granule is constructed by considering the distribution characteristics of the data. Then, the concept of fuzzy entropy is introduced to define the fuzzy multi-neighborhood entropy and its associated uncertainty measures, and the relationship between them is discussed. Next, the relevance, redundancy, and interactivity among attributes are defined, and the idea of maximum relevance-minimum redundancy-maximum interactivity is used to construct the evaluation indexes of heterogeneous features. Finally, experiments are conducted on several publicly unbalanced datasets, and the results are in comparison with existing algorithms. The experimental results show that the proposed algorithm can select fewer heterogeneous features to improve the efficiency of outlier detection tasks. The code is publicly available online at https://github.com/BELLoney/MNIFS.

An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution

An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution

Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy

Uncertainty measures and feature selection based on composite entropy for generalized multigranulation fuzzy neighborhood rough set

Feature selection using relative dependency complement mutual information in fitting fuzzy rough set model

Fuzzy Multi-Neighborhood Entropy-Based Interactive Feature Selection for Unsupervised Outlier Detection

Fusing Entropy Measures for Dynamic Feature Selection in Incomplete Approximation Spaces

Information-theoretic Partially Labeled Heterogeneous Feature Selection Based on Neighborhood Rough Sets

Feature Selection With Local Density-Based Fuzzy Rough Set Model for Noisy Data

Feature Selection for Unbalanced Distribution Hybrid Data Based on ${K}$-Nearest Neighborhood Rough Set

A relative uncertainty measure for fuzzy rough feature selection

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

An Incremental Feature Selection Approach Based on Information Entropy for Incomplete Data

Complement Information Entropy for Uncertainty Measure in Fuzzy Rough Set and Its Applications

Feature Selection Using Zentropy-Based Uncertainty Measure

A Fast Feature Selection Algorithm by Accelerating Computation of Fuzzy Rough Set-Based Information Entropy

Multi-label feature selection based on fuzzy neighborhood rough sets

Granularity Self-Information Based Uncertainty Measure for Feature Selection and Robust Classification

Feature Genes Selection Based on Fuzzy Neighborhood Conditional Entropy

Relative Fuzzy Rough Approximations for Feature Selection and Classification

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.