Abstract:Feature selection is an important learning task in data mining and knowledge discovery. Nevertheless, the fuzziness, uncertainty, and noise presented by the data greatly complicate the construction of learning models. Moreover, most works focus on exploring low-order correlations between variables using low-dimensional mutual information, without paying attention to high-order interaction for multiple variables, resulting in the loss of some potentially important dependency information. Driven by these two issues, a robust knowledge metric approach is invented to perceive and excavate the latent information hidden in interaction. In this study, firstly, a robust fuzzy granularity space is constructed from different granular structures induced by different features, and the robust fuzzy uncertainty measures (RFUMs) are successively devised. Then, RFUMs are used to measure pair-wise, three-order, and even higher-order interaction dependencies among features. Further, a constrained high-order interaction evaluation function inspired by the N-gram language model is formulated, and a corresponding high-order interaction feature selection algorithm with RFUMs ( HIFS-RFUMs ) is designed. Next, comparative experiments with seven representative algorithms on twenty datasets illustrate its effectiveness. In addition, ablation experiments are conducted on the high-order interaction feature selection algorithm with fuzzy uncertainty measures ( HIFS -FUMs) and the relative reduction algorithm with RFUMs (R2- RFUMs ), which demonstrate the robustness of the metric and the effectiveness for mining high-order interactive features, respectively.

Feature selection based on feature interactions with application to text categorization.

Feature Selection with Conditional Mutual Information Considering Feature Interaction

An Interaction-Enhanced Feature Selection Algorithm

Feature selection and threshold method based on fuzzy joint mutual information

Feature Selection Method on Imbalanced Text

Fuzzy joint mutual information feature selection based on ideal vector

MFSJMI: Multi-label Feature Selection Considering Join Mutual Information and Interaction Weight

Interaction-based Feature Selection Using Factorial Design

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

JMIM: A Feature Selection Technique using Joint Mutual Information Maximization Approach

High-order interaction feature selection for classification learning: A robust knowledge metric perspective

An Effective Feature Selection Method For Text Categorization

FIVE NEW FEATURE SELECTION METRICS IN TEXT CATEGORIZATION

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

A New Approach of Feature Selection for Text Categorization

Select Strong Information Features to Improve Text Categorization Effectiveness

Joint Feature Selection and Classification for Multilabel Learning

Toward Optimal Feature Selection in Naive Bayes for Text Categorization

Feature selection algorithm for text classification based on improved mutual information

Effective fuzzy joint mutual information feature selection based on uncertainty region for classification problem