Abstract:Feature selection is an important way to optimize the efficiency and accuracy of classifiers. However, traditional feature selection methods cannot work with many kinds of data in the real world, such as multi-label data. To overcome this challenge, multi-label feature selection is developed. Multi-label feature selection plays an irreplaceable role in pattern recognition and data mining. This process can improve the efficiency and accuracy of multi-label classification. However, traditional multi-label feature selection based on mutual information does not fully consider the effect of redundancy among labels. The deficiency may lead to repeated computing of mutual information and leave room to enhance the accuracy of multi-label feature selection. To deal with this challenge, this paper proposed a multi-label feature selection based on conditional mutual information among labels (CRMIL). Firstly, we analyze how to reduce the redundancy among features based on existing papers. Secondly, we propose a new approach to diminish the redundancy among labels. This method takes label sets as conditions to calculate the relevance between features and labels. This approach can weaken the impact of the redundancy among labels on feature selection results. Finally, we analyze this algorithm and balance the effects of relevance and redundancy on the evaluation function. For testing CRMIL, we compare it with the other eight multi-label feature selection algorithms on ten datasets and use four evaluation criteria to examine the results. Experimental results illustrate that CRMIL performs better than other existing algorithms.

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Conditional mutual information-based feature selection analyzing for synergy and redundancy

Feature Selection Using Mutual Information: An Experimental Study

An Interaction-Enhanced Feature Selection Algorithm

A feature selection algorithm based on redundancy analysis and interaction weight

Feature Selection With Dynamic Mutual Information

Mutual Information Criteria for Feature Selection

A Feature Selection Algorithm Based on Equal Interval Division and Conditional Mutual Information

Feature Selection by Maximizing Part Mutual Information

Conditional Mutual Information-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Feature Selection Considering Two Types of Feature Relevancy and Feature Interdependency.

Multi-Label Feature Selection with Conditional Mutual Information

Feature Selection Algorithm Based On Conditional Dynamic Mutual Information

MFSJMI: Multi-label Feature Selection Considering Join Mutual Information and Interaction Weight

Multi-label Feature Selection Algorithm Based on Joint Mutual Information of Max-Relevance and Min-Redundancy

Feature selection based on mutual information with correlation coefficient

An Intrusion Detection Feature Selection Method Based on Improved Mutual Information

Feature selection based on complementarity of feature classification capability

Feature selection based on survival Cauchy-Schwartz mutual information

Minimum Joint Mutual Information Loss-based Optimal Feature Selection Algorithm

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures