Abstract:In a conventional supervised learning paradigm, each data instance is associated with one single class label. Multilabel learning differs in the way that data instances may belong to multiple concepts simultaneously, which naturally appear in a variety of high impact domains, ranging from bioinformatics and information retrieval to multimedia analysis. It targets leveraging the multiple label information of data instances to build a predictive learning model that can classify unlabeled instances into one or multiple predefined target classes. In multilabel learning, even though each instance is associated with a rich set of class labels, the label information could be noisy and incomplete as the labeling process is both time consuming and labor expensive, leading to potential missing annotations or even erroneous annotations. The existence of noisy and missing labels could negatively affect the performance of underlying learning algorithms. More often than not, multilabeled data often has noisy, irrelevant, and redundant features of high dimensionality. The existence of these uninformative features may also deteriorate the predictive power of the learning model due to the curse of dimensionality. Feature selection, as an effective dimensionality reduction technique, has shown to be powerful in preparing high-dimensional data for numerous data mining and machine-learning tasks. However, a vast majority of existing multilabel feature selection algorithms either boil down to solving multiple single-labeled feature selection problems or directly make use of the imperfect labels to guide the selection of representative features. As a result, they may not be able to obtain discriminative features shared across multiple labels. In this article, to bridge the gap between a rich source of multilabel information and its blemish in practical usage, we propose a novel noise-resilient multilabel informed feature selection framework (MIFS) by exploiting the correlations among different labels. In particular, to reduce the negative effects of imperfect label information in obtaining label correlations, we decompose the multilabel information of data instances into a low-dimensional space and then employ the reduced label representation to guide the feature selection phase via a joint sparse regression framework. Empirical studies on both synthetic and real-world datasets demonstrate the effectiveness and efficiency of the proposed MIFS framework.

Embedded feature selection for multi-label learning

Toward Embedding-Based Multi-Label Feature Selection with Label and Feature Collaboration

Multi-Label Informed Feature Selection.

An Ensemble Multi-Label Feature Selection Algorithm Based on Information Entropy

Embedded Feature Selection for Multi-label Classification of Music Emotions

A multi-label feature extraction algorithm via maximizing feature variance and feature-label dependence simultaneously.

Multi-label feature selection by strongly relevant label gain and label mutual aid

Parallel dual-channel multi-label feature selection

Multi-label Feature Selection Via Joint Label Enhancement and Pairwise Label Correlations

Multi-label Feature Selection Based on Relative Entropy and Fuzzy Neighborhood Mutual Discrimination Index

Fuzzy Mutual Information-Based Multilabel Feature Selection with Label Dependency and Streaming Labels

Label Correlation Guided Feature Selection for Multi-label Learning.

Enhanced multi-label feature selection considering label-specific relevant information

Multi-label Feature Selection Based on Fuzzy Neighborhood Mutual Discrimination Index

A Fast Feature Selection Method Based on Mutual Information in Multi-label Learning.

LEFMIFS: Label enhancement and fuzzy mutual information for robust multilabel feature selection

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

Multi-label Feature Selection Based on Max-Dependency and Min-Redundancy.

Exploiting Multilabel Information for Noise-Resilient Feature Selection.

Embedded Feature Fusion for Multi-View Multi-Label Feature Selection

Feature Selection for Multi-label Learning: A Systematic Literature Review and Some Experimental Evaluations