Abstract:In a conventional supervised learning paradigm, each data instance is associated with one single class label. Multilabel learning differs in the way that data instances may belong to multiple concepts simultaneously, which naturally appear in a variety of high impact domains, ranging from bioinformatics and information retrieval to multimedia analysis. It targets leveraging the multiple label information of data instances to build a predictive learning model that can classify unlabeled instances into one or multiple predefined target classes. In multilabel learning, even though each instance is associated with a rich set of class labels, the label information could be noisy and incomplete as the labeling process is both time consuming and labor expensive, leading to potential missing annotations or even erroneous annotations. The existence of noisy and missing labels could negatively affect the performance of underlying learning algorithms. More often than not, multilabeled data often has noisy, irrelevant, and redundant features of high dimensionality. The existence of these uninformative features may also deteriorate the predictive power of the learning model due to the curse of dimensionality. Feature selection, as an effective dimensionality reduction technique, has shown to be powerful in preparing high-dimensional data for numerous data mining and machine-learning tasks. However, a vast majority of existing multilabel feature selection algorithms either boil down to solving multiple single-labeled feature selection problems or directly make use of the imperfect labels to guide the selection of representative features. As a result, they may not be able to obtain discriminative features shared across multiple labels. In this article, to bridge the gap between a rich source of multilabel information and its blemish in practical usage, we propose a novel noise-resilient multilabel informed feature selection framework (MIFS) by exploiting the correlations among different labels. In particular, to reduce the negative effects of imperfect label information in obtaining label correlations, we decompose the multilabel information of data instances into a low-dimensional space and then employ the reduced label representation to guide the feature selection phase via a joint sparse regression framework. Empirical studies on both synthetic and real-world datasets demonstrate the effectiveness and efficiency of the proposed MIFS framework.

An Ensemble Multi-Label Feature Selection Algorithm Based on Information Entropy

Multi-label Feature Selection Based on Relative Entropy and Fuzzy Neighborhood Mutual Discrimination Index

LEFMIFS: Label enhancement and fuzzy mutual information for robust multilabel feature selection

An Ensemble Multi-Label Classification Method Using Feature Selection

Multi-Label Informed Feature Selection.

Multi-Label Bioinformatics Data Classification with Ensemble Embedded Feature Selection.

A Fast Feature Selection Method Based on Mutual Information in Multi-label Learning.

A Robust Multi-Label Feature Selection Based on Label Significance and Fuzzy Entropy

Enhanced multi-label feature selection considering label-specific relevant information

Multi-label Feature Selection Based on Fuzzy Neighborhood Mutual Discrimination Index

Ensemble feature selection for multi‐label text classification: An intelligent order statistics approach

Embedded feature selection for multi-label learning

Exploiting Multilabel Information for Noise-Resilient Feature Selection.

Mutual information based multi-label feature selection via constrained convex optimization.

Multi-label Feature Selection Algorithm Based on Joint Mutual Information of Max-Relevance and Min-Redundancy

A Mutual Information and Information Entropy Pair Based Feature Selection Method in Text Classification

Embedded Feature Selection for Multi-label Classification of Music Emotions

Multilabel Feature Selection Using Mutual Information and ML-ReliefF for Multilabel Classification

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

An information-theoretic feature selection method based on estimation of Markov blanket

Feature Selection For Multi-Label Learning Using Mutual Information And Ga