Abstract:In a conventional supervised learning paradigm, each data instance is associated with one single class label. Multilabel learning differs in the way that data instances may belong to multiple concepts simultaneously, which naturally appear in a variety of high impact domains, ranging from bioinformatics and information retrieval to multimedia analysis. It targets leveraging the multiple label information of data instances to build a predictive learning model that can classify unlabeled instances into one or multiple predefined target classes. In multilabel learning, even though each instance is associated with a rich set of class labels, the label information could be noisy and incomplete as the labeling process is both time consuming and labor expensive, leading to potential missing annotations or even erroneous annotations. The existence of noisy and missing labels could negatively affect the performance of underlying learning algorithms. More often than not, multilabeled data often has noisy, irrelevant, and redundant features of high dimensionality. The existence of these uninformative features may also deteriorate the predictive power of the learning model due to the curse of dimensionality. Feature selection, as an effective dimensionality reduction technique, has shown to be powerful in preparing high-dimensional data for numerous data mining and machine-learning tasks. However, a vast majority of existing multilabel feature selection algorithms either boil down to solving multiple single-labeled feature selection problems or directly make use of the imperfect labels to guide the selection of representative features. As a result, they may not be able to obtain discriminative features shared across multiple labels. In this article, to bridge the gap between a rich source of multilabel information and its blemish in practical usage, we propose a novel noise-resilient multilabel informed feature selection framework (MIFS) by exploiting the correlations among different labels. In particular, to reduce the negative effects of imperfect label information in obtaining label correlations, we decompose the multilabel information of data instances into a low-dimensional space and then employ the reduced label representation to guide the feature selection phase via a joint sparse regression framework. Empirical studies on both synthetic and real-world datasets demonstrate the effectiveness and efficiency of the proposed MIFS framework.

A multi-label feature extraction algorithm via maximizing feature variance and feature-label dependence simultaneously.

Embedded feature selection for multi-label learning

Learning shared subspace for multi-label dimensionality reduction via dependence maximization

Multi-label feature selection by strongly relevant label gain and label mutual aid

A Weighted Linear Discriminant Analysis Framework for Multi-Label Feature Extraction

Novel multi-label feature selection via label enhancement and relative maximal discernibility pairs

Multilabel Dimensionality Reduction Via Dependence Maximization.

Mutual information based multi-label feature selection via constrained convex optimization.

Dependence Maximization Based Label Space Dimension Reduction for Multi-Label Classification.

Multi-label Feature Selection Based on Max-Dependency and Min-Redundancy.

Parallel dual-channel multi-label feature selection

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.

Multi-Label Informed Feature Selection.

Multi-label Feature Selection Via Adaptive Dual-Graph Optimization

Multi-Label Feature Selection via Label Enhancement and Analytic Hierarchy Process

A Simple and Convex Formulation for Multi-label Feature Selection.

Label driven latent subspace learning for multi-view multi-label classification

Exploiting Multilabel Information for Noise-Resilient Feature Selection.

Feature extraction using maximum nonparametric margin projection.

A Fast Feature Selection Method Based on Mutual Information in Multi-label Learning.

Multi-label Feature Selection Via Joint Label Enhancement and Pairwise Label Correlations