Abstract:To make the problem of multilabel classification with many classes more tractable, in recent years, academia has seen efforts devoted to performing label space dimension reduction (LSDR). Specifically, LSDR encodes high-dimensional label vectors into low-dimensional code vectors lying in a latent space, so as to train predictive models at much lower costs. With respect to the prediction, it performs classification for any unseen instance by recovering a label vector from its predicted code vector via a decoding process. In this paper, we propose a novel method, namely End-to-End Feature-aware label space Encoding (E2FE), to perform LSDR. Instead of requiring an encoding function like most previous works, E2FE directly learns a code matrix formed by code vectors of the training instances in an end-to-end manner. Another distinct property of E2FE is its feature awareness attributable to the fact that the code matrix is learned by jointly maximizing the recoverability of the label space and the predictability of the latent space. Based on the learned code matrix, E2FE further trains predictive models to map instance features into code vectors, and also learns a linear decoding matrix for efficiently recovering the label vector of any unseen instance from its predicted code vector. Theoretical analyses show that both the code matrix and the linear decoding matrix in E2FE can be efficiently learned. Moreover, similar to previous works, E2FE can be specified to learn an encoding function. And it can also be extended with kernel tricks to handle nonlinear correlations between the feature space and the latent space. Comprehensive experiments conducted on diverse benchmark data sets with many classes show consistent performance gains of E2FE over the state-of-the-art methods.

Incorporating Label Embedding and Feature Augmentation for Multi-Dimensional Classification.

Two-Stage Label Embedding Via Neural Factorization Machine for Multi-Label Classification

Dual Enhancement for Multi-Label Learning with Missing Labels

Multi-Dimensional Classification Via Class Space Fusion and Comprehensive Label Correlations

Multi-Dimensional Classification via Decomposed Label Encoding

Learning from Multi-Dimensional Partial Labels.

Probability-based Label Enhancement for Multi-Dimensional Classification

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

MULFE: Multi-Label Learning via Label-Specific Feature Space Ensemble

Enhance Via Decoupling - Improving Multi-Label Classifiers with Variational Feature Augmentation.

Embedded feature selection for multi-label learning

Incorporating Multiple Cluster Centers for Multi-Label Learning

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Deep Cross-View Label Embedding with Correlation and Structure Preserved for Multi-Label Classification

Partial Classifier Chains with Feature Selection by Exploiting Label Correlation in Multi-Label Classification

Disentangling, Embedding and Ranking Label Cues for Multi-Label Image Recognition

Multi-label text classification via joint learning from label embedding and label correlation

End-to-End Feature-Aware Label Space Encoding for Multilabel Classification with Many Classes.

Toward Embedding-Based Multi-Label Feature Selection with Label and Feature Collaboration

Learning Label-Specific Features Via Neural Network for Multi-Label Classification