Abstract:In the current paper, we propose a probabilistic generative model, the label correlation mixture model (LCMM), to depict multi-labeled document data, which can be utilized for multi-label text classification. LCMM assumes two stochastic generative processes, which correspond to two submodels: 1) a label correlation model; and 2) a label mixture model. The former model formulates labels' generative process, in which a label correlation network is created to depict the dependency between labels. Moreover, we present an efficient inference algorithm for calculating the generative probability of a multi-label class. Furthermore, in order to optimize the label correlation network, we propose a parameter-learning algorithm based on gradient descent. The second submodel in the LCMM depicts the generative process of words in a document with the given labels. Different traditional mixture models can be adopted in this generative process, such as the mixture of language models, or topic models. In the multi-label classification stage, we propose a two-step strategy to most efficiently utilize the LCMM based on the framework of Bayes decision theory. We conduct extensive multi-label classification experiments on three standard text data sets. The experimental results show significant performance improvements comparing to existing approaches. For example, the improvements on accuracy and macro F-score measures in the OHSUMED data set achieve 28.3% and 37.0%, respectively. These performance enhancements demonstrate the effectiveness of the proposed models and solutions.

CorrLog: Correlated Logistic Models for Joint Prediction of Multiple Labels.

Correlated Logistic Model with Elastic Net Regularization for Multilabel Image Classification

Joint Learning of Multi-Label Classification and Label Correlations

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Learning common and label-specific features for multi-Label classification with correlation information

Multi-label classification by exploiting local positive and negative pairwise label correlation

Multi-label classification by exploiting label correlations

Clustered Intrinsic Label Correlations for Multi-Label Classification

A Generative Probabilistic Model for Multi-label Classification

Multi-label Text Classification Based on the Label Correlation Mixture Model.

Exploring Common and Label-Specific Features for Multi-Label Learning with Local Label Correlations

Rethinking Modal-oriented Label Correlations for Multi-modal Multi-label Learning

Learning Instance Correlation Functions for Multilabel Classification

Capturing Correlations of Multiple Labels: A Generative Probabilistic Model for Multi-Label Learning

Multi-Label Learning by Exploiting Label Correlations Locally

Exploiting Multi-Label Correlation in Label Distribution Learning

Weakly Supervised Multi-label Learning Using Prior Label Correlation Information

Complementary to Multiple Labels: A Correlation-Aware Correction Approach

Label Correlations Variation for Robust Multi-Label Feature Selection

Label Correlation Mixture Model: A Supervised Generative Approach to Multilabel Spoken Document Categorization

Label Distribution Learning by Exploiting Label Correlations.