Abstract:In the current paper, we propose a probabilistic generative model, the label correlation mixture model (LCMM), to depict multi-labeled document data, which can be utilized for multi-label text classification. LCMM assumes two stochastic generative processes, which correspond to two submodels: 1) a label correlation model; and 2) a label mixture model. The former model formulates labels' generative process, in which a label correlation network is created to depict the dependency between labels. Moreover, we present an efficient inference algorithm for calculating the generative probability of a multi-label class. Furthermore, in order to optimize the label correlation network, we propose a parameter-learning algorithm based on gradient descent. The second submodel in the LCMM depicts the generative process of words in a document with the given labels. Different traditional mixture models can be adopted in this generative process, such as the mixture of language models, or topic models. In the multi-label classification stage, we propose a two-step strategy to most efficiently utilize the LCMM based on the framework of Bayes decision theory. We conduct extensive multi-label classification experiments on three standard text data sets. The experimental results show significant performance improvements comparing to existing approaches. For example, the improvements on accuracy and macro F-score measures in the OHSUMED data set achieve 28.3% and 37.0%, respectively. These performance enhancements demonstrate the effectiveness of the proposed models and solutions.

A Generative Probabilistic Model for Multi-label Classification

Multi-label Text Classification Based on the Label Correlation Mixture Model.

A Bayesian Network nearest k-labels method for Multi-label classification

Capturing Correlations of Multiple Labels: A Generative Probabilistic Model for Multi-Label Learning

Label correlation mixture model for multi-label text categorization

Generative Multi-Label Correlation Learning

Label Correlation Mixture Model: A Supervised Generative Approach to Multilabel Spoken Document Categorization

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Multi-label classification by exploiting label correlations

Multi-Label Bayesian Active Learning with Inter-Label Relationships

CorrLog: Correlated Logistic Models for Joint Prediction of Multiple Labels.

Multi-label classification by exploiting local positive and negative pairwise label correlation

A General Framework for Multi-Label Learning Towards Class Correlations and Class Imbalance.

Multi-Label Learning by Exploiting Label Correlations with LDA

Generative-Discriminative Complementary Learning

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Multi-Label Learning by Exploiting Label Correlations Locally

Multi-label classification with weak labels by learning label correlation and label regularization

Learning common and label-specific features for multi-Label classification with correlation information

Probability-based Label Enhancement for Multi-Dimensional Classification

Correlated Logistic Model with Elastic Net Regularization for Multilabel Image Classification