Abstract:In the multi-label text classification task, a text usually corresponds to multiple label categories, and the labels have correlation and hierarchical structure. However, when the label hierarchy is unknown, the number of various labels is not balanced, which makes it difficult for the model to classify low-frequency labels. At the same time, due to the existence of similar labels, the model will be difficult to distinguish similar labels. In this paper, we propose a multi-label text classification model based on multi-level constraint augmentation and label association attention. Compared with traditional methods, our method has two contributions: (1) In order to alleviate the problem of unbalanced number of different label categories and ensure the rationality of sample generation, we propose a data augmentation method based on multi-level constraints. In the process of sample generation, this method uses historical generation information, sample original text information and sample topic to constrain the generated text. (2) In order to make the model recognize the associated labels accurately, we propose an interaction mechanism based on label association attention and filter gate. This method combines text information and label weight information. At the same time, our classification model considers the important weights of text sentences and effectively utilizes the co-occurrence relationship between labels. Experimental results on three benchmark datasets show that our model outperforms state-of-the-art methods on all main evaluation metrics, especially on low-frequency label prediction with sparse samples.

Long-tailed Multi-label Text Classification Via Label Co-occurrence-Aware Knowledge Transfer

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Dual Enhancement for Multi-Label Learning with Missing Labels

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

On the Value of Head Labels in Multi-Label Text Classification

Residual diverse ensemble for long-tailed multi-label text classification

A Dual-Branch Learning Model with Gradient-Balanced Loss for Long-Tailed Multi-Label Text Classification

Research of multi-label text classification based on label attention and correlation networks

A Label Information Aware Model for Multi-label Text Classification

Hierarchical long-tailed classification based on multi-granularity knowledge transfer driven by multi-scale feature fusion

Multi-label Text Categorization with Joint Learning Predictions-as-Features Method

Does Tail Label Help for Large-Scale Multi-Label Learning

MsCoa: Multi-Step Co-Attention Model for Multi-Label Classification

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Learning for Tail Label Data: A Label-Specific Feature Approach.

Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Distribution-Balanced Loss for Multi-label Classification in Long-Tailed Datasets

Multi-label Classification via Label-Topic Pairs

Effective Multi-Label Active Learning for Text Classification

Learning Label-Adaptive Representation for Large-Scale Multi-Label Text Classification