Abstract:Multi-Label Text Classification (MLTC) is one of the most import research of natural language processing. Although Deep Learning (DL) models have been widely applied to MLTC, there still exist some drawbacks. First, traditional DL models utilize all the words in the document to construct the embedding vector, while there are many words that affect the classification results. Next, the labels in MLTC have specific semantics, while traditional DL models ignore fine-grained matching signals between words and labels. Then, traditional DL models have difficulty in handling the data imbalance issue in MLTC datasets. In addition, during the training process, small errors in a certain epoch may be amplified with the increase of the number of iterations, resulting in classification errors. To address the above problems, a MLTC model integrating Label Attention and Historical Attention (i.e. LAHA) is proposed. First, a word filter is set up to select important words based on the cosine similarity between words and labels. Next, Document Self Attention (DSA) and Label Attention (LA) are obtained, and DSA-attended LA co-attention (LA-co) and LA-attended DSA co-attention (DAS-co) networks are constructed. Then, the fine-grained matching signals between words and labels are integrated through the adaptive plus of LA-co and DAS-co. At last, Historical Attention is integrated to LAHA, which not only avoids mis-classification caused by minor errors of a certain epoch, but also reduces overfitting to high-frequency labels. Multiple comparative experiments on four benchmark datasets demonstrate that LAHA outperforms the state-of-the-art baseline models and can effectively solve the data imbalance issue in MLTC datasets. Our code is available at https://github.com/sgysgywaityou/LAHA.

Label-Wise Document Pre-Training for Multi-Label Text Classification

A Label Information Aware Model for Multi-label Text Classification

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Dual Enhancement for Multi-Label Learning with Missing Labels

Partial Multi-label Learning with Label and Feature Collaboration

Multi-Label Text Classification Model Integrating Label Attention and Historical Attention

On the Value of Head Labels in Multi-Label Text Classification

Research of multi-label text classification based on label attention and correlation networks

Multi-label Classification via Label-Topic Pairs

Label prompt for multi-label text classification

MLGN:A Multi-Label Guided Network for Improving Text Classification

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

Multi-Task Label Embedding for Text Classification

Learning Label-Adaptive Representation for Large-Scale Multi-Label Text Classification

Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification

Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification.

Multi-Label Learning by Exploiting Label Correlations with LDA

A Debiased Nearest Neighbors Framework for Multi-Label Text Classification

Meta-LMTC - Meta-Learning for Large-Scale Multi-Label Text Classification.

Multi-label text classification via joint learning from label embedding and label correlation

Effective Multi-Label Active Learning for Text Classification