Abstract:Text classification is one of the fundamental tasks in natural language processing, which requires an agent to determine the most appropriate category for input sentences. Recently, deep neural networks have achieved impressive performance in this area, especially pretrained language models (PLMs). Usually, these methods concentrate on input sentences and corresponding semantic embedding generation. However, for another essential component: labels, most existing works either treat them as meaningless one-hot vectors or use vanilla embedding methods to learn label representations along with model training, underestimating the semantic information and guidance that these labels reveal. To alleviate this problem and better exploit label information, in this article, we employ self-supervised learning (SSL) in model learning process and design a novel self-supervised relation of relation (R <sup>2</sup> ) classification task for label utilization from a one-hot manner perspective. Then, we propose a novel () for text classification, in which text classification and R <sup>2</sup> classification are treated as optimization targets. Meanwhile, triplet loss is employed to enhance the analysis of differences and connections among labels. Moreover, considering that one-hot usage is still short of exploiting label information, we incorporate external knowledge from WordNet to obtain multiaspect descriptions for label semantic learning and extend to a novel () from a label embedding perspective. One step further, since these fine-grained descriptions may introduce unexpected noise, we develop a mutual interaction module to select appropriate parts from input sentences and labels simultaneously based on contrastive learning (CL) for noise mitigation. Extensive experiments on different text classification tasks reveal that can effectively improve the classification performance and can make better use of label information and further improve the performance. As a byproduct, we have released the codes to facilitate other research.

LED: Label Correlation Enhanced Decoder for Multi-Label Text Classification

Multi-label text classification via joint learning from label embedding and label correlation

Two-Stage Label Embedding Via Neural Factorization Machine for Multi-Label Classification

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Disentangling, Embedding and Ranking Label Cues for Multi-Label Image Recognition

Correlation-Guided Representation for Multi-Label Text Classification

Multi-Task Label Embedding for Text Classification

Research of multi-label text classification based on label attention and correlation networks

Label-Related Adaptive Graph Construction Based on Attention for Multi-label Text Classification

Query2Label: A Simple Transformer Way to Multi-Label Classification

Distance Restricted Transformer Encoder for Multi-Label Classification

Multi-label Text Classification Based on Sequence Model.

Description-Enhanced Label Embedding Contrastive Learning for Text Classification

TLC-XML: Transformer with Label Correlation for Extreme Multi-label Text Classification

MsCoa: Multi-Step Co-Attention Model for Multi-Label Classification

MLGN:A Multi-Label Guided Network for Improving Text Classification

Multi-Label Classification with Label Graph Superimposing

Multi-Label Text Classification Model Integrating Label Attention and Historical Attention

Label Dependencies-Aware Set Prediction Networks for Multi-Label Text Classification

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.