Abstract:Text classification is one of the fundamental tasks in natural language processing, which requires an agent to determine the most appropriate category for input sentences. Recently, deep neural networks have achieved impressive performance in this area, especially pretrained language models (PLMs). Usually, these methods concentrate on input sentences and corresponding semantic embedding generation. However, for another essential component: labels, most existing works either treat them as meaningless one-hot vectors or use vanilla embedding methods to learn label representations along with model training, underestimating the semantic information and guidance that these labels reveal. To alleviate this problem and better exploit label information, in this article, we employ self-supervised learning (SSL) in model learning process and design a novel self-supervised relation of relation (R <sup>2</sup> ) classification task for label utilization from a one-hot manner perspective. Then, we propose a novel () for text classification, in which text classification and R <sup>2</sup> classification are treated as optimization targets. Meanwhile, triplet loss is employed to enhance the analysis of differences and connections among labels. Moreover, considering that one-hot usage is still short of exploiting label information, we incorporate external knowledge from WordNet to obtain multiaspect descriptions for label semantic learning and extend to a novel () from a label embedding perspective. One step further, since these fine-grained descriptions may introduce unexpected noise, we develop a mutual interaction module to select appropriate parts from input sentences and labels simultaneously based on contrastive learning (CL) for noise mitigation. Extensive experiments on different text classification tasks reveal that can effectively improve the classification performance and can make better use of label information and further improve the performance. As a byproduct, we have released the codes to facilitate other research.

Enhancing Robust Text Classification via Category Description

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Description-Enhanced Label Embedding Contrastive Learning for Text Classification

Exploiting Textual and Visual Features for Image Categorization

Multi-category classification with label noise by robust binary loss

Description Based Text Classification with Reinforcement Learning

Towards Robust Text Classification: Mitigating Spurious Correlations with Causal Learning

Robust Learning for Text Classification with Multi-source Noise Simulation and Hard Example Mining

Automatic Noise Generation and Reduction for Text Classification

Dynamic training for handling textual label noise

Robust Image Classification with Noisy Labels by Negative Learning and Feature Space Renormalization

Noisy Label Processing for Classification: A Survey

Robust Long-Tailed Learning under Label Noise

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Analyze the Robustness of Classifiers under Label Noise

Denoising Multi-Source Weak Supervision for Neural Text Classification

ROBUST BINARY LOSS FOR MULTI-CATEGORY CLASSIFICATION WITH LABEL NOISE

Weakly-Supervised Neural Text Classification

An Ensemble Noise-Robust K-fold Cross-Validation Selection Method for Noisy Labels

Learning from Noisy Labels with Complementary Loss Functions