Abstract:Text classification is one of the fundamental tasks in natural language processing, which requires an agent to determine the most appropriate category for input sentences. Recently, deep neural networks have achieved impressive performance in this area, especially pretrained language models (PLMs). Usually, these methods concentrate on input sentences and corresponding semantic embedding generation. However, for another essential component: labels, most existing works either treat them as meaningless one-hot vectors or use vanilla embedding methods to learn label representations along with model training, underestimating the semantic information and guidance that these labels reveal. To alleviate this problem and better exploit label information, in this article, we employ self-supervised learning (SSL) in model learning process and design a novel self-supervised relation of relation (R <sup>2</sup> ) classification task for label utilization from a one-hot manner perspective. Then, we propose a novel () for text classification, in which text classification and R <sup>2</sup> classification are treated as optimization targets. Meanwhile, triplet loss is employed to enhance the analysis of differences and connections among labels. Moreover, considering that one-hot usage is still short of exploiting label information, we incorporate external knowledge from WordNet to obtain multiaspect descriptions for label semantic learning and extend to a novel () from a label embedding perspective. One step further, since these fine-grained descriptions may introduce unexpected noise, we develop a mutual interaction module to select appropriate parts from input sentences and labels simultaneously based on contrastive learning (CL) for noise mitigation. Extensive experiments on different text classification tasks reveal that can effectively improve the classification performance and can make better use of label information and further improve the performance. As a byproduct, we have released the codes to facilitate other research.

Exploring Description-Augmented Dataless Intent Classification

Online Differentiable Clustering for Intent Learning in Recommendation.

Dataless Text Classification with Descriptive LDA.

Description-Enhanced Label Embedding Contrastive Learning for Text Classification

Generate then Refine: Data Augmentation for Zero-shot Intent Detection

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks

New Intent Discovery with Pre-training and Contrastive Learning

Intent Classification Using Pre-trained Language Agnostic Embeddings For Low Resource Languages

Unsupervised Document Embedding via Contrastive Augmentation

Description Based Text Classification with Reinforcement Learning

Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification

Description Boosting for Zero-Shot Entity and Relation Classification

Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training

Improved Out-of-Scope Intent Classification with Dual Encoding and Threshold-based Re-Classification

A character representation enhanced on-device Intent Classification

Similarity Learning with Implicit-Network and Explicit-Network for Zero-Shot Intent Detection

Intent-Enhanced Data Augmentation for Sequential Recommendation

Enhancing Chinese Intent Classification by Dynamically Integrating Character Features into Word Embeddings with Ensemble Techniques

On the Effectiveness of Sentence Encoding for Intent Detection Meta-Learning

Enhancing Intent Classifier Training with Large Language Model-generated Data

Analysis of Utterance Embeddings and Clustering Methods Related to Intent Induction for Task-Oriented Dialogue