Abstract:Few-shot intent detection is a challenging task. Most existing methods only focus on acquisition of generalization knowledge in known classes, or on the adaptation situation of meta-learning tasks. However, these methods lack both the learning of beneficial information for intent detection and the learning of discriminative representation of intent keywords. Solving these problems can effectively improve the model's ability to recognize text intent and thus effectively execute user commands. Therefore, in this paper, we propose a few-shot intent detection framework based on Mutual Information and Contrastive Learning (MICL). It improves the robustness of the model learning of intent keywords through mutual information maximization, thus improving the accuracy of intent detection. Additionally, maximization of mutual information enhances the intent representation consistency on two text views,1which helps to promote the efficiency of sample contrastive learning. Specifically, we use a neural network to approximately estimate the joint probability distribution and marginal probability distribution of two text views and maximize the mutual information through back-propagation. In order to enable the model to focus on intent keywords in text, we introduce a sample-level contrastive learning. It helps the model to learn discriminative representations of intent keywords by comparing the similarity of text from two text views. In addition, to prevent overfitting of the model on known classes, we introduce a class-level contrastive learning. We regard it as regularization of known classes, aiming to improve the model generalization performance on unknown classes. Our method achieves state-of-the-art performance on four public datasets.2

Dual Class Knowledge Propagation Network for Multi-label Few-shot Intent Detection

Few-shot Learning for Multi-label Intent Detection

Multi-Label Few-Shot Learning for Aspect Category Detection

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Dual Enhancement for Multi-Label Learning with Missing Labels

Towards Multi-label Unknown Intent Detection.

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

A Pointer Network-based Approach for Joint Extraction and Detection of Multi-Label Multi-Class Intents

Label-enhanced Prototypical Network with Contrastive Learning for Multi-label Few-shot Aspect Category Detection

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks

Learning to Classify Open Intent via Soft Labeling and Manifold Mixup

Few-shot Intent Detection with Mutual Information and Contrastive Learning

Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection

Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot Filling

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Dual-stream Multi-Modal Graph Neural Network for Few-Shot Learning

Continual Few-shot Intent Detection.

Multi-label Few-shot Learning with Semantic Inference (student Abstract)

Similarity Learning with Implicit-Network and Explicit-Network for Zero-Shot Intent Detection

New Intent Discovery with Pre-training and Contrastive Learning

Dual Branch Multi-Level Semantic Learning for Few-Shot Segmentation