Abstract:User intent detection is vital for understanding their demands in dialogue systems. Although the User Intent Classification (UIC) task has been widely studied, for large-scale industrial applications, the task is still challenging. This is because user inputs in distinct domains may have different text distributions and target intent sets. When the underlying application evolves, new UIC tasks continuously emerge in a large quantity. Hence, it is crucial to develop a framework for large-scale extensible UIC that continuously fits new tasks and avoids catastrophic forgetting with an acceptable parameter growth rate. In this paper, we introduce the Meta Lifelong Learning (MeLL) framework to address this task. In MeLL, a BERT-based text encoder is employed to learn robust text representations across tasks, which is slowly updated for lifelong learning. We design global and local memory networks to capture the cross-task prototype representations of different classes, treated as the meta-learner quickly adapted to different tasks. Additionally, the Least Recently Used replacement policy is applied to manage the global memory such that the model size does not explode through time. Finally, each UIC task has its own task-specific output layer, with the attentive summarization of various features. We have conducted extensive experiments on both open-source and real industry datasets. Results show that MeLL improves the performance compared with strong baselines and also reduces the number of total parameters. We have also deployed MeLL on a real-world e-commerce dialogue system AliMe and observed significant improvements in terms of both F1 and the resources usage.

A Feature-Enriched Method for User Intent Classification by Leveraging Semantic Tag Expansion.

Still Haven't Found What You're Looking For -- Detecting the Intent of Web Search Missions from User Interaction Features

A Multi-Concept Semantic Representation System for Chinese Intent Recognition

Multi-Task Deep Learning for User Intention Understanding in Speech Interaction Systems

User Intention Modeling in Web Applications Using Data Mining

MeLL: Large-scale Extensible User Intent Classification for Dialogue Systems with Meta Lifelong Learning

Understanding users’ requirements precisely: a double Bi-LSTM-CRF joint model for detecting user’s intentions and slot tags

Effective user intent mining with unsupervised word representation models and topic modelling

Beyond Query: Interactive User Intention Understanding

Intention Understanding Based on Multi-Source Information Integration for Chinese Mandarin Spoken Commands.

Chinese User Service Intention Classification Based on Hybrid Neural Network

Intention Classification in Multiturn Dialogue Systems with Key Sentences Mining.

A Prompt Learning Based Intent Recognition Method on a Chinese Implicit Intent Dataset CIID

Enhancing Chinese Intent Classification by Dynamically Integrating Character Features into Word Embeddings with Ensemble Techniques

I Know Your Intent: Graph-enhanced Intent-aware User Device Interaction Prediction Via Contrastive Learning

DialogUSR: Complex Dialogue Utterance Splitting and Reformulation for Multiple Intent Detection

An Intent Recognition Model Supporting the Spoken Expression Mixed with Chinese and English.

AMFF: A new attention-based multi-feature fusion method for intention recognition

Multi-modal User Intent Classification Under the Scenario of Smart Factory (Student Abstract)

FDHFUI: Fusing Deep Representation and Hand-Crafted Features for User Identification

Incorporating Instructional Prompts into a Unified Generative Framework for Joint Multiple Intent Detection and Slot Filling.