Abstract:Intent determination and slot filling are two prominent research areas related to natural language understanding (NLU). In a multi-turn NLU system, contextual information from dialogue history is exploited to mitigate the ambiguity of user utterance. State-of-the-art models employ memory networks to encode dialogue context, which is used by neural networks for determining user intent and associated slots. However, these methods rely on a large amount of labelled data, whereas we often have limited labelled data. To address this problem, we propose a multi-task learning model based on neural networks and regular expressions (REs), to jointly perform intent determination and slot filling tasks. The proposed model integrates neural networks with REs to encode domain knowledge and handle cases with a limited amount of labelled data in an end-to-end trainable manner. More specifically, the model employs a pre-trained BERT model to obtain contextual word representations of user utterances. These representations are utilized by a memory network to encode multi-turn information which is shared by the tasks. Furthermore, the convolutional neural network (CNN) and the recurrent neural network (RNN) are applied to contextual word representations and dialogue context for intent determination and slot filling tasks, respectively. These neural networks are then combined with REs which encode domain knowledge about a particular intent or slot value. Finally, the two neural networks are trained simultaneously by minimizing the joint loss. Extensive experiments on Key-Value Retrieval and Frames datasets show that the proposed model outperforms baseline methods in both tasks while requiring modest human effort.

Dialogue Intent Classification with Long Short-Term Memory Networks.

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Learning Dialogue History for Spoken Language Understanding.

Multi-Task Deep Learning for User Intention Understanding in Speech Interaction Systems

Intent-Aware Dialogue Generation and Multi-Task Contrastive Learning for Multi-Turn Intent Classification

Intent Classification Based on Single Model

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks

MeLL: Large-scale Extensible User Intent Classification for Dialogue Systems with Meta Lifelong Learning

Cascaded LSTMs based Deep Reinforcement Learning for Goal-driven Dialogue

Multi-domain Language Understanding of Task Oriented Dialogue Based on Intent Enhancement.

Human-Robot Collaboration by Intention Recognition Using Deep LSTM Neural Network

Memory-to-Sequence learning with LSTM joint decoding for task-oriented dialogue systems

A Post-Processing Method for Detecting Unknown Intent of Dialogue System Via Pre-Trained Deep Neural Network Classifier

A Novel Model Based on a Transformer for Intent Detection and Slot Filling

Dialog State Tracking Using Long Short-Term Memory Neural Networks.

Few‐Shot Contrastive Learning‐Based Multi‐Round Dialogue Intent Classification Method

A Two-stage User Intent Detection Model on Complicated Utterances with Multi-task Learning

Multi-turn Intent Determination and Slot Filling with Neural Networks and Regular Expressions.

Improved Dynamic Memory Network for Dialogue Act Classification with Adversarial Training

Detecting Context Dependent Messages in a Conversational Environment.

HAIN: Multi-label Classification with Hierarchical Attention-based Interaction Network for Multi-turn Dialogue Texts