Abstract:Purpose Intent detection (ID) and slot filling (SF) are two important tasks in natural language understanding. ID is to identify the main intent of a paragraph of text. The goal of SF is to extract the information that is important to the intent from the input sentence. However, most of the existing methods use sentence-level intention recognition, which has the risk of error propagation, and the relationship between intention recognition and SF is not explicitly modeled. Aiming at this problem, this paper proposes a collaborative model of ID and SF for intelligent spoken language understanding called ID-SF-Fusion. Design/methodology/approach ID-SF-Fusion uses Bidirectional Encoder Representation from Transformers (BERT) and Bidirectional Long Short-Term Memory (BiLSTM) to extract effective word embedding and context vectors containing the whole sentence information respectively. Fusion layer is used to provide intent–slot fusion information for SF task. In this way, the relationship between ID and SF task is fully explicitly modeled. This layer takes the result of ID and slot context vectors as input to obtain the fusion information which contains both ID result and slot information. Meanwhile, to further reduce error propagation, we use word-level ID for the ID-SF-Fusion model. Finally, two tasks of ID and SF are realized by joint optimization training. Findings We conducted experiments on two public datasets, Airline Travel Information Systems (ATIS) and Snips. The results show that the Intent ACC score and Slot F1 score of ID-SF-Fusion on ATIS and Snips are 98.0 per cent and 95.8 per cent, respectively, and the two indicators on Snips dataset are 98.6 per cent and 96.7 per cent, respectively. These models are superior to slot-gated, SF-ID NetWork, stack-Prop and other models. In addition, ablation experiments were performed to further analyze and discuss the proposed model. Originality/value This paper uses word-level intent recognition and introduces intent information into the SF process, which is a significant improvement on both data sets.

Using Convolutional Neural Network with BERT for Intent Determination.

BERT for Joint Intent Classification and Slot Filling

A Chinese Text Classification Method Based on BERT and Convolutional Neural Network

ID-SF-Fusion: a cooperative model of intent detection and slot filling for natural language understanding

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks

Chinese User Service Intention Classification Based on Hybrid Neural Network

Interactive Dual Attention Network for Text Sentiment Classification

Triple Channel Feature Fusion Few-Shot Intent Recognition With Orthogonality Constrained Multi-Head Attention

Multi-turn Intent Determination and Slot Filling with Neural Networks and Regular Expressions.

BERT-CNN: a Hierarchical Patent Classifier Based on a Pre-Trained Language Model

Prediction of Intentions Behind a Single Human Action: an Application of Convolutional Neural Network

A BERT-Based Hybrid Short Text Classification Model Incorporating CNN and Attention-Based BiGRU

CTRAN: CNN-Transformer-based Network for Natural Language Understanding

Effectiveness of Pre-training for Few-shot Intent Classification

Intention Inference for Space Targets Using Deep Convolutional Neural Network

Z-BERT-A: a zero-shot Pipeline for Unknown Intent detection

Multi-Task Deep Learning for User Intention Understanding in Speech Interaction Systems

The Automatic Text Classification Method Based on BERT and Feature Union

Hybrid Detection Method for Multi-Intent Recognition in Air–Ground Communication Text

MBCFNet: A Multimodal Brain–Computer Fusion Network for Human Intention Recognition