Abstract:Purpose Intent detection (ID) and slot filling (SF) are two important tasks in natural language understanding. ID is to identify the main intent of a paragraph of text. The goal of SF is to extract the information that is important to the intent from the input sentence. However, most of the existing methods use sentence-level intention recognition, which has the risk of error propagation, and the relationship between intention recognition and SF is not explicitly modeled. Aiming at this problem, this paper proposes a collaborative model of ID and SF for intelligent spoken language understanding called ID-SF-Fusion. Design/methodology/approach ID-SF-Fusion uses Bidirectional Encoder Representation from Transformers (BERT) and Bidirectional Long Short-Term Memory (BiLSTM) to extract effective word embedding and context vectors containing the whole sentence information respectively. Fusion layer is used to provide intent–slot fusion information for SF task. In this way, the relationship between ID and SF task is fully explicitly modeled. This layer takes the result of ID and slot context vectors as input to obtain the fusion information which contains both ID result and slot information. Meanwhile, to further reduce error propagation, we use word-level ID for the ID-SF-Fusion model. Finally, two tasks of ID and SF are realized by joint optimization training. Findings We conducted experiments on two public datasets, Airline Travel Information Systems (ATIS) and Snips. The results show that the Intent ACC score and Slot F1 score of ID-SF-Fusion on ATIS and Snips are 98.0 per cent and 95.8 per cent, respectively, and the two indicators on Snips dataset are 98.6 per cent and 96.7 per cent, respectively. These models are superior to slot-gated, SF-ID NetWork, stack-Prop and other models. In addition, ablation experiments were performed to further analyze and discuss the proposed model. Originality/value This paper uses word-level intent recognition and introduces intent information into the SF process, which is a significant improvement on both data sets.

POS Scaling Attention Model for Joint Slot Filling and Intent Classification

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Intent-Slot Correlation Modeling for Joint Intent Prediction and Slot Filling

Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics.

BERT for Joint Intent Classification and Slot Filling

Pre-Trained Joint Model for Intent Classification and Slot Filling with Semantic Feature Fusion

A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding

Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning

A Bi-model based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling

SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling

Joint modeling method of question intent detection and slot filling for domain-oriented question answering system

Understanding users’ requirements precisely: a double Bi-LSTM-CRF joint model for detecting user’s intentions and slot tags

EM analysis of phagosomes.

Natural language understanding approaches based on joint task of intent detection and slot filling for IoT voice interaction

Interactive POS-aware network for aspect-level sentiment classification

Intent Determination and Slot Filling inQuestion Answering

Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling Via Adjustive and Forced Cross-Task Alignment

ID-SF-Fusion: a cooperative model of intent detection and slot filling for natural language understanding

A Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding.

PAPER Special Technology Support Hyperconnectivity Conceptual Knowledge Enhanced Model for Multi-Intent Detection and Slot Filling

Towards Multi-Intent Spoken Language Understanding Via Hierarchical Attention and Optimal Transport