Abstract:Spoken language understanding (SLU) is the core of the speech-centric human-robot interaction system, which mainly involves intent detection and slot filling. The recent SLU research focuses on the joint modeling of the two tasks due to their correlation. Furthermore, the slot information consists of slot position and slot type. Although the slot types are semantically related to the intent, the slot positions of the same intent may vary a lot in different utterances due to the diversity of spoken language. Thus, the conventional one-stage slot filling task may introduce unrelated information for slot position prediction in the slot-intent interaction of the joint modeling. Therefore, we propose a novel two-stage selective fusion framework for joint intent detection and slot filling. Unlike the previous one-stage framework, the proposed framework decomposes the slot filling into two stages, i.e., the slot proposal and slot classification. The slot proposal network consisting of BERT and bidirectional long short-term memory (Bi-LSTM)-conditional random field (CRF) predicts the slot positions. Instead of the tokenwise fusion in the existing methods, the slot-intent feature fusion is only performed in the slot classification. A selective fusion mechanism is designed to facilitate the slot-intent interaction within each slot candidate for more accurate slot-type classification. Experiments on five standard benchmarks (i.e., ATIS, SNIPS, MixATIS, MixSNIPS, and DSTC4) show that the proposed framework achieves the best performance in comparison with several state-of-the-art methods.

Deep Multi-task Learning with Cross Connected Layer for Slot Filling.

Deep Cascade Multi-task Learning for Slot Filling in Chinese E-commerce Shopping Guide Assistant

Deep Cascade Multi-Task Learning for Slot Filling in Online Shopping Assistant

A Joint Multi-Task Learning Framework for Spoken Language Understanding

Hierarchical Tagger with Multi-task Learning for Cross-domain Slot Filling

Using Deep Time Delay Neural Network for Slot Filling in Spoken Language Understanding.

A Unified Approach to Nested and Non-Nested Slots for Spoken Language Understanding

Effective Slot Filling via Weakly-Supervised Dual-Model Learning

Improving Spoken Language Understanding with Cross-Modal Contrastive Learning

Cross-Domain Slot Filling As Machine Reading Comprehension

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

Improving Zero-shot Cross-domain Slot Filling Via Transformer-based Slot Semantics Fusion

Using Word Confusion Networks for Slot Filling in Spoken Language Understanding.

SEED: A Cross-Layer Semantic Enhanced SLU Model with Role Context Differentiated Fusion

A Two-Stage Selective Fusion Framework for Joint Intent Detection and Slot Filling

A CO-INTERACTIVE TRANSFORMER FOR JOINT SLOT FILLING AND INTENT DETECTION

FC-MTLF: A Fine- and Coarse-grained Multi-Task Learning Framework for Cross-Lingual Spoken Language Understanding.

Combining Word Feature Vector Method with the Convolutional Neural Network for Slot Filling in Spoken Language Understanding

Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling Via Adjustive and Forced Cross-Task Alignment

Jointly Modeling Intent Identification and Slot Filling with Contextual and Hierarchical Information.

Slot Transferability for Cross-domain Slot Filling.