Abstract:Spoken Language Understanding (SLU) is a crucial component of task-oriented dialog systems. In recent years, there has been increasing attention on multi-intent SLU due to its relevance to complex real-world applications. Most existing joint models only utilize multi-intent information to guide the slot filling, with only a small number of models achieving bidirectional interaction. Additionally, unlike traditional single-intent SLU, multi-intent SLU is scope-dependent, where each intent in a sentence has its specific dependency range. However, current bidirectional joint models often employ a pipeline approach to implement interaction between the two sub-tasks, which fails to fully leverage the semantic information between them and can lead to error propagation. Moreover, attention-based multi-intent joint models do not adequately model the positional relationships between words, resulting in suboptimal overall performance. In this paper, we propose a novel multi-intent SLU model called Position-aware Interactive Attention Network (PIAN), which consists of interactive attention and rotary position embedding. The aim of PIAN is to fully exploit the correlation between the two sub-tasks and capturing the positional dependencies between words. This facilitates mutual guidance and enhancement between the two sub-tasks. Additionally, to address the issue of uncoordinated slot problem generated by traditional slot filling decoders, we employ an MCRF slot filling decoder to constrain the slot labels. We evaluate our model on two public multi-intent SLU datasets, and the experimental results demonstrate that our model achieves state-of-the-art performance on key metrics. Code for this paper is publicly available at https://github.com/puhahahahahaha/SLU_with_Co_PRoE.

Joint Training Model of Intent Detection and Slot Filling for Multi Granularity Implicit Guidance.

A Novel Bi-Directional Interrelated Model For Joint Intent Detection And Slot Filling

A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding

A Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding.

Semantically Guided Enhanced Fusion for Intent Detection and Slot Filling

Jointly Modeling Intent Identification and Slot Filling with Contextual and Hierarchical Information.

A Unified Approach to Nested and Non-Nested Slots for Spoken Language Understanding

Focus on Interaction: A Novel Dynamic Graph Model for Joint Multiple Intent Detection and Slot Filling

Intent-Slot Correlation Modeling for Joint Intent Prediction and Slot Filling

A Two-Stage Selective Fusion Framework for Joint Intent Detection and Slot Filling

TD-GIN: Token-level Dynamic Graph-Interactive Network for Joint Multiple Intent Detection and Slot Filling.

SPM: A Split-Parsing Method for Joint Multi-Intent Detection and Slot Filling.

GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling

A Joint Multi-Task Learning Framework for Spoken Language Understanding

Position-aware Interactive Attention Network for Multi-Intent Spoken Language Understanding

Towards Joint Intent Detection and Slot Filling via Higher-order Attention

Pre-Trained Joint Model for Intent Classification and Slot Filling with Semantic Feature Fusion

SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling

Dual Level Intent-Slot Interaction for Improved Multi-Intent Spoken Language Understanding

Multitask Learning with Knowledge Base for Joint Intent Detection and Slot Filling

Joint Intent Detection Model for Task-oriented Human-Computer Dialogue System Using Asynchronous Training