Abstract:Spoken Language Understanding (SLU) is a crucial component of task-oriented dialog systems. In recent years, there has been increasing attention on multi-intent SLU due to its relevance to complex real-world applications. Most existing joint models only utilize multi-intent information to guide the slot filling, with only a small number of models achieving bidirectional interaction. Additionally, unlike traditional single-intent SLU, multi-intent SLU is scope-dependent, where each intent in a sentence has its specific dependency range. However, current bidirectional joint models often employ a pipeline approach to implement interaction between the two sub-tasks, which fails to fully leverage the semantic information between them and can lead to error propagation. Moreover, attention-based multi-intent joint models do not adequately model the positional relationships between words, resulting in suboptimal overall performance. In this paper, we propose a novel multi-intent SLU model called Position-aware Interactive Attention Network (PIAN), which consists of interactive attention and rotary position embedding. The aim of PIAN is to fully exploit the correlation between the two sub-tasks and capturing the positional dependencies between words. This facilitates mutual guidance and enhancement between the two sub-tasks. Additionally, to address the issue of uncoordinated slot problem generated by traditional slot filling decoders, we employ an MCRF slot filling decoder to constrain the slot labels. We evaluate our model on two public multi-intent SLU datasets, and the experimental results demonstrate that our model achieves state-of-the-art performance on key metrics. Code for this paper is publicly available at https://github.com/puhahahahahaha/SLU_with_Co_PRoE.

Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling Via Adjustive and Forced Cross-Task Alignment

A Two-Stage Selective Fusion Framework for Joint Intent Detection and Slot Filling

Position-aware Interactive Attention Network for Multi-Intent Spoken Language Understanding

Towards Joint Intent Detection and Slot Filling via Higher-order Attention

A Joint Multi-Task Learning Framework for Spoken Language Understanding

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

Towards Multi-Intent Spoken Language Understanding Via Hierarchical Attention and Optimal Transport

Cross-Modal Semantic Alignment before Fusion for Two-Pass End-to-End Spoken Language Understanding

Dual Level Intent-Slot Interaction for Improved Multi-Intent Spoken Language Understanding

A Unified Approach to Nested and Non-Nested Slots for Spoken Language Understanding

A Model with Length-Variable Attention for Spoken Language Understanding

Towards Unified Spoken Language Understanding Decoding via Label-aware Compact Linguistics Representations

A Novel Bi-Directional Interrelated Model For Joint Intent Detection And Slot Filling

Semantically Guided Enhanced Fusion for Intent Detection and Slot Filling

A Unified Framework for Multi-intent Spoken Language Understanding with prompting

CLID: A Chunk-Level Intent Detection Framework for Multiple Intent Spoken Language Understanding.

A CO-INTERACTIVE TRANSFORMER FOR JOINT SLOT FILLING AND INTENT DETECTION

MRRL: Modifying the Reference Via Reinforcement Learning for Non-Autoregressive Joint Multiple Intent Detection and Slot Filling

SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling

Joint Training Model of Intent Detection and Slot Filling for Multi Granularity Implicit Guidance.

Code-Switching Can be Better Aligners: Advancing Cross-Lingual SLU through Representation-Level and Prediction-Level Alignment