Abstract:Spoken Language Understanding (SLU) is a crucial component of task-oriented dialog systems. In recent years, there has been increasing attention on multi-intent SLU due to its relevance to complex real-world applications. Most existing joint models only utilize multi-intent information to guide the slot filling, with only a small number of models achieving bidirectional interaction. Additionally, unlike traditional single-intent SLU, multi-intent SLU is scope-dependent, where each intent in a sentence has its specific dependency range. However, current bidirectional joint models often employ a pipeline approach to implement interaction between the two sub-tasks, which fails to fully leverage the semantic information between them and can lead to error propagation. Moreover, attention-based multi-intent joint models do not adequately model the positional relationships between words, resulting in suboptimal overall performance. In this paper, we propose a novel multi-intent SLU model called Position-aware Interactive Attention Network (PIAN), which consists of interactive attention and rotary position embedding. The aim of PIAN is to fully exploit the correlation between the two sub-tasks and capturing the positional dependencies between words. This facilitates mutual guidance and enhancement between the two sub-tasks. Additionally, to address the issue of uncoordinated slot problem generated by traditional slot filling decoders, we employ an MCRF slot filling decoder to constrain the slot labels. We evaluate our model on two public multi-intent SLU datasets, and the experimental results demonstrate that our model achieves state-of-the-art performance on key metrics. Code for this paper is publicly available at https://github.com/puhahahahahaha/SLU_with_Co_PRoE.

A Typed Iteration Approach for Spoken Language Understanding

A Joint and Domain-Adaptive Approach to Spoken Language Understanding

A Novel Bi-Directional Interrelated Model For Joint Intent Detection And Slot Filling

On joint training with interfaces for spoken language understanding

A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding

A Joint Multi-Task Learning Framework for Spoken Language Understanding

A Model with Length-Variable Attention for Spoken Language Understanding

A Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding.

A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understanding

A Unified Approach to Nested and Non-Nested Slots for Spoken Language Understanding

A Spoken Language Understanding Approach Using Successive Learners

Position-aware Interactive Attention Network for Multi-Intent Spoken Language Understanding

Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understanding

A Streaming End-to-End Framework for Spoken Language Understanding.

Effectiveness of Text, Acoustic, and Lattice-based representations in Spoken Language Understanding tasks

Joint Spoken Language Understanding And Domain Adaptive Language Modeling

A Mixed Approach to Spoken Language Understanding

Joint Training Model of Intent Detection and Slot Filling for Multi Granularity Implicit Guidance.

Using Bidirectional Transformer-CRF for Spoken Language Understanding.

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

An Adversarial Learning based Multi-Step Spoken Language Understanding System through Human-Computer Interaction