Abstract:Spoken Language Understanding (SLU) is a crucial component of task-oriented dialog systems. In recent years, there has been increasing attention on multi-intent SLU due to its relevance to complex real-world applications. Most existing joint models only utilize multi-intent information to guide the slot filling, with only a small number of models achieving bidirectional interaction. Additionally, unlike traditional single-intent SLU, multi-intent SLU is scope-dependent, where each intent in a sentence has its specific dependency range. However, current bidirectional joint models often employ a pipeline approach to implement interaction between the two sub-tasks, which fails to fully leverage the semantic information between them and can lead to error propagation. Moreover, attention-based multi-intent joint models do not adequately model the positional relationships between words, resulting in suboptimal overall performance. In this paper, we propose a novel multi-intent SLU model called Position-aware Interactive Attention Network (PIAN), which consists of interactive attention and rotary position embedding. The aim of PIAN is to fully exploit the correlation between the two sub-tasks and capturing the positional dependencies between words. This facilitates mutual guidance and enhancement between the two sub-tasks. Additionally, to address the issue of uncoordinated slot problem generated by traditional slot filling decoders, we employ an MCRF slot filling decoder to constrain the slot labels. We evaluate our model on two public multi-intent SLU datasets, and the experimental results demonstrate that our model achieves state-of-the-art performance on key metrics. Code for this paper is publicly available at https://github.com/puhahahahahaha/SLU_with_Co_PRoE.

Multi-Lingual Attention based Multi-Intent Detection in Dialogue System

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Multilingual and Cross-Lingual Intent Detection from Spoken Data

A Pointer Network-based Approach for Joint Extraction and Detection of Multi-Label Multi-Class Intents

MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue

Multi-Task Deep Learning for User Intention Understanding in Speech Interaction Systems

Real-time Caller Intent Detection In Human-Human Customer Support Spoken Conversations

Multi-domain Language Understanding of Task Oriented Dialogue Based on Intent Enhancement.

Acoustics Based Intent Recognition Using Discovered Phonetic Units for Low Resource Languages

A Framework to Generate High-Quality Datapoints for Multiple Novel Intent Detection

EmoInHindi: A Multi-label Emotion and Intensity Annotated Dataset in Hindi for Emotion Recognition in Dialogues

A Dual-Attention Hierarchical Recurrent Neural Network for Dialogue Act Classification

Position-aware Interactive Attention Network for Multi-Intent Spoken Language Understanding

An Intent Recognition Model Supporting the Spoken Expression Mixed with Chinese and English.

Multi-turn Intent Determination and Slot Filling with Neural Networks and Regular Expressions.

Attention-Informed Mixed-Language Training for Zero-Shot Cross-Lingual Task-Oriented Dialogue Systems

Intention Detection Based on Siamese Neural Network with Triplet Loss.

Multi-attention Recurrent Network for Human Communication Comprehension

Event Detection via Gated Multilingual Attention Mechanism.

InMu-Net: Advancing Multi-modal Intent Detection Via Information Bottleneck and Multi-sensory Processing

DialogueRNN: An Attentive RNN for Emotion Detection in Conversations