Abstract:Multi-intent spoken language understanding (SLU) has garnered growing attention due to its ability to handle multiple intent utterances, which closely mirrors practical scenarios. Unlike traditional SLU, each intent in multi-intent SLU corresponds to its designated scope for slots, which occurs in certain fragments within the utterance. As a result, establishing precise scope alignment to mitigate noise impact emerges as a key challenge in multi-intent SLU. More seriously, they lack alignment between the predictions of the two sub-tasks due to task-independent decoding, resulting in a limitation on the overall performance. To address these challenges, we propose a novel framework termed Aligner² for multi-intent SLU, which contains an Adjustive Cross-task Aligner (ACA) and a Forced Cross-task Aligner (FCA). ACA utilizes the information conveyed by joint label embeddings to accurately align the scope of intent and corresponding slots, before the interaction of the two subtasks. FCA introduces reinforcement learning, to enforce the alignment of the task-specific hidden states after the interaction, which is explicitly guided by the prediction. Extensive experiments on two public multi-intent SLU datasets demonstrate the superiority of our Aligner² over state-of-the-art methods. More encouragingly, the proposed method Aligner² can be easily integrated into existing multi-intent SLU frameworks, to further boost performance.

HIT-SCIR at MMNLU-22: Consistency Regularization for Multilingual Spoken Language Understanding.

ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding

End-to-End Cross-Lingual Spoken Language Understanding Model with Multilingual Pretraining.

I^2KD-SLU: an Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding

I$^2$KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding

DiffSLU: Knowledge Distillation Based Diffusion Model for Cross-Lingual Spoken Language Understanding

Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling Via Adjustive and Forced Cross-Task Alignment

A Joint and Domain-Adaptive Approach to Spoken Language Understanding

Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Training

Large Language Models for Expansion of Spoken Language Understanding Systems to New Languages

FC-MTLF: A Fine- and Coarse-grained Multi-Task Learning Framework for Cross-Lingual Spoken Language Understanding.

Towards Multi-Intent Spoken Language Understanding Via Hierarchical Attention and Optimal Transport

GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding

Towards ASR Robust Spoken Language Understanding Through In-Context Learning With Word Confusion Networks

Do Large Language Model Understand Multi-Intent Spoken Language ?

WHISMA: A Speech-LLM to Perform Zero-shot Spoken Language Understanding

The Massively Multilingual Natural Language Understanding 2022 (MMNLU-22) Workshop and Competition

Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding

UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions