Abstract:Recent graph-based models for multi-intent SLU have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the unidirectional guidance from intent to slot, while there are bidirectional inter-correlations between intent and slot; (2) adopt homogeneous graphs to model the interactions between the slot semantics nodes and intent label nodes, which limit the performance. In this paper, we propose a novel model termed Co-guiding Net, which implements a two-stage framework achieving the mutual guidances between the two tasks. In the first stage, the initial estimated labels of both tasks are produced, and then they are leveraged in the second stage to model the mutual guidances. Specifically, we propose two heterogeneous graph attention networks working on the proposed two heterogeneous semantics label graphs, which effectively represent the relations among the semantics nodes and label nodes. Besides, we further propose Co-guiding-SCL Net, which exploits the single-task and dual-task semantics contrastive relations. For the first stage, we propose single-task supervised contrastive learning, and for the second stage, we propose co-guiding supervised contrastive learning, which considers the two tasks' mutual guidances in the contrastive learning procedure. Experiment results on multi-intent SLU show that our model outperforms existing models by a large margin, obtaining a relative improvement of 21.3% over the previous best model on MixATIS dataset in overall accuracy. We also evaluate our model on the zero-shot cross-lingual scenario and the results show that our model can relatively improve the state-of-the-art model by 33.5% on average in terms of overall accuracy for the total 9 languages.

SaLa: Scenario-aware Label Graph Interaction for Multi-intent Spoken Language Understanding

Dance with Labels: Dual-Heterogeneous Label Graph Interaction for Multi-intent Spoken Language Understanding.

Towards Unified Spoken Language Understanding Decoding via Label-aware Compact Linguistics Representations

A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

Towards Multi-Intent Spoken Language Understanding Via Hierarchical Attention and Optimal Transport

A Dynamic Graph Interactive Framework with Label-Semantic Injection for Spoken Language Understanding

Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling Via Adjustive and Forced Cross-Task Alignment

A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applications

Capture Salient Historical Information: A Fast and Accurate Non-autoregressive Model for Multi-turn Spoken Language Understanding

A Scope Sensitive and Result Attentive Model for Multi-Intent Spoken Language Understanding.

TD-GIN: Token-level Dynamic Graph-Interactive Network for Joint Multiple Intent Detection and Slot Filling.

Co-guiding for Multi-intent Spoken Language Understanding

A BiRGAT Model for Multi-intent Spoken Language Understanding with Hierarchical Semantic Frames

A Unified Framework for Multi-intent Spoken Language Understanding with prompting

LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations

SPM: A Split-Parsing Method for Joint Multi-Intent Detection and Slot Filling.

A Model with Length-Variable Attention for Spoken Language Understanding

Semi-Supervised Semantic Role Labeling with Bidirectional Language Models

Joint Spoken Language Understanding And Domain Adaptive Language Modeling

AGIF: an Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Filling