Abstract:Recent graph-based models for multi-intent SLU have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the unidirectional guidance from intent to slot, while there are bidirectional inter-correlations between intent and slot; (2) adopt homogeneous graphs to model the interactions between the slot semantics nodes and intent label nodes, which limit the performance. In this paper, we propose a novel model termed Co-guiding Net, which implements a two-stage framework achieving the mutual guidances between the two tasks. In the first stage, the initial estimated labels of both tasks are produced, and then they are leveraged in the second stage to model the mutual guidances. Specifically, we propose two heterogeneous graph attention networks working on the proposed two heterogeneous semantics label graphs, which effectively represent the relations among the semantics nodes and label nodes. Besides, we further propose Co-guiding-SCL Net, which exploits the single-task and dual-task semantics contrastive relations. For the first stage, we propose single-task supervised contrastive learning, and for the second stage, we propose co-guiding supervised contrastive learning, which considers the two tasks' mutual guidances in the contrastive learning procedure. Experiment results on multi-intent SLU show that our model outperforms existing models by a large margin, obtaining a relative improvement of 21.3% over the previous best model on MixATIS dataset in overall accuracy. We also evaluate our model on the zero-shot cross-lingual scenario and the results show that our model can relatively improve the state-of-the-art model by 33.5% on average in terms of overall accuracy for the total 9 languages.

SASGBC

A Joint and Domain-Adaptive Approach to Spoken Language Understanding

A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding

Incorporating Complete Syntactical Knowledge for Spoken Language Understanding

Using Bidirectional Transformer-CRF for Spoken Language Understanding.

On joint training with interfaces for spoken language understanding

Jointly Encoding Word Confusion Network and Dialogue Context with BERT for Spoken Language Understanding

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

A BiRGAT Model for Multi-intent Spoken Language Understanding with Hierarchical Semantic Frames

A Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding.

A Novel Slot-Gated Model Combined with a Key Verb Context Feature for Task Request Understanding by Service Robots

Towards Unified Spoken Language Understanding Decoding via Label-aware Compact Linguistics Representations

Multi-Classification Model for Spoken Language Understanding

BERT for Joint Intent Classification and Slot Filling

Co-guiding for Multi-intent Spoken Language Understanding

End-to-End Cross-Lingual Spoken Language Understanding Model with Multilingual Pretraining.

SaLa: Scenario-aware Label Graph Interaction for Multi-intent Spoken Language Understanding

Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction

Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling Via Adjustive and Forced Cross-Task Alignment

A Unified Framework for Multi-intent Spoken Language Understanding with prompting

Learning Dialogue History for Spoken Language Understanding.