Abstract:Spoken Language Understanding (SLU) aims to extract structured information from speech recognized texts, which suffers from inaccurate automatic speech recognition (ASR) (especially in a specific dialogue domain). Language Modeling (LM) is significant to ASR for producing natural sentences. To improve the SLU performance in a specific domain, we try two ways: (1) domain adaptive language modeling which tends to recognize in-domain utterances; (2) joint modeling of SLU and LM which distills semantic information to build semantic-aware LM, and also helps SLU by semi-supervised learning (LM is unsupervised). To unify these two approaches, we propose a multi-task model (MTM) that jointly performs two SLU tasks (slot filling and intent detection), domain-specific LM and domain-free (general) LM. In the proposed multi-task architecture, the shared-private network is utilized to automatically learn which part of general data can be shared by the specific domain or not. We attempt to further improve the SLU and ASR performance in a specific domain with a few of labeled data in the specific domain and plenty of unlabeled data in general domain. The experiments show that the proposed MTM can obtain 4.06% absolute WER (Word Error Rate) reduction in a car navigation domain, compared to a general-domain LM. For language understanding, the MTM outperforms the baseline (especially slot filling task) on the manual transcript, ASR 1-best output. By exploiting the domain-adaptive LM to rescore ASR output, our proposed model achieves further improvement in SLU (7.08% absolute F1 increase of slot filling task).

An Explicit-Memory Few-Shot Joint Learning Model.

An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling

A Joint Learning Framework with BERT for Spoken Language Understanding.

Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling.

A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding

A Novel Bi-Directional Interrelated Model For Joint Intent Detection And Slot Filling

Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks.

A Joint Multi-Task Learning Framework for Spoken Language Understanding

FewJoint: few-shot learning for joint dialogue understanding

Joint Training Model of Intent Detection and Slot Filling for Multi Granularity Implicit Guidance.

A Model with Length-Variable Attention for Spoken Language Understanding

Pre-Trained Joint Model for Intent Classification and Slot Filling with Semantic Feature Fusion

Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History

A Unified Approach to Nested and Non-Nested Slots for Spoken Language Understanding

A Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding.

A Two-Stage Selective Fusion Framework for Joint Intent Detection and Slot Filling

Joint Spoken Language Understanding And Domain Adaptive Language Modeling

FewJoint: A Few-shot Learning Benchmark for Joint Language Understanding

A Joint Model Based on CNN-LSTMs in Dialogue Understanding

ESIE-BERT: Enriching Sub-words Information Explicitly with BERT for Joint Intent Classification and SlotFilling

Joint Intent Detection Model for Task-oriented Human-Computer Dialogue System Using Asynchronous Training