Abstract:Natural language understanding (NLU) is the task of semantic decoding of human languages by machines. NLU models rely heavily on large training data to ensure good performance. However, substantial languages and domains have very few data resources and domain experts. It is necessary to overcome the data scarcity challenge, when very few or even zero training samples are available. In this thesis, we focus on developing cross-lingual and cross-domain methods to tackle the low-resource issues. First, we propose to improve the model's cross-lingual ability by focusing on the task-related keywords, enhancing the model's robustness and regularizing the representations. We find that the representations for low-resource languages can be easily and greatly improved by focusing on just the keywords. Second, we present Order-Reduced Modeling methods for the cross-lingual adaptation, and find that modeling partial word orders instead of the whole sequence can improve the robustness of the model against word order differences between languages and task knowledge transfer to low-resource languages. Third, we propose to leverage different levels of domain-related corpora and additional masking of data in the pre-training for the cross-domain adaptation, and discover that more challenging pre-training can better address the domain discrepancy issue in the task knowledge transfer. Finally, we introduce a coarse-to-fine framework, Coach, and a cross-lingual and cross-domain parsing framework, X2Parser. Coach decomposes the representation learning process into a coarse-grained and a fine-grained feature learning, and X2Parser simplifies the hierarchical task structures into flattened ones. We observe that simplifying task structures makes the representation learning more effective for low-resource languages and domains.

Transfer Learning Methods for Spoken Language Understanding

Source-Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language

End-to-End Cross-Lingual Spoken Language Understanding Model with Multilingual Pretraining.

Transfer Learning for Speech and Language Processing

Almost Unsupervised Text to Speech and Automatic Speech Recognition

Research on Named Entity Recognition for Spoken Language Understanding Using Adversarial Transfer Learning

Multi-Classification Model for Spoken Language Understanding

Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models.

Effective Transfer Learning for Low-Resource Natural Language Understanding

Speech Emotion Recognition Based on Meta-Transfer Learning with Domain Adaption

Listening to the World Improves Speech Command Recognition

ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding

Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents

FC-MTLF: A Fine- and Coarse-grained Multi-Task Learning Framework for Cross-Lingual Spoken Language Understanding.

Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target

CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations

End-to-end spoken language understanding using joint CTC loss and self-supervised, pretrained acoustic encoders

A Joint and Domain-Adaptive Approach to Spoken Language Understanding

Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

Cantonese Automatic Speech Recognition Using Transfer Learning from Mandarin

MCLF: A Multi-grained Contrastive Learning Framework for ASR-robust Spoken Language Understanding