Abstract:Recently, data-driven task-oriented dialogue systems have achieved promising performance in English. However, developing dialogue systems that support low-resource languages remains a long-standing challenge due to the absence of high-quality data. In order to circumvent the expensive and time-consuming data collection, we introduce Attention-Informed Mixed-Language Training (MLT), a novel zero-shot adaptation method for cross-lingual task-oriented dialogue systems. It leverages very few task-related parallel word pairs to generate code-switching sentences for learning the inter-lingual semantics across languages. Instead of manually selecting the word pairs, we propose to extract source words based on the scores computed by the attention layer of a trained English task-related model and then generate word pairs using existing bilingual dictionaries. Furthermore, intensive experiments with different cross-lingual embeddings demonstrate the effectiveness of our approach. Finally, with very few word pairs, our model achieves significant zero-shot adaptation performance improvements in both cross-lingual dialogue state tracking and natural language understanding (i.e., intent detection and slot filling) tasks compared to the current state-of-the-art approaches, which utilize a much larger amount of bilingual data.

Inducing Bilingual Lexica from Non-Parallel Data with Earth Mover's Distance Regularization.

Earth Mover's Distance Minimization for Unsupervised Bilingual Lexicon Induction.

Building Earth Mover'S Distance on Bilingual Word Embeddings for Machine Translation

Bilingual Lexicon Induction from Non-Parallel Data with Minimal Supervision.

Bilingual lexicon induction from non-parallel corpora

Improving Bilingual Lexicon Induction on Distant Language Pairs

Unsupervised Bilingual Lexicon Induction Via Latent Variable Models.

Adversarial Training for Unsupervised Bilingual Lexicon Induction

How Lexical is Bilingual Lexicon Induction?

Bilingual word embedding fusion for robust unsupervised bilingual lexicon induction

LexMatcher: Dictionary-centric Data Curation for LLM-based Machine Translation

Word Translation Without Parallel Data

Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport

LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

A Simple Regularization-based Algorithm for Learning Cross-Domain Word Embeddings

A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages

Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation

Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context

Sentence Alignment with Parallel Documents Helps Biomedical Machine Translation

Unsupervised Cross-Lingual Sentence Representation Learning via Linguistic Isomorphism

Attention-Informed Mixed-Language Training for Zero-Shot Cross-Lingual Task-Oriented Dialogue Systems