Abstract:Our book "The Reality of Multi-Lingual Machine Translation" discusses the benefits and perils of using more than two languages in machine translation systems. While focused on the particular task of sequence-to-sequence processing and multi-task learning, the book targets somewhat beyond the area of natural language processing. Machine translation is for us a prime example of deep learning applications where human skills and learning capabilities are taken as a benchmark that many try to match and surpass. We document that some of the gains observed in multi-lingual translation may result from simpler effects than the assumed cross-lingual transfer of knowledge. In the first, rather general part, the book will lead you through the motivation for multi-linguality, the versatility of deep neural networks especially in sequence-to-sequence tasks to complications of this learning. We conclude the general part with warnings against too optimistic and unjustified explanations of the gains that neural networks demonstrate. In the second part, we fully delve into multi-lingual models, with a particularly careful examination of transfer learning as one of the more straightforward approaches utilizing additional languages. The recent multi-lingual techniques, including massive models, are surveyed and practical aspects of deploying systems for many languages are discussed. The conclusion highlights the open problem of machine understanding and reminds of two ethical aspects of building large-scale models: the inclusivity of research and its ecological trace.

Multi-Task Neural Models for Translating Between Styles Within and Across Languages

Multi-Task Learning for Multiple Language Translation.

Formality Style Transfer with Shared Latent Space

Formality Style Transfer with Hybrid Textual Annotations

Neural Task Representations as Weak Supervision for Model Agnostic Cross-Lingual Transfer

A Multi-task Multi-stage Transitional Training Framework for Neural Chat Translation

Unified Model Learning for Various Neural Machine Translation

The Reality of Multi-Lingual Machine Translation

Improving the quality of neural TTS using long-form content and multi-speaker multi-style modeling

Style Transfer with Multi-iteration Preference Optimization

Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer.

Adaptive multi-task learning for speech to text translation

ST$^2$: Small-data Text Style Transfer via Multi-task Meta-Learning

Style Transfer as Unsupervised Machine Translation

Adaptive Scheduling for Multi-Task Learning

Multi-Style Transfer with Discriminative Feedback on Disjoint Corpus

Multi-agent Learning for Neural Machine Translation

Modeling Bilingual Conversational Characteristics for Neural Chat Translation

Multi-task Learning-based Data Augmentation for Minority Languages to Chinese Neural Machine Translation

Multi-Task Learning in Natural Language Processing: An Overview

Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination