Abstract:Morphologically rich languages pose difficulties to machine translation. Machine translation engines that rely on statistical learning from parallel training data, such as state-of-the-art neural systems, face challenges especially with rich morphology on the output language side. Key challenges of rich target-side morphology in data-driven machine translation include: (1) A large amount of differently inflected word surface forms entails a larger vocabulary and thus data sparsity. (2) Some inflected forms of infrequent terms typically do not appear in the training corpus, which makes closed-vocabulary systems unable to generate these unobserved variants. (3) Linguistic agreement requires the system to correctly match the grammatical categories between inflected word forms in the output sentence, both in terms of target-side morpho-syntactic wellformedness and semantic adequacy with respect to the input. In this paper, we re-investigate two target-side linguistic processing techniques: a lemma-tag strategy and a linguistically informed word segmentation strategy. Our experiments are conducted on a English-German translation task under three training corpus conditions of different magnitudes. We find that a stronger Transformer baseline leaves less room for improvement than a shallow-RNN encoder-decoder model when translating in-domain. However, we find that linguistic modeling of target-side morphology does benefit the Transformer model when the same system is applied to out-of-domain input text. We also successfully apply our approach to English to Czech translation.

Morphologically Aware Word-Level Translation

Compositional Morphology for Word Representations and Language Modelling

Morph-fitting: Fine-Tuning Word Vector Spaces with Simple Language-Specific Rules

A Latent Morphology Model for Open-Vocabulary Neural Machine Translation

Maam: A Morphology-Aware Alignment Model For Unsupervised Bilingual Lexicon Induction

End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages

Modeling Target-Side Inflection in Neural Machine Translation

Language Modeling for Morphologically Rich Languages: Character-Aware Modeling for Word-Level Prediction

Word Representation Models for Morphologically Rich Languages in Neural Machine Translation

Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations

Modeling Target-Side Morphology in Neural Machine Translation: A Comparison of Strategies

Morphological and Language-Agnostic Word Segmentation for NMT

Low-resource neural machine translation with morphological modeling

How Lexical is Bilingual Lexicon Induction?

Better Character Language Modeling Through Morphology

Improving Word Translation via Two-Stage Contrastive Learning

A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages

Explicit Morphological Knowledge Improves Pre-training of Language Models for Hebrew

Joint Semantic Synthesis and Morphological Analysis of the Derived Word

Morphological Inflection: A Reality Check

On Bilingual Lexicon Induction with Large Language Models