Abstract:Morphologically rich languages pose difficulties to machine translation. Machine translation engines that rely on statistical learning from parallel training data, such as state-of-the-art neural systems, face challenges especially with rich morphology on the output language side. Key challenges of rich target-side morphology in data-driven machine translation include: (1) A large amount of differently inflected word surface forms entails a larger vocabulary and thus data sparsity. (2) Some inflected forms of infrequent terms typically do not appear in the training corpus, which makes closed-vocabulary systems unable to generate these unobserved variants. (3) Linguistic agreement requires the system to correctly match the grammatical categories between inflected word forms in the output sentence, both in terms of target-side morpho-syntactic wellformedness and semantic adequacy with respect to the input. In this paper, we re-investigate two target-side linguistic processing techniques: a lemma-tag strategy and a linguistically informed word segmentation strategy. Our experiments are conducted on a English-German translation task under three training corpus conditions of different magnitudes. We find that a stronger Transformer baseline leaves less room for improvement than a shallow-RNN encoder-decoder model when translating in-domain. However, we find that linguistic modeling of target-side morphology does benefit the Transformer model when the same system is applied to out-of-domain input text. We also successfully apply our approach to English to Czech translation.

Cognate-aware morphological segmentation for multilingual neural translation

TAMS: Translation-Assisted Morphological Segmentation

Morphological and Language-Agnostic Word Segmentation for NMT

Morphological Word Segmentation on Agglutinative Languages for Neural Machine Translation

The University of Helsinki submissions to the WMT19 news translation task

NICT's Neural and Statistical Machine Translation Systems for the WMT18 News Translation Task

LIUM-CVC Submissions for WMT18 Multimodal Translation Task

The University of Sydney's Machine Translation System for WMT19

Transfer learning and subword sampling for asymmetric-resource one-to-many neural translation

Tencent AI Lab - Shanghai Jiao Tong University Low-Resource Translation System for the WMT22 Translation Task

Character-Aware Decoder for Translation into Morphologically Rich Languages

The Effectiveness of Morphology-aware Segmentation in Low-Resource Neural Machine Translation

Teaching Unseen Low-resource Languages to Large Translation Models

Evaluating Neural Network Models for Word Segmentation in Agglutinative Languages: Comparison With Rule-Based Approaches and Statistical Models

The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

LIUM Machine Translation Systems for WMT17 News Translation Task

JUMT at WMT2019 News Translation Task: A Hybrid approach to Machine Translation for Lithuanian to English

Modeling Target-Side Morphology in Neural Machine Translation: A Comparison of Strategies

Character-Level Neural Translation for Multilingual Media Monitoring in the SUMMA Project

The University of Edinburgh's Neural MT Systems for WMT17

Facebook AI WMT21 News Translation Task Submission