Abstract:Neural machine translation, which achieves near human-level performance in some languages, strongly relies on the large amounts of parallel sentences, which hinders its applicability to low-resource language pairs. Recent works explore the possibility of unsupervised machine translation with monolingual data only, leading to much lower accuracy compared with the supervised one. Observing that weakly paired bilingual documents are much easier to collect than bilingual sentences, e.g., from Wikipedia, news websites or books, in this paper, we investigate training translation models with weakly paired bilingual documents. Our approach contains two components. 1) We provide a simple approach to mine implicitly bilingual sentence pairs from document pairs which can then be used as supervised training signals. 2) We leverage the topic consistency of two weakly paired documents and learn the sentence translation model by constraining the word distribution-level alignments. We evaluate our method on weakly paired documents from Wikipedia on six tasks, the widely used WMT16 German$English, WMT13 Spanish$English and WMT16 Romanian$English translation tasks. We obtain 24:1/30:3, 28:1/27:6 and 30:1/27:6 BLEU points separately, outperforming previous results by more than 5 BLEU points in each direction and reducing the gap between unsupervised translation and supervised translation up to 50%

Word-to-word Machine Translation: Bilateral Similarity Retrieval for Mitigating Hubness

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translation

Embedding Word Similarity with Neural Machine Translation

Machine Translation With Weakly Paired Bilingual Documents

Adversarial Training for Unknown Word Problems in Neural Machine Translation

Short Text Semantic Matching Model Based on Bert and Adversarial Network.

Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation

Generative Adversarial Network with Multi-Branch Discriminator for Cross-Species Image-to-Image Translation

Building Earth Mover'S Distance on Bilingual Word Embeddings for Machine Translation

Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features

(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Texts

Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models

Dual-perspective fusion for word translation enhancement

WSD-GAN: Word Sense Disambiguation Using Generative Adversarial Networks.

Finding Better Subword Segmentation for Neural Machine Translation

Machine Translation with Weakly Paired Documents.

Integrating Weakly Supervised Word Sense Disambiguation into Neural Machine Translation

Two Way Adversarial Unsupervised Word Translation

N-Gram Nearest Neighbor Machine Translation

Word self-update contrastive adversarial networks for text-to-image synthesis