Abstract:Objective: Today's neural machine translation (NMT) can achieve near human-level translation quality and greatly facilitates international communications, but the lack of parallel corpora poses a key problem to the development of translation systems for highly specialized domains, such as biomedicine. This work presents an unsupervised algorithm for deriving parallel corpora from document-level translations by using sentence alignment and explores how training materials affect the performance of biomedical NMT systems. Materials and Methods: Document-level translations are mixed to train bilingual word embeddings (BWEs) for the evaluation of cross-lingual word similarity, and sentence distance is defined by combining semantic and positional similarities of the sentences. The alignment of sentences is formulated as an extended earth mover's distance problem. A Chinese-English biomedical parallel corpus is derived with the proposed algorithm using bilingual articles from UpToDate and translations of PubMed abstracts, which is then used for the training and evaluation of NMT. Results: On two manually aligned translation datasets, the proposed algorithm achieved accurate sentence alignment in the 1-to-1 cases and outperformed competing algorithms in the many-to-many cases. The NMT model fine-tuned on biomedical data significantly improved the in-domain translation quality (zh-en: +17.72 BLEU; en-zh: +17.02 BLEU). Both the size of the training data and the combination of different corpora can significantly affect the model's performance. Conclusion: The proposed algorithm relaxes the assumption for sentence alignment and effectively generates accurate translation pairs that facilitate training high quality biomedical NMT models.

Inflating a Small Parallel Corpus into a Large Quasi-parallel Corpus Using Monolingual Data for Chinese-Japanese Machine Translation.

Improved Chinese-Japanese phrase-based MT quality using an extended quasi-parallel corpus

Inflating a Training Corpus for SMT by Using Unrelated Unaligned Monolingual Data.

Train the Machine with What It Can Learn

Construction Method of Parallel Corpus for Minority Language Machine Translation

Corpus Augmentation by Sentence Segmentation for Low-Resource Neural Machine Translation

UM-Corpus: A Large English-Chinese Parallel Corpus for Statistical Machine Translation

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

Refining parallel quality for machine translation

Chinese-Portuguese Machine Translation: A Study on Building Parallel Corpora from Comparable Texts

Towards Neural Machine Translation with Partially Aligned Corpora

Sentence Alignment with Parallel Documents Facilitates Biomedical Machine Translation

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Web-based parallel corpora for statistical machine translation

ParaZh-22M: A Large-Scale Chinese Parabank via Machine Translation.

Constructing of a large-scale Chinese-English parallel corpus

"A Little is Enough": Few-Shot Quality Estimation based Corpus Filtering improves Machine Translation

Pseudotext Injection and Advance Filtering of Low-Resource Corpus for Neural Machine Translation.

Machine Translation Model based on Non-parallel Corpus and Semi-supervised Transductive Learning

Building a Large English-Chinese Parallel Corpus from Comparable Patents and Its Experimental Application to SMT

Building an Annotated Japanese-Chinese Parallel Corpus - A Part of NICT Multilingual Corpora.