Abstract:Objective: Today's neural machine translation (NMT) can achieve near human-level translation quality and greatly facilitates international communications, but the lack of parallel corpora poses a key problem to the development of translation systems for highly specialized domains, such as biomedicine. This work presents an unsupervised algorithm for deriving parallel corpora from document-level translations by using sentence alignment and explores how training materials affect the performance of biomedical NMT systems. Materials and Methods: Document-level translations are mixed to train bilingual word embeddings (BWEs) for the evaluation of cross-lingual word similarity, and sentence distance is defined by combining semantic and positional similarities of the sentences. The alignment of sentences is formulated as an extended earth mover's distance problem. A Chinese-English biomedical parallel corpus is derived with the proposed algorithm using bilingual articles from UpToDate and translations of PubMed abstracts, which is then used for the training and evaluation of NMT. Results: On two manually aligned translation datasets, the proposed algorithm achieved accurate sentence alignment in the 1-to-1 cases and outperformed competing algorithms in the many-to-many cases. The NMT model fine-tuned on biomedical data significantly improved the in-domain translation quality (zh-en: +17.72 BLEU; en-zh: +17.02 BLEU). Both the size of the training data and the combination of different corpora can significantly affect the model's performance. Conclusion: The proposed algorithm relaxes the assumption for sentence alignment and effectively generates accurate translation pairs that facilitate training high quality biomedical NMT models.

Agreement-based Learning of Parallel Lexicons and Phrases from Non-Parallel Corpora

Iterative Learning of Parallel Lexicons and Phrases from Non-Parallel Corpora

Iterative Task-adaptive Pretraining for Unsupervised Word Alignment

Generalized Agreement for Bidirectional Word Alignment.

Agreement-based Joint Training for Bidirectional Attention-based Neural Machine Translation.

Bilingual lexicon induction from non-parallel corpora

Word Alignment by Fine-tuning Embeddings on Parallel Corpora

Extracting parallel phrases from comparable corpora

Incorporating Phrase-Level Agreement into Neural Machine Translation.

Translation-Based Automatic Alignment of English and Chinese Parallel Corpora

Multilingual Agreement for Multilingual Neural Machine Translation

Jointly Learning Bilingual Word Embeddings and Alignments

Machine Translation Model based on Non-parallel Corpus and Semi-supervised Transductive Learning

Research of English-Chinese Alignment at Word Granularity on Parallel Corpora

Term translation pair alignment based on a parallel corpus of Chinese historical classics and their english translations

Sentence Alignment with Parallel Documents Facilitates Biomedical Machine Translation

Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment

Co-Training Based Bilingual Sentiment Lexicon Learning.

Phrase-Based Chinese-Vietnamese Pseudo-Parallel Sentence Pair Generation

A Research on Bilingual Dictionary Based Sentence Alignment for Chinese English Parallel Corpus

Unsupervised Bilingual Lexicon Induction Via Latent Variable Models.