Abstract:Objective: Today's neural machine translation (NMT) can achieve near human-level translation quality and greatly facilitates international communications, but the lack of parallel corpora poses a key problem to the development of translation systems for highly specialized domains, such as biomedicine. This work presents an unsupervised algorithm for deriving parallel corpora from document-level translations by using sentence alignment and explores how training materials affect the performance of biomedical NMT systems. Materials and Methods: Document-level translations are mixed to train bilingual word embeddings (BWEs) for the evaluation of cross-lingual word similarity, and sentence distance is defined by combining semantic and positional similarities of the sentences. The alignment of sentences is formulated as an extended earth mover's distance problem. A Chinese-English biomedical parallel corpus is derived with the proposed algorithm using bilingual articles from UpToDate and translations of PubMed abstracts, which is then used for the training and evaluation of NMT. Results: On two manually aligned translation datasets, the proposed algorithm achieved accurate sentence alignment in the 1-to-1 cases and outperformed competing algorithms in the many-to-many cases. The NMT model fine-tuned on biomedical data significantly improved the in-domain translation quality (zh-en: +17.72 BLEU; en-zh: +17.02 BLEU). Both the size of the training data and the combination of different corpora can significantly affect the model's performance. Conclusion: The proposed algorithm relaxes the assumption for sentence alignment and effectively generates accurate translation pairs that facilitate training high quality biomedical NMT models.

Probabilistic neural network based english-arabic sentence alignment

Sentence alignment using feed forward neural network

A Sentence Meaning Based Alignment Method for Parallel Text Corpora Preparation

Sentence Alignment with Parallel Documents Helps Biomedical Machine Translation

Towards Neural Machine Translation with Partially Aligned Corpora

Sentence Alignment for Ancient and Modern Chinese Parallel Corpus

Word Alignment Modeling with Context Dependent Deep Neural Network.

Neural Baselines for Word Alignment

Improving Neural Machine Translation by Achieving Knowledge Transfer with Sentence Alignment Learning

Neural Machine Translation by Jointly Learning to Align and Translate

Word Alignment by Fine-tuning Embeddings on Parallel Corpora

AligNART: Non-autoregressive Neural Machine Translation by Jointly Learning to Estimate Alignment and Translate

Sentence Alignment with Parallel Documents Facilitates Biomedical Machine Translation

Noisy Parallel Data Alignment

Inter-Weighted Alignment Network for Sentence Pair Modeling.

Adaptative Bilingual Aligning Using Multilingual Sentence Embedding

On The Alignment Problem In Multi-Head Attention-Based Neural Machine Translation

A Supervised Word Alignment Method based on Cross-Language Span Prediction using Multilingual BERT

Performance Improvements of Probabilistic Transcript-adapted ASR with Recurrent Neural Network and Language-specific Constraints

A Neural Probabilistic Structured-Prediction Method for Transition-Based Natural Language Processing.

Leveraging Closed-Access Multilingual Embedding for Automatic Sentence Alignment in Low Resource Languages