Abstract:Lecture transcript translation helps learners understand online courses, however, building a high-quality lecture machine translation system lacks publicly available parallel corpora. To address this, we examine a framework for parallel corpus mining, which provides a quick and effective way to mine a parallel corpus from publicly available lectures on Coursera. To create the parallel corpora, we propose a dynamic programming based sentence alignment algorithm which leverages the cosine similarity of machine-translated sentences. The sentence alignment F1 score reaches 96%, which is higher than using the BERTScore, LASER, or sentBERT methods. For both English--Japanese and English--Chinese lecture translations, we extracted parallel corpora of approximately 50,000 lines and created development and test sets through manual filtering for benchmarking translation performance. Through machine translation experiments, we show that the mined corpora enhance the quality of lecture transcript translation when used in conjunction with out-of-domain parallel corpora via multistage fine-tuning. Furthermore, this study also suggests guidelines for gathering and cleaning corpora, mining parallel sentences, cleaning noise in the mined data, and creating high-quality evaluation splits. For the sake of reproducibility, we have released the corpora as well as the code to create them. The dataset is available at <a class="link-external link-https" href="https://github.com/shyyhs/CourseraParallelCorpusMining" rel="external noopener nofollow">this https URL</a>.

A Corpus Level MIRA Tuning Strategy for Machine Translation.

A simple discriminative training method for machine translation with large-scale features

MIMIR: A Streamlined Platform for Personalized Agent Tuning in Domain Expertise

Enhancing Model Performance in Multilingual Information Retrieval with Comprehensive Data Engineering Techniques

Verdi: Quality Estimation and Error Detection for Bilingual Corpora

Maximum Rank Correlation Training for Statistical Machine Translation.

Optimizing Non-Decomposable Evaluation Metrics for Neural Machine Translation

Using RBMT Systems to Produce Bilingual Corpus for SMT

Effective Hypotheses Re-ranking Model in Statistical Machine Translation

Bilingual Corpus Mining and Multistage Fine-Tuning for Improving Machine Translation of Lecture Transcripts

Efficient Machine Translation Corpus Generation

UMIE: Unified Multimodal Information Extraction with Instruction Tuning

Improving Non-autoregressive Machine Translation with Error Exposure and Consistency Regularization

Instruction-Tuned LLMs Succeed in Document-Level MT Without Fine-Tuning -- But BLEU Turns a Blind Eye

Transductive Minimum Error Rate Training for Statistical Machine Translation.

The MSRA Machine Translation System for IWSLT 2010.

Automated Testing for Machine Translation Via Constituency Invariance

Bridging the Domain Gap: Improve Informal Language Translation Via Counterfactual Domain Adaptation

Benchmarking Machine Translation with Cultural Awareness

BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training

A Comparison of Approaches to Document-level Machine Translation