Abstract:The data-hungry statistical machine translation (SMT) and neural machine translation (NMT) models offer state-of-the-art results for languages with abundant data resources. However, extensive research is imperative to make these models perform equally well for low-resource languages. This paper proposes a novel approach to integrate the best features of the NMT and SMT systems for improved translation performance of low-resource English-Tamil language pair. The suboptimal NMT model trained with the small parallel corpus translates the monolingual corpus and selects only the best translations, to retrain itself in the next iteration. The proposed method employs the SMT phrase-pair table to determine the best translations, based on the maximum match between the words of the phrase-pair dictionary and each of the individual translations. This repeating cycle of translation and retraining generates a large quasi-parallel corpus, thus making the NMT model more powerful. SMT-integrated incremental training demonstrates a substantial difference in translation performance as compared to the existing approaches for incremental training. The model is strengthened further by adopting a beam search decoding strategy to produce k best possible translations for each input sentence. Empirical findings prove that the proposed model with BLEU scores of 19.56 and 23.49 outperforms the baseline NMT with scores 11.06 and 17.06 for Eng-to-Tam and Tam-to-Eng translations, respectively. METEOR score evaluation further corroborates these results, proving the supremacy of the proposed model.

Transductive Minimum Error Rate Training for Statistical Machine Translation.

Coordinate System Selection for Minimum Error Rate Training in Statistical Machine Translation

Language Model Weight Adaptation Based on Cross-entropy for Statistical Machine Translation

BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training

Adaptive development data selection for log-linear model in statistical machine translation

Maximum Rank Correlation Training for Statistical Machine Translation.

A simple discriminative training method for machine translation with large-scale features

RMBR: A Regularized Minimum Bayes Risk Reranking Framework for Machine Translation

Addressing Exposure Bias With Document Minimum Risk Training: Cambridge at the WMT20 Biomedical Translation Task

Chasing COMET: Leveraging Minimum Bayes Risk Decoding for Self-Improving Machine Translation

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Minimum Error Rate Training for Bilingual News Alignment.

Bayesian Optimisation for Machine Translation

Effective Hypotheses Re-ranking Model in Statistical Machine Translation

Optimizing Non-Decomposable Evaluation Metrics for Neural Machine Translation

Minimum Bayes Risk Training of RNN-Transducer for End-to-End Speech Recognition

Discriminative Training of 150 Million Translation Parameters and Its Application to Pruning.

Model Adaptation for HMM-Based Speech Synthesis under Minimum Generation Error Criterion

Minimum word error training for non-autoregressive Transformer-based code-switching ASR

Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task

Efficient incremental training using a novel NMT-SMT hybrid framework for translation of low-resource languages