Abstract:In this article we address the issue of generating diversified translation systems from a single Statistical Machine Translation (SMT) engine for system combination. Unlike traditional approaches, we do not resort to multiple structurally different SMT systems, but instead directly learn a strong SMT system from a single translation engine in a principled way. Our approach is based on Bagging and Boosting which are two instances of the general framework of ensemble learning. The basic idea is that we first generate an ensemble of weak translation systems using a base learning algorithm, and then learn a strong translation system from the ensemble. One of the advantages of our approach is that it can work with any of current SMT systems and make them stronger almost “for free”. Beyond this, most system combination methods are directly applicable to the proposed framework for generating the final translation system from the ensemble of weak systems. We evaluate our approach on Chinese–English translation in three state-of-the-art SMT systems, including a phrase-based system, a hierarchical phrase-based system and a syntax-based system. Experimental results on the NIST MT evaluation corpora show that our approach leads to significant improvements in translation accuracy over the baselines. More interestingly, it is observed that our approach is able to improve the existing system combination systems. The biggest improvements are obtained by generating weak systems using Bagging/Boosting, and learning the strong system using a state-of-the-art system combination method.

Stability vs. Effectiveness: Improved Sentence-Level Combination of Machine Translation Based on Weighted MBR

Boosting-based system combination for machine translation

Bagging and Boosting Statistical Machine Translation Systems

Combining Multiple Alignments to Improve Machine Translation.

Weighted Alignment Matrices for Statistical Machine Translation.

Neural System Combination For Machine Translation

Combining Multiple Chinese Word Segmentation Results for Statistical Machine Translation

Fusion of Word and Letter Based Metrics for Automatic MT Evaluation

Diversify and Combine: Improving Word Alignment for Machine Translation on Low-Resource Languages.

Transformation from Discontinuous to Continuous Word Alignment Improves Translation Quality

Adaptive Weighting for Neural Machine Translation

Lattice-based System Combination for Statistical Machine Translation.

Exploring Hybrid Character-Words Representational Unit in Classical-to-Modern Chinese Machine Translation

Constrained Phrase-based Translation Using Weighted Finite State Transducer.

RMBR: A Regularized Minimum Bayes Risk Reranking Framework for Machine Translation

Translation Model Combination Based On String-Chunk

The multi-strategic incremental TER for system combination

Combining Discrete Lexicon Probabilities with NMT for Low-Resource Mongolian-Chinese Translation

Document-Level Machine Translation Evaluation Metrics Enhanced with Simplified Lexical Chain.

Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task

Improving Statistical Machine Translation with monolingual collocation