Abstract:In statistical machine translation, the standard methods such as MERT tune a single weight with regard to a given development data. However, these methods suffer from two problems due to the diversity and uneven distribution of source sentences. First, their performance is highly dependent on the choice of a development set, which may lead to an unstable performance for testing. Second, the sentence level translation quality is not assured since tuning is performed on the document level rather than on sentence level. In contrast with the standard global training in which a single weight is learned, we propose novel local training methods to address these two problems. We perform training and testing in one step by locally learning the sentence-wise weight for each input sentence. Since the time of each tuning step is unnegligible and learning sentence-wise weights for the entire test set means many passes of tuning, it is a great challenge for the efficiency of local training. We propose an efficient two-phase method to put the local training into practice by employing the ultraconservative update. On NIST Chinese-to-English translation tasks with both medium and large scales of training data, our local training methods significantly outperform standard methods with the maximal improvements up to 2.0 BLEU points, meanwhile their efficiency is comparable to that of the standard methods.

Softmax-margin Training for Statistical Machine Translation

Locally Training the Log-Linear Model for SMT.

Transductive Minimum Error Rate Training for Statistical Machine Translation.

A simple discriminative training method for machine translation with large-scale features

Maximum Rank Correlation Training for Statistical Machine Translation.

Discriminative Training for Log-Linear Based SMT: Global or Local Methods.

BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training

Expected Error Minimization with Ultraconservative Update for SMT.

Prevent the Language Model from being Overconfident in Neural Machine Translation

Coordinate System Selection for Minimum Error Rate Training in Statistical Machine Translation

Training MT Model Using Structural SVM

An Empirical Study on Development Set Selection Strategy for Machine Translation Learning.

Large-Margin Regularized Softmax Cross-Entropy Loss

Stability vs. Effectiveness: Improved Sentence-Level Combination of Machine Translation Based on Weighted MBR

An Improved Multi-task Approach to Pre-trained Model Based MT Quality Estimation.

Multi-classifier Combination for Translation Error Detection

Exploring the traditional NMT model and Large Language Model for chat translation

CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation

Bayesian Optimisation for Machine Translation

Semi-Supervised Neural Machine Translation Via Marginal Distribution Estimation

A Bilingual Graph-Based Semantic Model for Statistical Machine Translation.