An Error-Sensitive Evaluation Metric for Word Alignment

黄书剑,奚宁,赵迎功,戴新宇,陈家骏
DOI: https://doi.org/10.3969/j.issn.1003-0077.2009.03.011
2009-01-01
Abstract:AER(Alignment Error Rate) is a widely used alignment quality measure.Recent study shows that the AER score is not well correlated with the BLEU score of the final translation result.In this paper,we analyze the possible reasons for this weak correlation in a phrase-based SMT environment.We also propose a new alignment quality measure ESAER(Error-Sensitive Alignment Error Rate) according to different alignment errors.Experimental result shows that ESAER gets a much higher correlation with BLEU score than AER.
What problem does this paper attempt to address?