Deep combination of large-scale features in statistical machine translation

Yu-peng LIU,Xiu-ming QIAO,Shi-lei ZHAO,Chun-guang MA
DOI: https://doi.org/10.3785/j.issn.1008-973X.2017.01.006
2017-01-01
Abstract:Deep neural network (DNN) has many successful applications in statistical machine translation (SMT),and the absent semantic problem of machine translation system was solved.The mainstream recurrent neural network (RTNN) and recursive neural network (RENN) model were modified,and a deep neural network combination (DCNN) of large-scale features for system combination in SMT was presented.The model has strong generalization ability,which is suitable for the current mainstream bottom-up decoding style.Hierarchical phrase-based grammar (HPG) was combined with bracket transduction grammar (BTG).The improved recurrent neural network was used to generate the phrasepair semantic vector which is suitable to phrase generation process,and the autoencoder was used to improve the performance of the recurrent neural network.The improved recursive neural network was used to guide the decoding process in SMT task,and the mutual influence information was considered from another decoder.The deep neural translation combination model is suitable not only for heterogeneoussystem,but also for heterogeneous corpus.The experimental results showed that DCNN significantly improved the performance of a state-of-the-art SMT baseline system,leading to a gain of 1.0-1.9 and 1.05-1.58 BLEU points in heterogeneous system and corpus combination,respectively.
What problem does this paper attempt to address?