Abstract:Learning semantic representations of bilingual phrases is very important for statistical machine translation to overcome data sparsity and exploit semantic information. In this paper, we consider word alignments as a semantic bridge between the source and target phrases, and propose two neural networks based on the conventional recursive autocoder, which exploit word alignments to generate alignment-consistent bilingual phrase structures: One is Alignment Enhanced Recursive Autoencoder that incorporates a word-alignment-related error into the final objective function; The other is Alignment Guided Recursive Neural Network which treats word alignments as direct signals to guide phrase structure constructions. Then, we further establish the semantic correspondences between the source and target nodes of the generated bilingual phrase structures via word alignments. By jointly minimizing recursive autoencoder reconstruction errors, structural alignment consistency errors and cross-lingual reconstruction errors, our model not only generates alignment-consistent phrase structures, but also captures different levels of semantic correspondences within bilingual phrases. Experiments on the NIST Chinese-English translation task show that our model achieves significant improvements over the baseline.

Recursive Autoencoders for ITG-Based Translation.

Hybrid-Regressive Paradigm for Accurate and Speed-Robust Neural Machine Translation

Recurrent Graph Syntax Encoder for Neural Machine Translation

Learning to Rewrite for Non-Autoregressive Neural Machine Translation.

Filtering Reordering Table Using a Novel Recursive Autoencoder Model for Statistical Machine Translation

Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input

INarIG: Iterative Non-autoregressive Instruct Generation Model For Word-Level Auto Completion

Imitation Learning for Non-Autoregressive Neural Machine Translation.

Lattice-Based Transformer Encoder for Neural Machine Translation

Topically-informed Bilingually-Constrained Recursive Autoencoders for Statistical Machine Translation

Semantically Smooth Bilingual Phrase Embeddings Based on Recursive Autoencoders

Lattice-Based Recurrent Neural Network Encoders for Neural Machine Translation

Lossless Speedup of Autoregressive Translation with Generalized Aggressive Decoding

Insertion-based Decoding with automatically Inferred Generation Order

Genetic Algorithm-based Transformer Architecture Design for Neural Machine Translation.

Neural Machine Translation with Dynamic Graph Convolutional Decoder

Syntax-aware Transformer Encoder for Neural Machine Translation

Train Once, and Decode As You Like.

Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information

Alignment-consistent Recursive Neural Networks for Bilingual Phrase Embeddings.

Non-autoregressive Translation with Dependency-Aware Decoder