Abstract:Syntactic structure has long been argued to be potentially useful for enforcing accurate word alignment and improving generalization performance of machine translation. Unfortunately, existing wisdom demonstrates its significance by considering only the syntactic structure of source tokens, neglecting the rich structural information from target tokens and the structural similarity between the source and target sentences. In this work, we propose to incorporate the syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. Particularly, we won’t leverage any annotated syntactic graph of the target side during training, so we introduce Dynamic Graph Convolution Networks (DGCN) on observed target tokens to sequentially and simultaneously generate the target tokens and the corresponding syntactic graphs, and further guide the word alignment. On this basis, Hierarchical Graph Random Walks (HGRW) are performed on the syntactic graphs of both source and target sides, for incorporating structured constraints on machine translation outputs. Experiments on four publicly available language pairs verify that our method is highly effective in capturing syntactic structure in different languages, consistently outperforming baselines in alignment accuracy and demonstrating promising results in translation quality.

Alignment-consistent Recursive Neural Networks for Bilingual Phrase Embeddings.

Bilingual Correspondence Recursive Autoencoder for Statistical Machine Translation

Neural Machine Translation with Explicit Phrase Alignment

Incorporating Structural Alignment Biases into an Attentional Neural Translation Model

Word Alignment Modeling with Context Dependent Deep Neural Network.

Neural Baselines for Word Alignment

A Neural Reordering Model for Phrase-based Translation.

Lattice-Based Recurrent Neural Network Encoders for Neural Machine Translation

Noun Phrase Alignment in Chinese-English Bilingual Corpora

Minimum Error Rate Training for Bilingual News Alignment.

Structural Supervision for Word Alignment and Machine Translation.

Recursive Autoencoders for ITG-Based Translation.

Agreement-based Joint Training for Bidirectional Attention-based Neural Machine Translation.

mammothwill be a jiang shi yixiang juda gongcheng job ( a )

Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNN

Unsupervised Deep Cross-Language Entity Alignment

Learning Two-Branch Neural Networks for Image-Text Matching Tasks.

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Asynchronous Bidirectional Decoding for Neural Machine Translation.

Hierarchical Character Embeddings: Learning Phonological and Semantic Representations in Languages of Logographic Origin using Recursive Neural Networks

Dependency-based Gated Recursive Neural Network for Chinese Word Segmentation.