Abstract:Syntactic structure has long been argued to be potentially useful for enforcing accurate word alignment and improving generalization performance of machine translation. Unfortunately, existing wisdom demonstrates its significance by considering only the syntactic structure of source tokens, neglecting the rich structural information from target tokens and the structural similarity between the source and target sentences. In this work, we propose to incorporate the syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. Particularly, we won’t leverage any annotated syntactic graph of the target side during training, so we introduce Dynamic Graph Convolution Networks (DGCN) on observed target tokens to sequentially and simultaneously generate the target tokens and the corresponding syntactic graphs, and further guide the word alignment. On this basis, Hierarchical Graph Random Walks (HGRW) are performed on the syntactic graphs of both source and target sides, for incorporating structured constraints on machine translation outputs. Experiments on four publicly available language pairs verify that our method is highly effective in capturing syntactic structure in different languages, consistently outperforming baselines in alignment accuracy and demonstrating promising results in translation quality.

Synchronous Constituent Context Model for Inducing Bilingual Synchronous Structures

Unsupervised Discriminative Induction of Synchronous Grammar for Machine Translation.

Bridging the Gaps of Both Modality and Language: Synchronous Bilingual CTC for Speech Translation and Speech Recognition

Improve Statistical Machine Translation with Context-Sensitive Bilingual Semantic Embedding Model.

Soft Syntactic Constraints for Hierarchical Phrase-Based Translation Using Latent Syntactic Distributions.

Towards Integrated Machine Translation Using Structural Alignment From Syntax-Augmented Synchronous Parsing

SCOI: Syntax-augmented Coverage-based In-context Example Selection for Machine Translation

A Context-Aware Topic Model for Statistical Machine Translation.

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Statistical Machine Translation for Speech: A Perspective on Structures, Learning, and Decoding

Learning synchronous context-free grammars with multiple specialised non-terminals for hierarchical phrase-based translation

Enriching SCFG Rules Directly from Efficient Bilingual Chart Parsing.

Structural Supervision for Word Alignment and Machine Translation.

Machine Translation: 15th China Conference, CCMT 2019, Nanchang, China, September 27–29, 2019, Revised Selected Papers

Synchronous Bidirectional Neural Machine Translation

Dependency-based bracketing transduction grammar for statistical machine translation

A Hybrid Approach to Chinese-English Machine Translation

Prior Derivation Models For Formally Syntax-Based Translation Using Linguistically Syntactic Parsing and Tree Kernels.

Improving Statistical Machine Translation with monolingual collocation

Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding.

An EM Algorithm for SCFG in Formal Syntax-Based Translation