Abstract:With the continuous advancement of deep learning technologies, neural machine translation (NMT) has emerged as a powerful tool for enhancing communication efficiency among the members of cross-language collaborative teams. Among the various available approaches, leveraging syntactic dependency relations to achieve enhanced translation performance has become a pivotal research direction. However, current studies often lack in-depth considerations of non-Euclidean spaces when exploring interword correlations and fail to effectively address the model complexity arising from dependency relation encoding. To address these issues, we propose a novel approach based on split graph convolutional self-attention encoding (SGSE), aiming to more comprehensively utilize syntactic dependency relationships while reducing model complexity. Specifically, we initially extract syntactic dependency relations from the source language and construct a syntax dependency graph in a non-Euclidean space. Subsequently, we devise split self-attention networks and syntactic semantic self-attention networks, integrating them into a unified model. Through experiments conducted on multiple standard datasets as well as datasets encompassing scenarios related to team collaboration and enterprise management, the proposed method significantly enhances the translation performance of the utilized model while effectively mitigating model complexity. This approach has the potential to effectively enhance communication among cross-language team members, thereby ameliorating collaborative efficiency.

Syntax-aware Transformer Encoder for Neural Machine Translation

Syntax-based Transformer for Neural Machine Translation

Syntax-Enhanced Neural Machine Translation with Syntax-Aware Word Representations

Improved Neural Machine Translation with a Syntax-Aware Encoder and Decoder

Syntax-Aware Complex-Valued Neural Machine Translation

Syntax-aware Neural Machine Translation Directed by Syntactic Dependency Degree

Boosting Neural Machine Translation with Dependency-Scaled Self-Attention Network.

Modeling Source Syntax for Neural Machine Translation

Recurrent Graph Syntax Encoder for Neural Machine Translation

Deps-SAN: Neural Machine Translation with Dependency-Scaled Self-Attention Network

Syntax-Based Context Representation for Statistical Machine Translation.

Syntax-Directed Attention for Neural Machine Translation

A neural machine translation method based on split graph convolutional self-attention encoding

SG-Net: Syntax Guided Transformer for Language Representation

Source Dependency-Aware Transformer with Supervised Self-Attention

Towards String-to-Tree Neural Machine Translation

Improving Neural Machine Translation with Neural Syntactic Distance

Explicit Sentence Compression for Neural Machine Translation

Enhancing low-resource neural machine translation with syntax-graph guided self-attention

Latent Part-of-Speech Sequences for Neural Machine Translation

An Augmented Transformer Architecture for Natural Language Generation Tasks