Abstract:Neural machine translation (NMT) has been bringing exciting news in the field of machine translation since its emergence. However, because NMT only employs single neural networks to convert natural languages, it suffers from two drawbacks in terms of reducing translation time: NMT is more sensitive to sentence length than statistical machine translation and the end-to-end implementation process fails to make explicit use of linguistic knowledge to improve translation performance. The network model performance of various deep learning machine translation tasks was constructed and compared in English-Chinese bilingual direction, and the defects of each network were solved by using an attention mechanism. The problems of gradient disappearance and gradient explosion are easy to occur in the recurrent neural network in the long-distance sequence. The short and long-term memory networks cannot reflect the information weight problems in long-distance sequences. In this study, through the comparison of examples, it is concluded that the introduction of an attention mechanism can improve the attention of context information in the process of model generation of the target language sequence, thus translating restore degree and fluency higher. This study proposes a neural machine translation method based on the divide-and-conquer strategy. Based on the idea of divide-and-conquer, this method identifies and extracts the longest noun phrase in a sentence and retains special identifiers or core words to form a sentence frame with the rest of the sentence. This method of translating the longest noun phrase and sentence frame separately by the neural machine translation system, and then recombining the translation, alleviates the poor performance of neural machine translation in long sentences. Experimental results show that the BLEU score of translation obtained by the proposed method has improved by 0.89 compared with the baseline method.

A Cooperative Lightweight Translation Algorithm Combined with Sparse-ReLU

Hybrid-Regressive Paradigm for Accurate and Speed-Robust Neural Machine Translation

Non-Autoregressive Translation with Layer-Wise Prediction and Deep Supervision

Deep Neural Machine Translation with Linear Associative Unit

Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters

Deep Learning-Based English-Chinese Translation Research

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation

Automatic translation of spoken English based on improved machine learning algorithm

Learn To be Efficient: Build Structured Sparsity in Large Language Models

Efficient Machine Translation with a BiLSTM-Attention Approach

Lite Transformer with Long-Short Range Attention

Dual sparse training framework: inducing activation map sparsity via Transformed $\ell1$ regularization

Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC

Efficient and Economic Large Language Model Inference with Attention Offloading

Optimizing Deep Transformers for Chinese-Thai Low-Resource Translation

Multi-split Reversible Transformers Can Enhance Neural Machine Translation.

SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization

Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs

Learning Language-Specific Layers for Multilingual Machine Translation