Abstract:With the rapid development of Natural Language Processing (NLP) technology, the accuracy and efficiency of machine translation have become hot topics of research. This paper proposes a novel Seq2Seq model aimed at improving translation quality while reducing the storage space required by the model. The model employs a Bidirectional Long Short-Term Memory network (Bi-LSTM) as the encoder to capture the context information of the input sequence; the decoder incorporates an attention mechanism, enhancing the model's ability to focus on key information during the translation process. Compared to the current mainstream Transformer model, our model achieves superior performance on the WMT14 machine translation dataset while maintaining a smaller size. The study first introduces the design principles and innovative points of the model architecture, followed by a series of experiments to verify the effectiveness of the model. The experimental includes an assessment of the model's performance on different language pairs, as well as comparative analysis with traditional Seq2Seq models. The results show that while maintaining translation accuracy, our model significantly reduces the storage requirements, which is of great significance for translation applications in resource-constrained scenarios. our code are available at <a class="link-external link-https" href="https://github.com/mindspore-lab/models/tree/master/research/arxiv_papers/miniformer" rel="external noopener nofollow">this https URL</a>. Thanks for the support provided by MindSpore Community.

Improving Neural Machine Translation with AMR Semantic Graphs

Semantic Neural Machine Translation Using AMR

Modeling Source Syntax and Semantics for Neural AMR Parsing

Mutual Information and Diverse Decoding Improve Neural Machine Translation.

Semantic Analysis and Evaluation of Translation Based on Abstract Meaning Representation

Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features

Syntax-Enhanced Neural Machine Translation with Syntax-Aware Word Representations

Neural amr: Sequence-to-sequence models for parsing and generation

Modeling Graph Structure in Transformer for Better AMR-to-Text Generation.

Combining Advanced Methods in Japanese-Vietnamese Neural Machine Translation

Analyzing the Role of Semantic Representations in the Era of Large Language Models

AMR-To-Text Generation with Graph Transformer.

Improving Non-Autoregressive Machine Translation Using Sentence-Level Semantic Agreement

Efficient Machine Translation with a BiLSTM-Attention Approach

Semantic Representation for Dialogue Modeling

Improving sentence representation for vietnamese natural language understanding using optimal transport

Machine Translation between Vietnamese and English: an Empirical Study

Exploration on Advanced Intelligent Algorithms of Artificial Intelligence for Verb Recognition in Machine Translation

Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation

Improving Performance of NMT Using Semantic Concept of WordNet Synset

Neural Machine Translation Research Based on the Semantic Vector of the Tri-Lingual Parallel Corpus