Abstract:Large language models (LLMs) have achieved reasonable quality improvements in machine translation (MT). However, most current research on MT-LLMs still faces significant challenges in maintaining translation consistency and accuracy when processing entire documents. In this paper, we introduce DelTA, a Document-levEL Translation Agent designed to overcome these limitations. DelTA features a multi-level memory structure that stores information across various granularities and spans, including Proper Noun Records, Bilingual Summary, Long-Term Memory, and Short-Term Memory, which are continuously retrieved and updated by auxiliary LLM-based components. Experimental results indicate that DelTA significantly outperforms strong baselines in terms of translation consistency and quality across four open/closed-source LLMs and two representative document translation datasets, achieving an increase in consistency scores by up to 4.58 percentage points and in COMET scores by up to 3.16 points on average. DelTA employs a sentence-by-sentence translation strategy, ensuring no sentence omissions and offering a memory-efficient solution compared to the mainstream method. Furthermore, DelTA improves pronoun translation accuracy, and the summary component of the agent also shows promise as a tool for query-based summarization tasks. We release our code and data at <a class="link-external link-https" href="https://github.com/YutongWang1216/DocMTAgent" rel="external noopener nofollow">this https URL</a>.

Document-level Neural Machine Translation with Associated Memory Network

Document-level Neural Machine Translation with Document Embeddings

Memory-augmented Neural Machine Translation.

Neural Machine Translation with Monolingual Translation Memory

Document-Level Event Role Filler Extraction Using Key-Value Memory Network

Rethinking Document-level Neural Machine Translation

Neural Machine Translation with Contrastive Translation Memories

Towards Making the Most of Context in Neural Machine Translation

Multi-Hop Transformer for Document-Level Machine Translation

Context-Adaptive Document-Level Neural Machine Translation

Graph Based Translation Memory for Neural Machine Translation

Neural Machine Translation with Key-Value Memory-Augmented Attention

Learning to Remember Translation History with a Continuous Cache.

Learning Contextualized Sentence Representations for Document-Level Neural Machine Translation

Learning Efficient Lexically-Constrained Neural Machine Translation with External Memory

Memory-augmented Chinese-Uyghur neural machine translation

Non-Autoregressive Document-Level Machine Translation

Diving Deep into Context-Aware Neural Machine Translation

Document-level Neural Machine Translation Using BERT As Context Encoder

DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory

Only 5\% Attention Is All You Need: Efficient Long-range Document-level Neural Machine Translation