Exploring Human-Like Translation Strategy with Large Language Models

Zhiwei He,Tian Liang,Wenxiang Jiao,Zhuosheng Zhang,Yujiu Yang,Rui Wang,Zhaopeng Tu,Shuming Shi,Xing Wang

2023-11-29

Abstract:Large language models (LLMs) have demonstrated impressive capabilities in general scenarios, exhibiting a level of aptitude that approaches, in some aspects even surpasses, human-level intelligence. Among their numerous skills, the translation abilities of LLMs have received considerable attention. Compared to typical machine translation that focuses solely on source-to-target mapping, LLM-based translation can potentially mimic the human translation process which might take preparatory steps to ensure high-quality translation. This work explores this possibility by proposing the MAPS framework, which stands for Multi-Aspect Prompting and Selection. Specifically, we enable LLMs first to analyze the given source sentence and induce three aspects of translation-related knowledge: keywords, topics, and relevant demonstrations to guide the final translation process. Moreover, we employ a selection mechanism based on quality estimation to filter out noisy and unhelpful knowledge. Both automatic (3 LLMs x 11 directions x 2 automatic metrics) and human evaluation (preference study and MQM) demonstrate the effectiveness of MAPS. Further analysis shows that by mimicking the human translation process, MAPS reduces various translation errors such as hallucination, ambiguity, mistranslation, awkward style, untranslated text, and omission. Source code is available at <a class="link-external link-https" href="https://github.com/zwhe99/MAPS-mt" rel="external noopener nofollow">this https URL</a>.

Computation and Language

What problem does this paper attempt to address?

The paper primarily explores how to make large language models (LLMs) mimic the strategies of human translators in translation tasks to improve translation quality. Specifically, the study proposes a method called MAPS (Multi-Aspect Prompting and Selection), which aims to have LLMs analyze the source text and extract three aspects of translation-relevant knowledge: keywords, themes, and related example sentences, and use this knowledge to guide the final translation process.

The main contributions of the paper include:
1. **Proposing the MAPS method**: Inspired by human translation strategies, the MAPS method simulates the process of human translators analyzing the source text before translation to collect knowledge that helps improve translation quality.
2. **Importance of multi-aspect knowledge**: The paper emphasizes the complementarity of the three aspects of knowledge—keywords, themes, and related examples—pointing out that combining these three types of knowledge can achieve optimal translation performance.
3. **In-depth analysis**: Through a combination of automatic and manual evaluations, the paper demonstrates the effectiveness of the MAPS method in addressing ambiguities, reducing hallucinations, and other common translation errors. Additionally, it discusses the issue of noise in generated knowledge and how to select the most useful knowledge through a filtering mechanism.

In short, the goal of the paper is to explore how to make large language models better simulate the thinking and workflow of human translators, thereby improving the quality and accuracy of translations.