Evaluation of Google Translate for Mandarin Chinese translation using sentiment and semantic analysis

Xuechun Wang,Rodney Beard,Rohitash Chandra
2024-09-16
Abstract:Machine translation using large language models (LLMs) is having a significant global impact, making communication easier. Mandarin Chinese is the official language used for communication by the government and media in China. In this study, we provide an automated assessment of translation quality of Google Translate with human experts using sentiment and semantic analysis. In order to demonstrate our framework, we select the classic early twentieth-century novel 'The True Story of Ah Q' with selected Mandarin Chinese to English translations. We use Google Translate to translate the given text into English and then conduct a chapter-wise sentiment analysis and semantic analysis to compare the extracted sentiments across the different translations. Our results indicate that the precision of Google Translate differs both in terms of semantic and sentiment analysis when compared to human expert translations. We find that Google Translate is unable to translate some of the specific words or phrases in Chinese, such as Chinese traditional allusions. The mistranslations may be due to lack of contextual significance and historical knowledge of China.
Computation and Language,Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the quality of Google Translate when translating from Chinese to English, especially in comparison with human expert translations in terms of sentiment and semantic analysis. Specifically, the researchers selected Lu Xun's classic novel "The True Story of Ah Q" as the research object. Through the methods of sentiment analysis and semantic analysis, they made a detailed comparison between the translation results of Google Translate and those of two professional translators. The research aims to explore Google Translate's ability to handle specific words or phrases, such as allusions in traditional Chinese culture, and analyze its accuracy in emotional expression. Through this research, the author hopes to reveal the limitations of machine translation in preserving the sentiment and semantics of the original text, as well as the possible impacts in cross - cultural communication.