Enhancing Taiwanese Hokkien Dual Translation by Exploring and Standardizing of Four Writing Systems

Bo-Han Lu,Yi-Hsuan Lin,En-Shiun Annie Lee,Richard Tzong-Han Tsai

2024-05-14

Abstract:Machine translation focuses mainly on high-resource languages (HRLs), while low-resource languages (LRLs) like Taiwanese Hokkien are relatively under-explored. The study aims to address this gap by developing a dual translation model between Taiwanese Hokkien and both Traditional Mandarin Chinese and English. We employ a pre-trained LLaMA 2-7B model specialized in Traditional Mandarin Chinese to leverage the orthographic similarities between Taiwanese Hokkien Han and Traditional Mandarin Chinese. Our comprehensive experiments involve translation tasks across various writing systems of Taiwanese Hokkien as well as between Taiwanese Hokkien and other HRLs. We find that the use of a limited monolingual corpus still further improves the model's Taiwanese Hokkien capabilities. We then utilize our translation model to standardize all Taiwanese Hokkien writing systems into Hokkien Han, resulting in further performance improvements. Additionally, we introduce an evaluation method incorporating back-translation and GPT-4 to ensure reliable translation quality assessment even for LRLs. The study contributes to narrowing the resource gap for Taiwanese Hokkien and empirically investigates the advantages and limitations of pre-training and fine-tuning based on LLaMA 2.

Computation and Language

What problem does this paper attempt to address?

The paper aims to address the resource scarcity of Taiwanese Hokkien in the field of machine translation. Specifically, the goals of the paper include:

1. **Developing a bilingual translation model**: Develop a bidirectional translation model between Taiwanese Hokkien and both traditional Mandarin and English to compensate for the lack of resources for this low-resource language in existing machine translation systems.

2. **Utilizing pre-trained models**: By using the LLaMA 2-7B model pre-trained specifically for traditional Mandarin, leverage the writing similarity between Taiwanese Hokkien characters (HAN) and traditional Mandarin to improve translation performance.

3. **Standardizing the writing system**: Standardize all Taiwanese Hokkien monolingual corpora into HAN format and continue pre-training on this basis to further enhance translation performance.

4. **Evaluation method**: Introduce a method combining back-translation and GPT-4 to ensure reliable evaluation of translation quality for low-resource languages.

The main contributions of the paper are:

- Developed and released the first bilingual translation model for Taiwanese Hokkien, narrowing the resource gap for this low-resource language.
- Demonstrated through experiments that adding monolingual corpora to parallel data can enhance model performance.
- Standardized all Taiwanese Hokkien monolingual corpora into HAN format, improving cross-language translation performance.
- Introduced a method of back-translating low-resource languages to high-resource languages for evaluation based on GPT prompts.