Improving Braille-Chinese translation with jointly trained and pre-trained language models

Tianyuan Huang,Wei Su,Lei Liu,Chuan Cai,Hailong Yu,Yongna Yuan
DOI: https://doi.org/10.1016/j.displa.2024.102660
IF: 3.074
2024-02-03
Displays
Abstract:The education of visually impaired children remains a focal topic, and the implementation of Braille-Chinese translation can facilitate improved understanding and learning of Braille for these children. Braille-Chinese translation refers to the conversion of Braille text into Chinese characters. Owing to the scarcity of Braille-Chinese parallel corpora, achieving Braille-Chinese translation with limited data remains a significant research challenge. This study tackles the challenge by utilizing both Braille joint training and pre-trained language models to conduct analogy learning and transfer learning on a substantial volume of readily available data. The method of Braille joint training also establishes a universal language model in the Braille domain, capable of simultaneously performing multiple tasks like Braille-Chinese translation, Chinese-Braille translation, Braille word segmentation, etc. This greatly caters to users' requirements for Braille information processing while also mitigating extensive deployment expenses associated with multiple models. Furthermore, we put forward a Braille phoneme recognition translation approach distinct from conventional Braille-Chinese translation methodologies. This approach aims to attain precise translation by identifying the Chinese characters corresponding to each Braille phoneme. This method achieves a BLEU score of 96.22 on the Braille-Chinese entity annotation dataset and exhibits high translation efficiency.
engineering, electrical & electronic,instruments & instrumentation,optics,computer science, hardware & architecture
What problem does this paper attempt to address?