Abstract:The technology for converting Chinese to Braille is of great importance. When paired with a Braille display, it can better meet the educational and daily needs of the visually impaired community, especially children and students. Incorporating visual assistance mechanisms can further enhance the user experience and provide comprehensive support for individuals with visual impairments. In recent years, the use of end-to-end neural machine translation models for Chinese–Braille translation has gained traction. However, this task requires large, high-quality, and domain-specific parallel data to train robust models. Unfortunately, the existing Chinese–Braille parallel data is insufficient to achieve satisfactory results. To address this challenge, this paper puts forward a groundbreaking approach that integrates pre-training models into the Chinese Braille translation task. This represents the first-ever application of such technology in this context and it is different from traditional pre-training methods. While previous pre-training method of natural language processing mainly utilized raw text data, we have identified its limitations in improving Chinese–Braille translation. Therefore, we have proposed three novel forms of pre-training datasets, instead of relying solely on raw text data. By utilizing the Transformer model, our approach achieves the highest BLEU score of 94.53 on a 10k parallel corpus, presenting a new direction for Chinese–Braille translation research. Furthermore, we introduce a new form of data that enables Chinese–Braille translation solely using the encoder framework. Leveraging the MacBERT model, this approach achieves a BLEU score of 98.87 on the test set and demonstrates an inference speed 54 times faster than the Transformer model. These findings have significant implications for the field of Chinese–Braille translation, providing insights for future research endeavors.

Braille-to-Chinese Translation System Based on Optical Braille Recognition

Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation

End-to-End Solution for Braille-To-Chinese

Accurate Braille-Chinese Translation Towards Efficient Chinese Input Method for Blind People

Recommender System for China Braille Library

Scene Text Detection and Recognition System for Visually Impaired People in Real World

Braille to Print Translations for Chinese

Braille Recognition Using Deep Learning

Chinese-Braille Translation Based on Braille Corpus.

Design and Implementation of Chinese Common Braille Translation System Integrating Braille Word Segmentation and Concatenation Rules

A Convenient and Efficient Scene Shop Recognition Assistant Tool for the Visually Impaired

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Store Sign Text Recognition for Wearable Navigation Assistance System

Improving Braille-Chinese translation with jointly trained and pre-trained language models

A Flexible Assistant Tool with Dynamic Scanning to Enhance the Ability of Color Discrimination

CBConv: Service for Automatic Conversion of Chinese Characters into Braille with High Accuracy

The Accessible Interactive Mode of Traditional Printing Based on Two-Dimensional Code

BrailleReader : Braille Character Recognition Using Wearable Motion Sensor

Pre-training model for low-resource Chinese–Braille translation

Segmentation of Mandarin Braille Word and Braille Translation Based on Multi-Knowledge

Braille for Visual Cryptography