Abstract:Visually impaired people are a large group who can only use braille for reading and writing. However, the lack of special educational resources is the bottleneck for educating them. Educational equity is a reflection of the level of social civilization, cultural equality, and individual dignity. Facilitating and improving lifelong learning channels for the visually impaired is of great significance. Their written braille homework or exam papers cannot be understood by sighted teachers, because of the lack of a highly accurate braille translation system, especially in Chinese which has tone marks. braille writers often omit tone marks to save space, leading to confusion when braille with the same consonants and vowels is translated into Chinese. Previous algorithms were insufficient in extracting contextual information, resulting in low accuracy of braille translations into Chinese. This project informatively fine-tuned the mT5 model with an Encoder-decoder architecture for braille to Chinese character conversion. This research created a training set of braille and corresponding Chinese text from the Leipzig Corpora. This project significantly reduced the confusion in braille, achieving $62.4$ and $62.3$ BLEU scores in the validation and test sets, with a curriculum learning fine-tuning method. By incorporating the braille recognition algorithm, this project is the first publicly available braille translation system and can benefit lots of visually impaired students and families who are preparing for the Chinese College Test and help to propel their college dreams in the future. There is a demo on our homepage\footnote{\url{<a class="link-external link-https" href="https://vision-braille.com/" rel="external noopener nofollow">this https URL</a>}}.

ASAB: a Chinese screen reader

Braille-to-Chinese Translation System Based on Optical Braille Recognition

Digital library access for Chinese visually impaired.

Human computer interface and optimized electro-mechanical design for Chinese Braille display

Accurate Braille-Chinese Translation Towards Efficient Chinese Input Method for Blind People

Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation

SignFind: A Synchronized Sign Language and Chinese Character Teaching Game for Chinese Deaf Children Using Gesture Recognition

A Virtual Chinese Keyboard BCI System Based on P300 Potentials

From Speech to Text in Chinese: A Computer-Aided Transcription System for the Legal Domain.

Design and Implementation of Chinese Common Braille Translation System Integrating Braille Word Segmentation and Concatenation Rules

A P300-Based Brain-Computer Interface For Chinese Character Input

C-SAK: Chinese Scanning Ambiguous Keyboard for Parkinson's Disease Patients

Human-Computer Chinese Sign Language Interaction System

BlindReader: an Assistant System to Support Text Reading for the Visually Impaired People

A Bi-directional Interactive System of Sign Language and Visual Speech Based on Portable Devices.

Chinese Sign Language Animation System on Mobile Devices

User-centred Design for Chinese-oriented Spoken English Learning System

A Method to Synthesize Chinese Sign Language Based on Virtual Human Technologies

Building Language Communication between Deaf People and Hearing Society through Multimodal Human-Computer Interface

Handtalker: A Multimodal Dialog System Using Sign Language and 3-D Virtual Human

A Chinese Text Input Brain–Computer Interface Based on the P300 Speller