Abstract:Visually impaired people are a large group who can only use braille for reading and writing. However, the lack of special educational resources is the bottleneck for educating them. Educational equity is a reflection of the level of social civilization, cultural equality, and individual dignity. Facilitating and improving lifelong learning channels for the visually impaired is of great significance. Their written braille homework or exam papers cannot be understood by sighted teachers, because of the lack of a highly accurate braille translation system, especially in Chinese which has tone marks. braille writers often omit tone marks to save space, leading to confusion when braille with the same consonants and vowels is translated into Chinese. Previous algorithms were insufficient in extracting contextual information, resulting in low accuracy of braille translations into Chinese. This project informatively fine-tuned the mT5 model with an Encoder-decoder architecture for braille to Chinese character conversion. This research created a training set of braille and corresponding Chinese text from the Leipzig Corpora. This project significantly reduced the confusion in braille, achieving $62.4$ and $62.3$ BLEU scores in the validation and test sets, with a curriculum learning fine-tuning method. By incorporating the braille recognition algorithm, this project is the first publicly available braille translation system and can benefit lots of visually impaired students and families who are preparing for the Chinese College Test and help to propel their college dreams in the future. There is a demo on our homepage\footnote{\url{<a class="link-external link-https" href="https://vision-braille.com/" rel="external noopener nofollow">this https URL</a>}}.

The Speech and Natural Language Processing Technique Used in a Software System for the Blinds

Braille-to-Chinese Translation System Based on Optical Braille Recognition

Design of voice interaction-based training system for cerebral palsy rehabilitation

Design of a speech interaction system for man-machine confrontation

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Scene Text Detection and Recognition System for Visually Impaired People in Real World

Right mix of speech and non-speech: hybrid auditory feedback in mobility assistance of the visually impaired

Design and implementation of a speaker recognition system

The Accessible Interactive Mode of Traditional Printing Based on Two-Dimensional Code

Braille Recognition Using Deep Learning

Study of Aural User Interface Based on Non-Speech Sound

A New Mmwave-Speech Multimodal Speech System for Voice User Interface

Voice Assistant for Blind Person

Electrostatic smart textiles for Braille‐to‐speech translation

Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation

A Chinese Text-to-Speech System

Speech Recognition Based Blind Chess Education System Chinese Chess as an Example

Lightweight smart glass system with audio aid for visually impaired people

The Speech Control of Intelligent Electrical/Electronic System in Vehicles

All-weather, natural silent speech recognition via machine-learning-assisted tattoo-like electronics

Radar Translator: Contactless Eyeblink Detection Assisting Basic Daily Intension Voice for the Paralyzed Aphasia Patient Using Bio-Radar