Abstract:The global prevalence of visual impairment due to diseases and accidents continues to increase. Visually impaired individuals rely on their auditory and tactile senses to recognize surrounding objects. However, accessible public facilities such as tactile pavements and tactile signs are installed only in limited areas globally, and visually impaired individuals use assistive devices such as canes or guide dogs, which have limitations. In particular, the visually impaired are not equipped to face unexpected situations by themselves while walking. Therefore, these situations are becoming a great threat to the safety of the visually impaired. To solve this problem, this study proposes a living assistance system, which integrates object recognition, object extraction, outline generation, and braille conversion algorithms, that is applicable both indoors and outdoors. The smart glasses guide objects in real photos, and the user can detect the shape of the object through a braille pad. Moreover, we built a database containing 100 objects on the basis of a survey to select objects frequently used by visually impaired people in real life to construct the system. A performance evaluation, consisting of accuracy and usefulness evaluations, was conducted to assess the system. The former involved comparing the tactile image generated on the basis of braille data with the expected tactile image, while the latter confirmed the object extraction accuracy and conversion rate on the basis of the images of real-life situations. As a result, the living assistance system proposed in this study was found to be efficient and useful with an average accuracy of 85% a detection accuracy of 90% and higher, and an average braille conversion time of 6.6 s. Ten visually impaired individuals used the assistance system and were satisfied with its performance. Participants preferred tactile graphics that contained only the outline of the objects, over tactile graphics containing the full texture details.

Effective Optical Braille Recognition Based On Two-Stage Learning For Double-Sided Braille Image

Braille-to-Chinese Translation System Based on Optical Braille Recognition

Braille Detection Model Based on Foreground Attention and Semantic Learning

Optical Braille Recognition Using Object Detection CNN

Scene Text Detection and Recognition System for Visually Impaired People in Real World

Braille Recognition Using Deep Learning

Iris Recognition Based on Statistical Learning

BrailleReader : Braille Character Recognition Using Wearable Motion Sensor

Enhanced braille recognition based on piezoresistive and piezoelectric dual-mode tactile sensors

Automatic Object Detection Algorithm-Based Braille Image Generation System for the Recognition of Real-Life Obstacles for Visually Impaired People

Postprocessing Algorithm for the Optical Recognition of Degraded Characters

Gesture Recognition Algorithm for Visually Blind Touch Interaction Optimization Using Crow Search Method

Two-Dimensional Optical Character Recognition of Mouse Drawn in Turkish Capital Letters Using Multi-Layer Perceptron Classification

Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation

Chinese-Braille Translation Based on Braille Corpus.

Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech2

A deep learning approach for line-level Amharic Braille image recognition

Tamil OCR Conversion from Digital Writing Pad Recognition Accuracy Improves through Modified Deep Learning Architectures

Multilevel Deep Feature Generation Framework for Automated Detection of Retinal Abnormalities Using OCT Images

End-to-End Solution for Braille-To-Chinese

One-stage Low-resolution Text Recognition with High-resolution Knowledge Transfer