Abstract:Natural Language Processing (NLP) is a group of theoretically inspired computer structures for analyzing and modeling clearly going on texts at one or extra degrees of linguistic evaluation to acquire human-like language processing for quite a few activities and applications. Hearing and visually impaired people are unable to see entirely or have very low vision, as well as being unable to hear completely or having a hard time hearing. It is difficult to get information since both hearing and vision, which are crucial organs for receiving information, are harmed. Hearing and visually impaired people are considered to have a substantial information deficit, as opposed to people who just have one handicap, such as blindness or deafness. Visually and hearing-impaired people who are unable to communicate with the outside world may experience emotional loneliness, which can lead to stress and, in extreme cases, serious mental illness. As a result, overcoming information handicap is a critical issue for visually and hearing-impaired people who want to live active, independent lives in society. The major objective of this study is to recognize Arabic speech in real time and convert it to Arabic text using Convolutional Neural Network-based algorithms before saving it to an SD card. The Arabic text is then translated into Arabic Braille characters, which are then used to control the Braille pattern via a Braille display with a solenoid drive. The Braille lettering triggered on the finger was deciphered by visually and hearing challenged participants who were proficient in Braille reading. The CNN, in combination with the ReLU model learning parameters, is fine-tuned for optimization, resulting in a model training accuracy of 90%. The tuned parameters model's testing results show that adding the ReLU activation function to the CNN model improves recognition accuracy by 84 % when speaking Arabic digits.

Image Recognition Using Text and Audio Translation for the Visually Challenged

Scene Text Detection and Recognition System for Visually Impaired People in Real World

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

TransEffiVisNet – an image captioning architecture for auditory assistance for the visually impaired

A Lightweight Visual Understanding System for Enhanced Assistance to the Visually Impaired Using an Embedded Platform

Assisting Blind People Using Object Detection with Vocal Feedback

A SMART IMAGE PROCESSING ALGORITHM FOR TEXT RECOGNITION, INFORMATION EXTRACTION AND VOCALIZATION FOR THE VISUALLY CHALLENGED

Caption positioning structure for hard of hearing people using deep learning method

Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation

Vision AI: A Deep Learning-Based Object Recognition System for Visually Impaired People Using TensorFlow and OpenCV

REAL TIME OBJECT DETECTION FOR VISUALLY CHALLENGED PEOPLE USING MACHINE LEARNING

Object Detection Using Image Processing for Blind Person

Portable Camera-Based Product Label Reading For Blind People

Convolutional Neural Network Based Real Time Arabic Speech Recognition to Arabic Braille for Hearing and Visually Impaired

Multilingual Video Viewing Subtitle to Audio Translator

Neuraltalk+: neural image captioning with visual assistance capabilities

Braille Recognition Using Deep Learning

CNN-LSTM Hybrid Real-Time IoT-Based Cognitive Approaches for ISLR with WebRTC: Auditory Impaired Assistive Technology

Portable Camera-Based Assistive Device for Real-Time Text Recognition on Various Products and Speech Using Android for Blind People

D-CNN: A New model for Generating Image Captions with Text Extraction Using Deep Learning for Visually Challenged Individuals

Quality-agnostic Image Captioning to Safely Assist People with Vision Impairment