Abstract:Natural Language Processing (NLP) is a group of theoretically inspired computer structures for analyzing and modeling clearly going on texts at one or extra degrees of linguistic evaluation to acquire human-like language processing for quite a few activities and applications. Hearing and visually impaired people are unable to see entirely or have very low vision, as well as being unable to hear completely or having a hard time hearing. It is difficult to get information since both hearing and vision, which are crucial organs for receiving information, are harmed. Hearing and visually impaired people are considered to have a substantial information deficit, as opposed to people who just have one handicap, such as blindness or deafness. Visually and hearing-impaired people who are unable to communicate with the outside world may experience emotional loneliness, which can lead to stress and, in extreme cases, serious mental illness. As a result, overcoming information handicap is a critical issue for visually and hearing-impaired people who want to live active, independent lives in society. The major objective of this study is to recognize Arabic speech in real time and convert it to Arabic text using Convolutional Neural Network-based algorithms before saving it to an SD card. The Arabic text is then translated into Arabic Braille characters, which are then used to control the Braille pattern via a Braille display with a solenoid drive. The Braille lettering triggered on the finger was deciphered by visually and hearing challenged participants who were proficient in Braille reading. The CNN, in combination with the ReLU model learning parameters, is fine-tuned for optimization, resulting in a model training accuracy of 90%. The tuned parameters model's testing results show that adding the ReLU activation function to the CNN model improves recognition accuracy by 84 % when speaking Arabic digits.

Automatic Speech Recognition and its Visual Perception Via a Cymatics Based Display

Speech Recognition and a Cymatics Based Configurable Speech Perception

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Scene to Text Conversion and a Cymatics Based Configurable Text Perception

VisibleSound: Perceiving Environmental Sound with 4D Form

Perceiving Graphical and Pictorial Information via Hearing and Touch

Help the Blind See: Assistance for the Visually Impaired through Augmented Acoustic Simulation

Advanced Audio Aid for Blind People

Image Recognition Using Text and Audio Translation for the Visually Challenged

SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis

Assistive Magnetic Skin System for Speech Reconstruction: An Empowering Technology for Aphonic Individuals

Decoding Silent Speech Commands from Articulatory Movements Through Soft Magnetic Skin and Machine Learning

Design and Implementation of a Real-Time Color Recognition System for the Visually Impaired

Development of speechreading supplements based on automatic speech recognition

Convolutional Neural Network Based Real Time Arabic Speech Recognition to Arabic Braille for Hearing and Visually Impaired

Design Considerations for Automatic Musical Soundscapes of Visual Art for People with Blindness or Low Vision

A Fusion of EMG and IMU for an Augmentative Speech Detection and Recognition System

Improve accessibility for Low Vision and Blind people using Machine Learning and Computer Vision

Speech visualization by integrating features for the hearing impaired

Physics-inspired Neuroacoustic Computing Based on Tunable Nonlinear Multiple-scattering

Deep Sensory Substitution: Noninvasively Enabling Biological Neural Networks to Receive Input from Artificial Neural Networks