Abstract:Aim/Purpose: This paper proposes a new approach to developing a deep learning-based prototyping wearable model which can assist blind and visually disabled people to recognize their environments and navigate through them. As a result, visually impaired people will be able to manage day-to-day activities and navigate through the world around them more easily. Background: In recent decades, the development of navigational devices has posed challenges for researchers to design smart guidance systems for visually impaired and blind individuals in navigating through known or unknown environments. Efforts need to be made to analyze the existing research from a historical perspective. Early studies of electronic travel aids should be integrated with the use of assistive technology-based artificial vision models for visually impaired persons. Methodology: This paper is an advancement of our previous research work, where we performed a sensor-based navigation system. In this research, the navigation of the visually disabled person is carried out with a vision-based 3D-designed wearable model and a vision-based smart stick. The wearable model used a neural network-based You Only Look Once (YOLO) algorithm to detect the course of the navigational path which is augmented by a GPS-based smart Stick. Over 100 images of each of the three classes, namely straight path, left path and right path, are being trained using supervised learning. The model accurately predicts a straight path with 79% mean average precision (mAP), the right path with 83% mAP, and the left path with 85% mAP. The average accuracy of the wearable model is 82.33% and that of the smart stick is 96.14% which combined gives an overall accuracy of 89.24%. Contribution: This research contributes to the design of a low-cost navigational standalone system that will be handy to use and help people to navigate safely in real-time scenarios. The challenging self-built dataset of various paths is generated and transfer learning is performed on the YOLO-v5 model after augmentation and manual annotation. To analyze and evaluate the model, various metrics, such as model losses, recall value, precision, and maP, are used. Findings: These were the main findings of the study: • To detect objects, the deep learning model uses a higher version of YOLO, i.e., a YOLOv5 detector, that may help those with visual im-pairments to improve their quality of navigational mobilities in known or unknown environments. • The developed standalone model has an option to be integrated into any other assistive applications like Electronic Travel Aids (ETAs) • It is the single neural network technology that allows the model to achieve high levels of detection accuracy of around 0.823 mAP with a custom dataset as compared to 0.895 with the COCO dataset. Due to its lightning-speed of 45 FPS object detection technology, it has become popular. Recommendations for Practitioners: Practitioners can help the model’s efficiency by increasing the sample size and classes used in training the model. Recommendation for Researchers: To detect objects in an image or live cam, there are various algorithms, e.g., R-CNN, Retina Net, Single Shot Detector (SSD), YOLO. Researchers can choose to use the YOLO version owing to its superior performance. Moreover, one of the YOLO versions, YOLOv5, outperforms its other versions such as YOLOv3 and YOLOv4 in terms of speed and accuracy. Impact on Society: We discuss new low-cost technologies that enable visually impaired people to navigate effectively in indoor environments. Future Research: The future of deep learning could incorporate recurrent neural networks on a larger set of data with special AI-based processors to avoid latency.

Computer Vision-Based Assistive Technology for Helping Visually Impaired and Blind People Using Deep Learning Framework

An Environmental Perception and Navigational Assistance System for Visually Impaired Persons Based on Semantic Stixels and Sound Interaction

Object Detection Using Image Processing for Blind Person

Scene Text Detection and Recognition System for Visually Impaired People in Real World

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Efficient Multi-Object Detection and Smart Navigation Using Artificial Intelligence for Visually Impaired People

Object detection and recognition: using deep learning to assist the visually impaired

Newvision: application for helping blind people using deep learning

Embedded Computer Vision for Object Recognition in Smart Devices for the Blind

Smart Glass System Using Deep Learning for the Blind and Visually Impaired

Computer Vision For Sight Computer Vision Techniques To Assist Visually Impaired People To Navigate In An Indoor Environment

Deep learning based assistive technology on audio visual speech recognition for hearing impaired

Realtime Object Detection and Disease Prediction of Visually Impaired People

Assisting Blind People Using Object Detection with Vocal Feedback

AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People

When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition

Deep learning based object detection and surrounding environment description for visually impaired people

Cumulative Study and Development of Obstacle Alert and Assistance Device for Visually Impaired People Using Machine Learning

Obstacle avoidance using stereo vision and depth maps for visual aid devices

A Deep Learning Based Model to Assist Blind People in Their Navigation

Vision AI: A Deep Learning-Based Object Recognition System for Visually Impaired People Using TensorFlow and OpenCV