Newvision: application for helping blind people using deep learning

Kumar Srinivas Bobba,Kartheeban K,Vamsi Krishna Sai Boddu,Vijaya Mani Surendra Bolla,Dinesh Bugga

2023-11-05

Abstract:As able-bodied people, we often take our vision for granted. For people who are visually impaired, however, their disability can have a significant impact on their daily lives. We are developing proprietary headgear that will help visually impaired people navigate their surroundings, identify objects and people, read text, and avoid obstacles. The headgear will use a combination of computer vision, distance estimation with ultrasonic sensors, voice recognition, and voice assistants to provide users with real-time information about their environment. Users will be able to interact with the headgear through voice commands, such as ''What is that?'' to identify an object or ''Navigate to the front door'' to find their way around. The headgear will then provide the user with a verbal description of the object or spoken navigation instructions. We believe that this headgear has the potential to make a significant difference in the lives of visually impaired people, allowing them to live more independently and participate more fully in society.

Human-Computer Interaction,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to develop a head - mounted device for the visually impaired that can help them better navigate, recognize objects and people, read text, and avoid obstacles. Specifically, this project aims to provide users with real - time information about their surrounding environment by combining computer vision, distance estimation of ultrasonic sensors, speech recognition and voice assistant technologies, thereby enhancing the life independence and social participation of the visually impaired. The paper mentions that currently, technological solutions for the visually impaired usually focus only on a single task, such as reading or navigation. However, the goal of this project is to create a more comprehensive device that can assist in a wider range of tasks. The device is designed in a wearable form, such as a mask or VR helmet, and is planned to be eventually reduced to the size of ordinary glasses. The device will be equipped with an on - board processor, radar, and camera, and special measures will be taken to ensure that the device is lightweight for comfortable all - day wear, while also ensuring all - weather battery life. In addition, the device is developed using a modular approach. Each function (such as currency detection, scene interpretation, object detection, and traffic assistance) is developed as an independent module, and these modules are then integrated into the final product. This modular approach not only allows the use of the latest AI technologies, such as object detection, computer vision, and deep learning, but also ensures that if one module fails, it will not affect the functions of other modules. The device also has a safety mode. If the entire system fails, it will warn the user and guide them to the nearest safe place or a place to seek help. In conclusion, this project aims to significantly improve the quality of life of the visually impaired through technological innovation, enabling them to live more independently and integrate more fully into society.

Newvision: application for helping blind people using deep learning

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

An Environmental Perception and Navigational Assistance System for Visually Impaired Persons Based on Semantic Stixels and Sound Interaction

A Virtual Vision Navigation System for The Blind Using Wearable Touch-vision Devices

Cumulative Study and Development of Obstacle Alert and Assistance Device for Visually Impaired People Using Machine Learning

AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People

Smart_Eye: A Navigation and Obstacle Detection for Visually Impaired People through Smart App

Computer Vision-Based Assistive Technology for Helping Visually Impaired and Blind People Using Deep Learning Framework

Wearable Travel Aid for Environment Perception and Navigation of Visually Impaired People

A Vision Aid for the Visually Impaired using Commodity Dual-Rear-Camera Smartphones

Wearable Visually Assistive Device for Blind People to Appreciate Real-world Scene and Screen Image

iVision: An Assistive System for the Blind Based on Augmented Reality and Machine Learning

AI-based Wearable Vision Assistance System for the Visually Impaired: Integrating Real-Time Object Recognition and Contextual Understanding Using Large Vision-Language Models

An Assistive Low-Vision Platform That Augments Spatial Cognition Through Proprioceptive Guidance: Point-to-Tell-and-Touch

VisBuddy -- A Smart Wearable Assistant for the Visually Challenged

Sensing and Navigation of Wearable Assistance Cognitive Systems for the Visually Impaired

Smart Glass System Using Deep Learning for the Blind and Visually Impaired

Embedded Computer Vision for Object Recognition in Smart Devices for the Blind

Efficient Multi-Object Detection and Smart Navigation Using Artificial Intelligence for Visually Impaired People

When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition