AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People
Rakesh Chandra Joshi,Nitin Singh,Anuj Kumar Sharma,Radim Burget,Malay Kishore Dutta
DOI: https://doi.org/10.1109/thms.2024.3375655
2024-01-01
IEEE Transactions on Human-Machine Systems
Abstract:Visually impaired people (VIPs) encounter various challenges in their daily lives, and there is a need for portable, user-friendly device for real-time assistance to give them guidance regarding their surroundings. This article presents an artificial-intelligence-based innovative wearable assistive device—artificial intelligence (AI)-SenseVision—to analyze visual and sensory information about the objects and obstacles present in the scene to perceive the surrounding environment. The device is a complete amalgamation of sensor and computer-vision-based technologies that generate auditory information with the name of identified objects or audio warnings for detected obstacles. The performance of the trained deep-learning model is rigorously tested in complex and real-life scenarios using various statistical parameters for experimental validation. Moreover, the trained deep-learning models have been integrated into a low-cost single-board processor to make a standalone cost-effective device. All data processing is done within an optimized single hardware setup, and the user can easily access different modes, such as indoor and outdoor mode, while also enabling object counting in observed scenes. The proposed system has low-cost sensors, multiple operational modes, easy integration, and small volume, making this assistive device helpful for VIPs for independent navigation and collision prevention.
computer science, cybernetics, artificial intelligence