AIris: An AI-powered Wearable Assistive Device for the Visually Impaired

Dionysia Danai Brilli,Evangelos Georgaras,Stefania Tsilivaki,Nikos Melanitis,Konstantina Nikita

2024-08-10

Abstract:Assistive technologies for the visually impaired have evolved to facilitate interaction with a complex and dynamic world. In this paper, we introduce AIris, an AI-powered wearable device that provides environmental awareness and interaction capabilities to visually impaired users. AIris combines a sophisticated camera mounted on eyewear with a natural language processing interface, enabling users to receive real-time auditory descriptions of their surroundings. We have created a functional prototype system that operates effectively in real-world conditions. AIris demonstrates the ability to accurately identify objects and interpret scenes, providing users with a sense of spatial awareness previously unattainable with traditional assistive devices. The system is designed to be cost-effective and user-friendly, supporting general and specialized tasks: face recognition, scene description, text reading, object recognition, money counting, note-taking, and barcode scanning. AIris marks a transformative step, bringing AI enhancements to assistive technology, enabling rich interactions with a human-like feel.

Human-Computer Interaction,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper introduces a wearable assistive device driven by artificial intelligence called AIris, designed to provide environmental awareness and interaction capabilities for visually impaired individuals. Specifically, AIris aims to achieve the following goals by combining advanced cameras, natural language processing technology, and a series of machine learning models:

1. **Enhance Environmental Awareness**: AIris can recognize objects and scenes in the surrounding environment in real-time and provide voice feedback to the user, helping them better understand and navigate their space.

2. **Increase Independence in Daily Life**: With features such as facial recognition, text reading, currency counting, note-taking, and barcode scanning, AIris helps visually impaired individuals complete daily tasks more independently.

3. **Improve Social Interaction Experience**: AIris can recognize known individuals, making visually impaired individuals more comfortable in social settings.

4. **Provide a Cost-Effective Solution**: The system is designed with cost-effectiveness in mind, aiming to offer an affordable and practical assistive tool.

In summary, the main objective of this research is to develop an assistive device that can significantly improve the quality of life for visually impaired individuals by integrating artificial intelligence technology into a wearable device, thereby promoting their autonomy and safety in a complex and ever-changing world.