An Intelligent Assistive System Based on Augmented Reality and Internet of Things for Patients with Alzheimer's Disease

Fatemeh Ghorbani
DOI: https://doi.org/10.13140/RG.2.2.22048.30728
2024-02-21
Abstract:Independent life of the individuals suffering from Alzheimer's disease (AD) is compromised due to their memory loss. As a result, they depend on others to help them lead their daily life. In this situation, either the family members or the caregivers offer their help; they attach notes on every single object or take out the contents of a drawer to make those visible when they leave the patient alone. The aim of this thesis is to provide multi-level support and some helping means for AD patients and their family members through the integration of existing science and methods. This study reports results on an intelligent assistive (IA) system, achieved through the integration of Internet of Things (IoT), augmented reality (AR), and adaptive fuzzy decision-making methods. The proposed system has four main components; (1) a location and heading data stored in the local fog layer, (2) an AR device to make interactions with the AD patient, (3) a supervisory decision-maker to handle the direct and environmental interactions with the patient, (4) and a user interface for family or caregivers to monitor the patient's real-time situation and send reminders once required. The system operates in different modes, including automated and semi-automated. The first one helps the user complete the activities in their daily life by showing AR messages or making automatic changes. The second one allows manual changes after the real-time assessment of the user's cognitive state based on the AR game score. We provide further evidence that the accuracy, reliability and response time of the IA system are appropriate to be implemented in AD patients' homes. Moreover, the system response in the semi-automated mode causes less data loss than the automated mode, as the number of active devices decreases.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem this paper attempts to address is the impairment of independent living abilities faced by Alzheimer's Disease (AD) patients due to memory loss in their daily lives. Specifically, the paper aims to develop an Intelligent Assistive System (IA) by integrating the Internet of Things (IoT), Augmented Reality (AR) technology, and adaptive fuzzy decision-making methods to support Alzheimer's patients and their families at multiple levels. This Intelligent Assistive System has the following four main components: 1. **Location and Direction Data Storage**: Stores location and direction data in the local fog layer; 2. **Augmented Reality Device**: Interacts with Alzheimer's patients; 3. **Supervisory Decision Maker**: Handles direct and environmental interactions with the patient; 4. **User Interface**: Allows family members or caregivers to monitor the patient's real-time status and send reminders when needed. The system can operate in both automated and semi-automated modes. In automated mode, the system assists users in completing daily activities by displaying AR messages or making automatic changes; in semi-automated mode, it allows for manual changes after assessing the user's cognitive state. Additionally, the study found that playing audio information performs better and consumes less battery than displaying image information.