Empowering individuals with disabilities: a real-time, cost-effective, calibration-free assistive system utilizing eye tracking
Govind Ram Chhimpa,Ajay Kumar,Sunita Garhwal,Dhiraj
DOI: https://doi.org/10.1007/s11554-024-01478-w
IF: 2.293
2024-05-21
Journal of Real-Time Image Processing
Abstract:Recent innovations in real-time eye-tracking technology enhance accessibility, offering individuals with disabilities effective computer engagement. This study presents a cost-effective, calibration-free, eye-controlled system comprising two phases: scaling and feature extraction, followed by coordinate mapping. In the first phase, the MediaPipe framework extracts features, and scaling adapts to the display size. The second phase computes parameters for accurate mapping between the user's iris and screen coordinates. MediaPipe's pre-trained models and optimized architecture improve system efficiency and real-time performance, reducing the need for extensive dataset training. Adaptive scaling and iris detection optimizations enhance computational efficiency and responsiveness in real-time applications. The system is budget friendly, costing $100 or less, with a user-friendly Graphical User Interface (GUI) meeting essential daily requirements for individuals with disabilities. A total of 30 participants have been recruited for system testing, including disabled and non-disabled. The system takes an average of 0.0492127 s to process a frame while video acquisition, face and facial features tracking, and iris plotting on screen take 0.0333667, 0.0086365, and 0.0082976 s per frame, respectively. The system has achieved a mean typing speed of 21.7 and 15.8 CPM (characters per minute) for non-disabled and disabled participants, respectively. In addition, the system has demonstrated an average pixel accuracy of 25.2 pixels for non-disabled individuals and 29.32 pixels for disabled individuals. A system usability test exclusively involving disabled participants yielded promising results, with an average score of 90.6. The proposed eye-controlled system operates in real time, showcasing its responsiveness and effectiveness in enhancing computer accessibility for individuals with limited mobility or disabilities.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology