Accessibility evaluation of major assistive mobile applications available for the visually impaired

Saidarshan Bhagat,Padmaja Joshi,Avinash Agarwal,Shubhanshu Gupta
DOI: https://doi.org/10.52953/TNRV4696
2024-07-05
Abstract:People with visual impairments face numerous challenges in their daily lives, including mobility, access to information, independent living, and employment. Artificial Intelligence (AI) with Computer Vision (CV) has the potential to improve their daily lives, provide them with necessary independence, and it will also spawn new opportunities in education and employment. However, while many such AI/CV-based mobile applications are now available, these apps are still not the preferred choice amongst visually impaired persons and are generally limited to advanced users only, due to certain limitations. This study evaluates the challenges faced by visually impaired persons when using AI/CV-based mobile apps. Four popular AI/CV- based apps, namely Seeing AI, Supersense, Envision and Lookout, are assessed by blind and low-vision users. Hence these mobile applications are evaluated on a set of parameters, including generic parameters based on the Web Content Accessibility Guidelines (WCAG) and specific parameters related to mobile app testing. The evaluation not only focused on the guidelines but also on the feedback that was gathered from these users on parameters covering the apps' accuracy, response time, reliability, accessibility, privacy, energy efficiency and usability. The paper also identifies the areas of improvement in the development and innovation of these assistive apps. This work will help developers create better accessible AI-based apps for the visually impaired.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the usability of the major mobile assistive applications on the market for the visually impaired, and to identify the functional deficiencies and technical challenges encountered in the actual use of these applications. Specifically, the paper focuses on the following aspects: 1. **Accuracy**: Evaluate the accuracy of the application in recognizing printed text, handwritten text, scenes/objects, and currency under different lighting conditions. 2. **Performance**: Measure the response time of the application, that is, the time required to complete text, object, and currency recognition. 3. **Reliability**: Evaluate the ability of the application to generate consistent results by testing similar text, object, and currency recognition multiple times. 4. **Accessibility**: Evaluate the accessibility of the application for visually impaired users based on the principles of the Web Content Accessibility Guidelines (WCAG) - Perceivable, Operable, Understandable, Robust (POUR). 5. **Privacy and Security**: Review the privacy policy and data management strategy of the application, and check whether users have the right to delete or verify data. 6. **Compatibility**: Evaluate the compatibility of the application with various assistive technologies (such as screen readers and magnifiers). 7. **Energy Efficiency**: Evaluate the battery consumption of the application during use. 8. **Ease of Use**: Evaluate the friendliness of the application's user interface and navigation controls, including language options, help modules, and options to switch UI themes. By conducting a detailed evaluation of four popular AI/CV - assisted mobile applications (Seeing AI, Supersense, Envision, and Lookout), the paper aims to provide improvement suggestions for developers to develop assistive applications that are more in line with the needs of the visually impaired. This will not only help improve the user experience of these applications but also promote the realization of digital inclusion and sustainable development goals.