Reporting Risks in AI-based Assistive Technology Research: A Systematic Review

Zahra Ahmadi,Peter R. Lewis,Mahadeo A. Sukhai
2024-07-19
Abstract:Artificial Intelligence (AI) is increasingly employed to enhance assistive technologies, yet it can fail in various ways. We conducted a systematic literature review of research into AI-based assistive technology for persons with visual impairments. Our study shows that most proposed technologies with a testable prototype have not been evaluated in a human study with members of the sight-loss community. Furthermore, many studies did not consider or report failure cases or possible risks. These findings highlight the importance of inclusive system evaluations and the necessity of standardizing methods for presenting and analyzing failure cases and threats when developing AI-based assistive technologies.
Human-Computer Interaction,Artificial Intelligence
What problem does this paper attempt to address?
The paper attempts to address the issue of insufficient reporting on risks and failure cases in the application of Artificial Intelligence (AI) assistive technologies for visually impaired individuals. Specifically, the research finds that although most proposed technologies have testable prototypes, they have not been evaluated through human studies within the visually impaired community. Additionally, many studies do not consider or report failure cases or potential risks. These findings highlight the importance of inclusive system evaluation and the necessity of standardizing the presentation and analysis of failure cases and threat methods when developing AI-based assistive technologies. Through a systematic literature review, the paper analyzes existing research on the introduction of AI assistive technologies to identify if there are defined gaps and to explore how to investigate, evaluate, and report failures and risks in AI assistive technology research. The results indicate that most studies lack real-world assessments of the target user group, and few studies provide detailed reports on system failures and their potential consequences. This further emphasizes the need for greater attention to risk assessment and reporting in AI assistive technologies.