Translating ethical and quality principles for the effective, safe and fair development, deployment and use of artificial intelligence technologies in healthcare
Nicoleta J Economou-Zavlanos,Sophia Bessias,Michael P Cary,Armando D Bedoya,Benjamin A Goldstein,John E Jelovsek,Cara L O’Brien,Nancy Walden,Matthew Elmore,Amanda B Parrish,Scott Elengold,Kay S Lytle,Suresh Balu,Michael E Lipkin,Afreen Idris Shariff,Michael Gao,David Leverenz,Ricardo Henao,David Y Ming,David M Gallagher,Michael J Pencina,Eric G Poon
DOI: https://doi.org/10.1093/jamia/ocad221
2023-11-29
Journal of the American Medical Informatics Association
Abstract:Abstract Objective The complexity and rapid pace of development of algorithmic technologies pose challenges for their regulation and oversight in healthcare settings. We sought to improve our institution’s approach to evaluation and governance of algorithmic technologies used in clinical care and operations by creating an Implementation Guide that standardizes evaluation criteria so that local oversight is performed in an objective fashion. Materials and Methods Building on a framework that applies key ethical and quality principles (clinical value and safety, fairness and equity, usability and adoption, transparency and accountability, and regulatory compliance), we created concrete guidelines for evaluating algorithmic technologies at our institution. Results An Implementation Guide articulates evaluation criteria used during review of algorithmic technologies and details what evidence supports the implementation of ethical and quality principles for trustworthy health AI. Application of the processes described in the Implementation Guide can lead to algorithms that are safer as well as more effective, fair, and equitable upon implementation, as illustrated through 4 examples of technologies at different phases of the algorithmic lifecycle that underwent evaluation at our academic medical center. Discussion By providing clear descriptions/definitions of evaluation criteria and embedding them within standardized processes, we streamlined oversight processes and educated communities using and developing algorithmic technologies within our institution. Conclusions We developed a scalable, adaptable framework for translating principles into evaluation criteria and specific requirements that support trustworthy implementation of algorithmic technologies in patient care and healthcare operations.
information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics