Establishing a Validation Infrastructure for Imaging-Based AI Algorithms Prior to Clinical Implementation

Ojas A. Ramwala,Kathryn P. Lowry,Nathan M. Cross,William Hsu,Christopher C. Austin,Sean D. Mooney,Christoph I. Lee
DOI: https://doi.org/10.1016/j.jacr.2024.04.027
IF: 6.24
2024-05-25
Journal of the American College of Radiology
Abstract:With promising Artificial Intelligence (AI) algorithms receiving FDA (Food and Drug Administration) clearance, the potential impact of these models on clinical outcomes must be evaluated locally before their integration into routine workflows. Robust validation infrastructures are pivotal to inspecting the accuracy and generalizability of these deep learning algorithms to ensure both patient safety and health equity. Protected Health Information (PHI) concerns, intellectual property rights, and diverse requirements of models impede the development of rigorous external validation infrastructures. Our work proposes various suggestions for addressing the challenges associated with the development of efficient, customizable, and cost-effective infrastructures for the external validation of AI models at large medical centers and institutions. We present comprehensive steps to establish an AI inferencing infrastructure outside clinical systems to examine the local performance of AI algorithms before health practice- or system-wide implementation and promote an evidence-based approach for adopting AI models that can enhance radiology workflows and improve patient outcomes.
radiology, nuclear medicine & medical imaging
What problem does this paper attempt to address?