A real-world clinical validation for AI-based MRI monitoring in multiple sclerosis
Michael Barnett,Dongang Wang,Heidi Beadnall,Antje Bischof,David Brunacci,Helmut Butzkueven,J. William L. Brown,Mariano Cabezas,Tilak Das,Tej Dugal,Daniel Guilfoyle,Alexander Klistorner,Stephen Krieger,Kain Kyle,Linda Ly,Lynette Masters,Andy Shieh,Zihao Tang,Anneke van der Walt,Kayla Ward,Heinz Wiendl,Geng Zhan,Robert Zivadinov,Yael Barnett,Chenyu Wang
DOI: https://doi.org/10.1038/s41746-023-00940-6
IF: 15.2
2023-10-20
npj Digital Medicine
Abstract:Modern management of MS targets No Evidence of Disease Activity (NEDA): no clinical relapses, no magnetic resonance imaging (MRI) disease activity and no disability worsening. While MRI is the principal tool available to neurologists for monitoring clinically silent MS disease activity and, where appropriate, escalating treatment, standard radiology reports are qualitative and may be insensitive to the development of new or enlarging lesions. Existing quantitative neuroimaging tools lack adequate clinical validation. In 397 multi-center MRI scan pairs acquired in routine practice, we demonstrate superior case-level sensitivity of a clinically integrated AI-based tool over standard radiology reports (93.3% vs 58.3%), relative to a consensus ground truth, with minimal loss of specificity. We also demonstrate equivalence of the AI-tool with a core clinical trial imaging lab for lesion activity and quantitative brain volumetric measures, including percentage brain volume loss (PBVC), an accepted biomarker of neurodegeneration in MS (mean PBVC −0.32% vs −0.36%, respectively), whereas even severe atrophy (>0.8% loss) was not appreciated in radiology reports. Finally, the AI-tool additionally embeds a clinically meaningful, experiential comparator that returns a relevant MS patient centile for lesion burden, revealing, in our cohort, inconsistencies in qualitative descriptors used in radiology reports. AI-based image quantitation enhances the accuracy of, and value-adds to, qualitative radiology reporting. Scaled deployment of these tools will open a path to precision management for patients with MS.
health care sciences & services,medical informatics