Abstract:Introduction In recent years, artificial intelligence (AI) in medical imaging has undergone unprecedented innovation and advancement, sparking a revolutionary transformation in healthcare. The field of radiology is particularly implicated, as clinical radiologists are expected to interpret an ever-increasing number of complex cases in record time. Machine learning software purchased by our institution is expected to help our radiologists come to a more prompt diagnosis by delivering point-of-care quantitative analysis of suspicious findings and streamlining clinical workflow. This paper explores AI's impact on neuroradiology, an area accounting for a substantial portion of recent radiology studies. We present a case series evaluating an AI software's performance in detecting neurovascular findings, highlighting five cases where AI interpretations differed from radiologists' assessments. Our study underscores common pitfalls of AI in the context of CT head angiograms, aiming to guide future AI algorithms. Methods We conducted a retrospective case series study at Stony Brook University Hospital, a large medical center in Stony Brook, New York, spanning from October 1, 2021 to December 31, 2021, analyzing 140 randomly sampled CT angiograms using AI software. This software assessed various neurovascular parameters, and AI findings were compared with neuroradiologists' interpretations. Five cases with divergent interpretations were selected for detailed analysis. Results Five representative cases in which AI findings were discordant with radiologists' interpretations are presented with diagnoses including diffuse anoxic ischemic injury, cortical laminar necrosis, colloid cyst, right superficial temporal artery-to-middle cerebral artery (STA-MCA) bypass, and subacute bilateral subdural hematomas. Discussion The errors identified in our case series expose AI's limitations in radiology. Our case series reveals that AI's incorrect interpretations can stem from complexities in pathology, challenges in distinguishing densities, inability to identify artifacts, identifying post-surgical changes in normal anatomy, sensitivity limitations, and insufficient pattern recognition. AI's potential for improvement lies in refining its algorithms to effectively recognize and differentiate pathologies. Incorporating more diverse training datasets, multimodal data, deep-reinforcement learning, clinical context, and real-time learning capabilities are some ways to improve AI's performance in the field of radiology. Conclusion Overall, it is apparent that AI applications in radiology have much room for improvement before becoming more widely integrated into clinical workflows. While AI demonstrates remarkable potential to aid in diagnosis and streamline workflows, our case series highlights common pitfalls that underscore the need for continuous improvement. By refining algorithms, incorporating diverse datasets, embracing multimodal information, and leveraging innovative machine learning strategies, AI's diagnostic accuracy can be significantly improved.

Generalization of Artificial Intelligence Models in Medical Imaging: A Case-Based Review

Artificial intelligence and machine learning for medical imaging: A technology review

Rogue AI: Cautionary Cases in Neuroradiology and What We Can Learn From Them

AI applications to medical images: From machine learning to deep learning

Evaluating artificial intelligence for medical imaging: a primer for clinicians

Breathing Life Into Artificial Intelligence*

Applications and challenges of artificial intelligence in diagnostic and interventional radiology

Interpretable artificial intelligence in radiology and radiation oncology

Artificial General Intelligence for Medical Imaging Analysis

Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging

Bias in artificial intelligence for medical imaging: fundamentals, detection, avoidance, mitigation, challenges, ethics, and prospects

The Evolution of Artificial Intelligence in Medical Imaging: From Computer Science to Machine and Deep Learning

Overview of Noninterpretive Artificial Intelligence Models for Safety, Quality, Workflow, and Education Applications in Radiology Practice

Key concepts, common pitfalls, and best practices in artificial intelligence and machine learning: focus on radiomics

Artificial Intelligence in Diagnostic Imaging: Status Quo, Challenges, and Future Opportunities

Radiology artificial intelligence: a systematic review and evaluation of methods (RAISE)

Potential strength and weakness of artificial intelligence integration in emergency radiology: a review of diagnostic utilizations and applications in patient care optimization

Artificial Intelligence in Medical Diagnosis: Methods, Algorithms and Applications

Interpretation of Artificial Intelligence Models in Healthcare

Engineering and clinical use of artificial intelligence (AI) with machine learning and data science advancements: radiology leading the way for future

Clinical, Cultural, Computational, and Regulatory Considerations to Deploy AI in Radiology: Perspectives of RSNA and MICCAI Experts