Abstract:Purpose To evaluate the diagnostic efficacy of a developed artificial intelligence (AI) platform incorporating deep learning algorithms for the automated detection of intracranial aneurysms in time-of-flight (TOF) magnetic resonance angiography (MRA). Method This retrospective study encompassed 3D TOF MRA images acquired between January 2023 and June 2023, aiming to validate the presence of intracranial aneurysms via our developed AI platform. The manual segmentation results by experienced neuroradiologists served as the "gold standard". Following annotation of MRA images by neuroradiologists using InferScholar software, the AI platform conducted automatic segmentation of intracranial aneurysms. Various metrics including accuracy (ACC), balanced ACC, area under the curve (AUC), sensitivity (SE), specificity (SP), F1 score, Brier Score, and Net Benefit were utilized to evaluate the generalization of AI platform. Comparison of intracranial aneurysm identification performance was conducted between the AI platform and six radiologists with experience ranging from 3 to 12 years in interpreting MR images. Additionally, a comparative analysis was carried out between radiologists' detection performance based on independent visual diagnosis and AI-assisted diagnosis. Subgroup analyses were also performed based on the size and location of the aneurysms to explore factors impacting aneurysm detectability. Results 510 patients were enrolled including 215 patients (42.16 %) with intracranial aneurysms and 295 patients (57.84 %) without aneurysms. Compared with six radiologists, the AI platform showed competitive discrimination power (AUC, 0.96), acceptable calibration (Brier Score loss, 0.08), and clinical utility (Net Benefit, 86.96 %). The AI platform demonstrated superior performance in detecting aneurysms with an overall SE, SP, ACC, balanced ACC, and F1 score of 91.63 %, 92.20 %, 91.96 %, 91.92 %, and 90.57 % respectively, outperforming the detectability of the two resident radiologists. For subgroup analysis based on aneurysm size and location, we observed that the SE of the AI platform for identifying tiny (diameter<3mm), small (3 mm ≤ diameter<5mm), medium (5 mm ≤ diameter<7mm) and large aneurysms (diameter ≥ 7 mm) was 87.80 %, 93.14 %, 95.45 %, and 100 %, respectively. Furthermore, the SE for detecting aneurysms in the anterior circulation was higher than that in the posterior circulation. Utilizing the AI assistance, six radiologists (i.e., two residents, two attendings and two professors) achieved statistically significant improvements in mean SE (residents: 71.40 % vs. 88.37 %; attendings: 82.79 % vs. 93.26 %; professors: 90.07 % vs. 97.44 %; P < 0.05) and ACC (residents: 85.29 % vs. 94.12 %; attendings: 91.76 % vs. 97.06 %; professors: 95.29 % vs. 98.82 %; P < 0.05) while no statistically significant change was observed in SP. Overall, radiologists' mean SE increased by 11.40 %, mean SP increased by 1.86 %, and mean ACC increased by 5.88 %, mean balanced ACC promoted by 6.63 %, mean F1 score grew by 7.89 %, and Net Benefit rose by 12.52 %, with a concurrent decrease in mean Brier score declined by 0.06. Conclusions The deep learning algorithms implemented in the AI platform effectively detected intracranial aneurysms on TOF-MRA and notably enhanced the diagnostic capabilities of radiologists. This indicates that the AI-based auxiliary diagnosis model can provide dependable and precise prediction to improve the diagnostic capacity of radiologists.

Automated detection of large vessel occlusion using deep learning: a pivotal multicenter study and reader performance study

Performance of An Automated Algorithm in Large and Medium Vessel Occlusion Detection: A Real-World Experience

Novel Prehospital Prediction Model of Large Vessel Occlusion Using Artificial Neural Network

Development and Validation of Automated Software for the Detection of Large Vessel Occlusion on Noncontrast CT

Automated identification of thrombectomy amenable vessel occlusion on computed tomography angiography using deep learning

Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic review

Multicenter validation of artificial intelligence software predicting large vessel occlusion using noncontrast brain CT

Deep learning-assisted diagnosis of large vessel occlusion in acute ischemic stroke based on four-dimensional computed tomography angiography

Prediction of large vessel occlusion for ischaemic stroke by using the machine learning model random forests

Artificial Intelligence for Large-Vessel Occlusion Stroke: A Systematic Review

Automated Prediction of Proximal Middle Cerebral Artery Occlusions in Noncontrast Brain Computed Tomography

The Impact of Artificial Intelligence on Large Vessel Occlusion Stroke Detection and Management: A Systematic Review Meta-analysis

A Deep-Learning Model for Intracranial Aneurysm Detection on CT Angiography Images in China: a Stepwise, Multicentre, Early-Stage Clinical Validation Study

Hyperdense Artery Sign in Patients With Acute Ischemic Stroke-Automated Detection With Artificial Intelligence-Driven Software

Artificial Intelligence in the Diagnosis of Cerebrovascular Diseases Using Magnetic Resonance Imaging: A Scoping Review

Detection and segmentation of hyperdense middle cerebral artery sign on non-contrast CT using artificial intelligence

Abstract WMP66: Detecting Medium Vessel Occlusions and Collateral Assessment With Multimodality AI Approach

A deep learning method to identify and localize large‐vessel occlusions from cerebral digital subtraction angiography

Automated detection of intracranial artery stenosis and occlusion in magnetic resonance angiography: A preliminary study based on deep learning

Utility of automated CT perfusion software in acute ischemic stroke with large and medium vessel occlusion

Deep learning-based platform performs high detection sensitivity of intracranial aneurysms in 3D brain TOF-MRA: An external clinical validation study