Abstract:Purpose To evaluate the diagnostic efficacy of a developed artificial intelligence (AI) platform incorporating deep learning algorithms for the automated detection of intracranial aneurysms in time-of-flight (TOF) magnetic resonance angiography (MRA). Method This retrospective study encompassed 3D TOF MRA images acquired between January 2023 and June 2023, aiming to validate the presence of intracranial aneurysms via our developed AI platform. The manual segmentation results by experienced neuroradiologists served as the "gold standard". Following annotation of MRA images by neuroradiologists using InferScholar software, the AI platform conducted automatic segmentation of intracranial aneurysms. Various metrics including accuracy (ACC), balanced ACC, area under the curve (AUC), sensitivity (SE), specificity (SP), F1 score, Brier Score, and Net Benefit were utilized to evaluate the generalization of AI platform. Comparison of intracranial aneurysm identification performance was conducted between the AI platform and six radiologists with experience ranging from 3 to 12 years in interpreting MR images. Additionally, a comparative analysis was carried out between radiologists' detection performance based on independent visual diagnosis and AI-assisted diagnosis. Subgroup analyses were also performed based on the size and location of the aneurysms to explore factors impacting aneurysm detectability. Results 510 patients were enrolled including 215 patients (42.16 %) with intracranial aneurysms and 295 patients (57.84 %) without aneurysms. Compared with six radiologists, the AI platform showed competitive discrimination power (AUC, 0.96), acceptable calibration (Brier Score loss, 0.08), and clinical utility (Net Benefit, 86.96 %). The AI platform demonstrated superior performance in detecting aneurysms with an overall SE, SP, ACC, balanced ACC, and F1 score of 91.63 %, 92.20 %, 91.96 %, 91.92 %, and 90.57 % respectively, outperforming the detectability of the two resident radiologists. For subgroup analysis based on aneurysm size and location, we observed that the SE of the AI platform for identifying tiny (diameter<3mm), small (3 mm ≤ diameter<5mm), medium (5 mm ≤ diameter<7mm) and large aneurysms (diameter ≥ 7 mm) was 87.80 %, 93.14 %, 95.45 %, and 100 %, respectively. Furthermore, the SE for detecting aneurysms in the anterior circulation was higher than that in the posterior circulation. Utilizing the AI assistance, six radiologists (i.e., two residents, two attendings and two professors) achieved statistically significant improvements in mean SE (residents: 71.40 % vs. 88.37 %; attendings: 82.79 % vs. 93.26 %; professors: 90.07 % vs. 97.44 %; P < 0.05) and ACC (residents: 85.29 % vs. 94.12 %; attendings: 91.76 % vs. 97.06 %; professors: 95.29 % vs. 98.82 %; P < 0.05) while no statistically significant change was observed in SP. Overall, radiologists' mean SE increased by 11.40 %, mean SP increased by 1.86 %, and mean ACC increased by 5.88 %, mean balanced ACC promoted by 6.63 %, mean F1 score grew by 7.89 %, and Net Benefit rose by 12.52 %, with a concurrent decrease in mean Brier score declined by 0.06. Conclusions The deep learning algorithms implemented in the AI platform effectively detected intracranial aneurysms on TOF-MRA and notably enhanced the diagnostic capabilities of radiologists. This indicates that the AI-based auxiliary diagnosis model can provide dependable and precise prediction to improve the diagnostic capacity of radiologists.

DSA Image Analysis of Clinical Features and Nursing Care of Cerebral Aneurysm Patients Based on the Deep Learning Algorithm

Fully Automatic Deep Learning Trained on Limited Data for Carotid Artery Segmentation from Large Image Volumes

A Deep-Learning Model for Intracranial Aneurysm Detection on CT Angiography Images in China: a Stepwise, Multicentre, Early-Stage Clinical Validation Study

A Deep Learning-Based Automatic System for Intracranial Aneurysms Diagnosis on Three-Dimensional Digital Subtraction Angiographic Images.

Deep Learning for Detection of Intracranial Aneurysms from Computed Tomography Angiography Images

Deep Learning for Detecting Cerebral Aneurysms with CT Angiography.

Deep Learning for Automated Cerebral Aneurysm Detection on Computed Tomography Images.

A deep learning algorithm may automate intracranial aneurysm detection on MR angiography with high diagnostic performance

Fully automated intracranial aneurysm detection and segmentation from digital subtraction angiography series using an end-to-end spatiotemporal deep neural network

Deep learning for intracranial aneurysm segmentation using CT angiography

A clinically applicable deep-learning model for detecting intracranial aneurysm in computed tomography angiography images

An Automatic Detection Method Of Cerebral Aneurysms In Time-Of-Flight Magnetic Resonance Angiography Images Based On Attention 3D U-Net

Enhancing Radiologists' Performance in Detecting Cerebral Aneurysms Using a Deep Learning Model: A Multicenter Study

A Deep Learning Framework for Intracranial Aneurysms Automatic Segmentation and Detection on Magnetic Resonance T1 Images

Automatic detection on intracranial aneurysm from digital subtraction angiography with cascade convolutional neural networks

Diagnosis of intracranial aneurysms by computed tomography angiography using deep learning-based detection and segmentation

Deep Learning-Based Magnetic Resonance Imaging in Diagnosis and Treatment of Intracranial Aneurysm

Deep learning-based platform performs high detection sensitivity of intracranial aneurysms in 3D brain TOF-MRA: An external clinical validation study

Automated anatomical labeling of the intracranial arteries via deep learning in computed tomography angiography

756 A 3D Deep-learning Based Algorithm for Cerebral Vessel and Aneurysm Segmentation From CTA Images

Evaluating a 3D deep learning pipeline for cerebral vessel and intracranial aneurysm segmentation from computed tomography angiography-digital subtraction angiography image pairs.