External Validation of Fully-Automated Infrarenal Maximum Aortic Aneurysm Diameter Measurements in Computed Tomography Angiography Scans Using Artificial Intelligence (PRAEVAorta 2)

Johannes Hatzl,Christian Uhl,Alexandru Barb,Daniel Henning,Jonathan Fiering,Edris El-Sanosy,Philippe W.M. Cuypers,Dittmar Böckler,Kak K Yeung,Bram Fioole,Eric Verhoeven,Athanasios Katsargyris,Geert Lauwers,Tilo Kölbel,Jan J Wever,Hans Van Overhagen,Randolph G Statius van Eps,Hugo T C Veger,Lukas C Van Dijk,Dierk Scheinert,Wouter Van den Eynde,Guido Rouhani,Barend M E Mees,Frank Vermassen,Hubert Schelzig
DOI: https://doi.org/10.1177/15266028241295563
IF: 2.6
2024-11-17
Journal of Endovascular Therapy
Abstract:Journal of Endovascular Therapy, Ahead of Print. Purpose:This study investigates the accuracy of fully-automated maximum aortic diameter measurements in abdominal aortic aneurysm (AAA) patients using artificial intelligence software (PRAEVAorta 2, Nurea, Bordeaux, France).Materials and Methods:This is a multicenter, retrospective validation study using prospectively collected data from the Zenith alpha for aneurysm Repair Registry (ZEPHYR). Automated measurements of PRAEVAorta 2 are compared with measurements of an internationally recognized core laboratory (Syntactx, New York, New York State). The reviewers at the core laboratory were measurement technologists trained to and utilizing established measurement standards, overseen by vascular surgeons and radiologists. The data set comprised 871 computed tomography angiography scans from the ZEPHYR registry with 347 patients who underwent endovascular aneurysm repair (EVAR) with the Zenith Alpha Endovascular Abdominal Graft (Cook Medical, Bloomington, Indiana) in Germany, Belgium, and The Netherlands between 2016 and 2019.Results:The analysis demonstrated excellent correlation of the measurements (r=0.97) with an intraclass correlation (ICC) of 0.972 (95% confidence interval [CI]=0.968-0.976) across all scans. For preoperative computed tomography (CT) scans, ICC was 0.953 (95% CI=0.941-0.963), and for postoperative scans, ICC was 0.979 (95% CI=0.975-0,983), respectively. In total, 95.4% of measurements were within the clinically acceptable range of 5 mm in absolute difference. In total, 10% of scans demonstrated obvious segmentation errors, mainly due to failure in detecting vessel segments (renal arteries, aortic bifurcation) or due to mis-detecting the outer border of the AAA (duodenum, inferior vena cava, aortic branches) and were excluded from the analysis.Conclusion:In this study, the maximum AAA diameter could be accurately measured fully-automatically by PRAEVAorta 2 (Nurea) in most cases demonstrating that artificial intelligence (AI) software could serve as an important adjunct for research and clinical practice. However, critical review of the generated reports by an experienced observer and cautious use is warranted to identify flawed segmentations.Clinical ImpactThis multicenter, retrospective validation study assessed the accuracy of fully-automated maximum infrarenal aortic aneurysm diameter measurements. It was demonstrated, that 95.4% of measurements were within the clinically acceptable range of 5 mm in absolute difference, positioning the software as a potential adjunct for clinical practice and research. It is also highlighted however, that critical review of the measurements is obligatory, due to a 10% segmentation error rate.
surgery,peripheral vascular disease
What problem does this paper attempt to address?