Diagnosis and prognosis of abnormal cardiac scintigraphy uptake suggestive of cardiac amyloidosis using artificial intelligence: a retrospective, international, multicentre, cross-tracer development and validation study
Clemens P Spielvogel,David Haberl,Katharina Mascherbauer,Jing Ning,Kilian Kluge,Tatjana Traub-Weidinger,Rhodri H Davies,Iain Pierce,Kush Patel,Thomas Nakuz,Adelina Göllner,Dominik Amereller,Maria Starace,Alice Monaci,Michael Weber,Xiang Li,Alexander R Haug,Raffaella Calabretta,Xiaowei Ma,Min Zhao,Julia Mascherbauer,Andreas Kammerlander,Christian Hengstenberg,Leon J Menezes,Roberto Sciagra,Thomas A Treibel,Marcus Hacker,Christian Nitsche
DOI: https://doi.org/10.1016/s2589-7500(23)00265-0
IF: 36.615
2024-03-22
The Lancet Digital Health
Abstract:Summary Background The diagnosis of cardiac amyloidosis can be established non-invasively by scintigraphy using bone-avid tracers, but visual assessment is subjective and can lead to misdiagnosis. We aimed to develop and validate an artificial intelligence (AI) system for standardised and reliable screening of cardiac amyloidosis-suggestive uptake and assess its prognostic value, using a multinational database of 99m Tc-scintigraphy data across multiple tracers and scanners. Methods In this retrospective, international, multicentre, cross-tracer development and validation study, 16 241 patients with 19 401 scans were included from nine centres: one hospital in Austria (consecutive recruitment Jan 4, 2010, to Aug 19, 2020), five hospital sites in London, UK (consecutive recruitment Oct 1, 2014, to Sept 29, 2022), two centres in China (selected scans from Jan 1, 2021, to Oct 31, 2022), and one centre in Italy (selected scans from Jan 1, 2011, to May 23, 2023). The dataset included all patients referred to whole-body 99m Tc-scintigraphy with an anterior view and all 99m Tc-labelled tracers currently used to identify cardiac amyloidosis-suggestive uptake. Exclusion criteria were image acquisition at less than 2 h ( 99m Tc-3,3-diphosphono-1,2-propanodicarboxylic acid, 99m Tc-hydroxymethylene diphosphonate, and 99m Tc-methylene diphosphonate) or less than 1 h ( 99m Tc-pyrophosphate) after tracer injection and if patients' imaging and clinical data could not be linked. Ground truth annotation was derived from centralised core-lab consensus reading of at least three independent experts (CN, TT-W, and JN). An AI system for detection of cardiac amyloidosis-associated high-grade cardiac tracer uptake was developed using data from one centre (Austria) and independently validated in the remaining centres. A multicase, multireader study and a medical algorithmic audit were conducted to assess clinician performance compared with AI and to evaluate and correct failure modes. The system's prognostic value in predicting mortality was tested in the consecutively recruited cohorts using cox proportional hazards models for each cohort individually and for the combined cohorts. Findings The prevalence of cases positive for cardiac amyloidosis-suggestive uptake was 142 (2%) of 9176 patients in the Austrian, 125 (2%) of 6763 patients in the UK, 63 (62%) of 102 patients in the Chinese, and 103 (52%) of 200 patients in the Italian cohorts. In the Austrian cohort, cross-validation performance showed an area under the curve (AUC) of 1·000 (95% CI 1·000–1·000). Independent validation yielded AUCs of 0·997 (0·993–0·999) for the UK, 0·925 (0·871–0·971) for the Chinese, and 1·000 (0·999–1·000) for the Italian cohorts. In the multicase multireader study, five physicians disagreed in 22 (11%) of 200 cases (Fleiss' kappa 0·89), with a mean AUC of 0·946 (95% CI 0·924–0·967), which was inferior to AI (AUC 0·997 [0·991–1·000], p=0·0040). The medical algorithmic audit demonstrated the system's robustness across demographic factors, tracers, scanners, and centres. The AI's predictions were independently prognostic for overall mortality (adjusted hazard ratio 1·44 [95% CI 1·19–1·74], p<0·0001). Interpretation AI-based screening of cardiac amyloidosis-suggestive uptake in patients undergoing scintigraphy was reliable, eliminated inter-rater variability, and portended prognostic value, with potential implications for identification, referral, and management pathways. Funding Pfizer.
medicine, general & internal,medical informatics