Confidence Weighting for Robust Automated Measurements of Popliteal Vessel Wall Magnetic Resonance Imaging
Daniel S. Hippe,Niranjan Balu,Li Chen,Gádor Cantón,Wenjin Liu,Hiroko Watase,John C. Waterton,Thomas S. Hatsukami,Jenq‐Neng Hwang,Chun Yuan
DOI: https://doi.org/10.1161/circgen.119.002870
2020-01-01
Circulation Genomic and Precision Medicine
Abstract:HomeCirculation: Genomic and Precision MedicineVol. 13, No. 1Confidence Weighting for Robust Automated Measurements of Popliteal Vessel Wall Magnetic Resonance Imaging Free AccessLetterPDF/EPUBAboutView PDFView EPUBSections ToolsAdd to favoritesDownload citationsTrack citationsPermissions ShareShare onFacebookTwitterLinked InMendeleyReddit Jump toFree AccessLetterPDF/EPUBConfidence Weighting for Robust Automated Measurements of Popliteal Vessel Wall Magnetic Resonance Imaging Daniel S. Hippe, MS, Niranjan Balu, PhD, Li Chen, BS, Gador Canton, PhD, Wenjin Liu, MD, PhD, Hiroko Watase, MD, MPH, John C. Waterton, PhD, Thomas S. Hatsukami, MD, Jenq-Neng Hwang, PhD and Chun Yuan, PhD Daniel S. HippeDaniel S. Hippe Department of Radiology (D.S.H., N.B., G.C., W.L., C.Y.), University of Washington, Seattle. , Niranjan BaluNiranjan Balu Department of Radiology (D.S.H., N.B., G.C., W.L., C.Y.), University of Washington, Seattle. , Li ChenLi Chen Department of Electrical and Computer Engineering (L.C., J.-N.H.), University of Washington, Seattle. , Gador CantonGador Canton Department of Radiology (D.S.H., N.B., G.C., W.L., C.Y.), University of Washington, Seattle. , Wenjin LiuWenjin Liu Department of Radiology (D.S.H., N.B., G.C., W.L., C.Y.), University of Washington, Seattle. , Hiroko WataseHiroko Watase Division of Vascular Surgery, Department of Surgery (H.W., T.S.H.), University of Washington, Seattle. , John C. WatertonJohn C. Waterton Centre for Imaging Sciences, Division of Informatics Imaging & Data Sciences, School of Health Sciences, Faculty of Biology Medicine & Health, Manchester Academic Health Sciences Centre, The University of Manchester, Manchester, United Kingdom. (J.C.W.). , Thomas S. HatsukamiThomas S. Hatsukami Division of Vascular Surgery, Department of Surgery (H.W., T.S.H.), University of Washington, Seattle. , Jenq-Neng HwangJenq-Neng Hwang Department of Electrical and Computer Engineering (L.C., J.-N.H.), University of Washington, Seattle. and Chun YuanChun Yuan Correspondence to: Chun Yuan, PhD, Department of Radiology, University of Washington, 850 Republican St, Seattle, WA 98109, Email E-mail Address: [email protected] or Daniel S. Hippe, MS, University of Washington, Seattle, WA, Email E-mail Address: [email protected] Department of Radiology (D.S.H., N.B., G.C., W.L., C.Y.), University of Washington, Seattle. Originally published12 Jan 2020https://doi.org/10.1161/CIRCGEN.119.002870Circulation: Genomic and Precision Medicine. 2020;13:e002870Other version(s) of this articleYou are viewing the most recent version of this article. Previous versions: January 13, 2020: Ahead of Print We recently introduced a novel approach to assessing atherosclerosis: popliteal artery wall analysis from knee magnetic resonance imaging.1 Specifically, the OAI (Osteoarthritis Initiative) is a multicenter, prospective cohort study of knee osteoarthritis (NCT00080171) acquiring multiple biomarkers longitudinally in 4796 subjects for a decade, including serial high-resolution 3-dimensional double-echo steady-state magnetic resonance imaging of the knee.2 The popliteal artery wall is well seen in these high-quality MR images, allowing quantitative assessment of atherosclerotic progression/regression. However, the large number of images poses a formidable challenge. Manual segmentation of 1 knee/artery across 60 axial slices takes about 3 to 4 hours for an expert human reader, so around 2 decades of continuous effort would be needed to manually segment all 3 million slices in the OAI database.To address this, we developed a fully automated deep learning–based algorithm called fully automated and robust analysis technique for popliteal artery evaluation (FRAPPE) to segment and quantify the popliteal artery wall.3 Institutional review boards approved the Health Insurance Portability and Accountability Act-compliant OAI study protocol, and all participants provided written informed consent. Anonymized OAI questionnaire and MR imaging data are publicly available at https://nda.nih.gov/oai/. The additional data that support the findings of this study are available from the corresponding author on reasonable request.FRAPPE reduced the segmentation time from 4 hours to 8 minutes on graphical processing unit–equipped high-performance environments such as the American Heart Association Precision Medicine Platform or equivalent workstations. Segmentation quality is generally good, with only occasional discrepancies due to image quality and the overall complexity of the case. For example, segmentation may be impacted by incomplete blood suppression, nonuniform fat suppression, complicated bifurcations/trifurcations/branches, and the presence of adjacent vein, which may resemble the artery. We require that our findings not be confounded by these aberrant images, but unfortunately, the large total number of images precludes checking and revising segmentations manually. We, therefore, seek an objective, unbiased, and fully automatic method to minimize the contribution of poor segmentations to the conclusions. Here, we employ confidence weights from FRAPPE's own internal assessment during subsequent statistical analysis.FRAPPE provides 2 outputs for each cross-sectional image: a map of the probability that each image pixel is artery wall; and pixel locations of lumen and outer wall contours. FRAPPE segmentation confidence is derived from these 2 outputs by summing the artery wall pixel probabilities within the artery wall contours (Pin) and outside of the artery wall (Pout), then dividing (Pin−Pout) by the number of pixels within the artery wall contours. The FRAPPE segmentation confidence is maximally 1 (highest confidence) when all pixels within the artery wall contours have probability 1 and all others have probability 0. However, FRAPPE segmentation confidence can be <0 when segmentation confidence is particularly low (Pin0.7. The overall coefficients of variation for repeatability of mean wall thickness and mean lumen area were 4.7% and 4.6%, respectively. After applying weighting, the overall coefficients of variation decreased to 4.0% and 4.3%, respectively—a 14% to 16% improvement. When grouped by ALW (Figure), the 2 lowest confidence groups showed the most improvement.Download figureDownload PowerPointFigure. Repeatability of fully automated and robust analysis technique for popliteal artery evaluation artery wall segmentation before and after weighting.A, Absolute, unweighted difference in mean lumen area (MLA) between repeated knee magnetic resonance imaging (MRI; 6-mo interval), grouped by confidence weights. The repeatability coefficient of variation (CoV) tended to decrease with increasing segmentation confidence and after applying statistical weights as described in the methods. B, Absolute, unweighted difference in mean wall thickness (MWT) between repeated knee MRI (6-mo interval), grouped by confidence weights. The repeatability CoV demonstrated similar patterns as for MLA.After applying confidence weights, FRAPPE scan-rescan coefficients of variation statistics for popliteal artery morphology measurements were similar to those from manual segmentation of carotid and intracranial arteries.4,5 This suggests that applying confidence weighting to automated FRAPPE measurements can improve measurement precision, allowing large-scale and reliable analyses of the OAI and similar cohorts. Coupled with the rich demographic, clinical, and lifestyle covariates collected over the follow-up period, this enables an in-depth assessment of popliteal plaque progression and related risk factors, providing a valuable opportunity to improve our understanding of the natural history of atherosclerosis. Automated FRAPPE segmentation and confidence weighting can be extended to other vascular beds and large-scale vessel wall magnetic resonance imaging studies for a comprehensive assessment of atherosclerosis.Sources of FundingThis project is funded by a grant from the American Heart Association to Dr Yuan (18AIML34280043). The OAI (Osteoarthritis Initiative) is a public-private partnership comprised of 5 contracts (N01-AR-2-2258, N01-AR-2-2259, N01-AR-2-2260, N01-AR-2-2261, and N01-AR-2-2262) funded by the National Institutes of Health (NIH)—a branch of the Department of Health and Human Services—and conducted by the OAI Study Investigators. Private funding partners include Merck Research Laboratories; Novartis Pharmaceuticals Corporation, GlaxoSmithKline; and Pfizer, Inc. Private sector funding for the OAI is managed by the Foundation for the NIH. This article was prepared using an OAI public use data set and does not necessarily reflect the opinions or views of the OAI investigators, the NIH, or the private funding partners. We also gratefully acknowledge the support of the Nvidia Corporation for donating graphical processing units used in the course of this study.DisclosuresD.S. Hippe reports research grants from GE Healthcare, Philips Healthcare, Toshiba American Medical Systems, and Siemens Medical Solutions USA, outside the submitted work. Dr Waterton reports compensation from Bioxydyn, Ltd, outside the submitted work. The other authors report no conflicts.FootnotesWinner of the AHA Institute for Precision Cardiovascular Medicine grant competition sponsored by Amazon Web Services (AWS) and Circulation: Genomic and Precision Medicine Journal prize presented at AHA Scientific Sessions November 2019.*D.S. Hippe and Dr Balu contributed equally to this work as first authors.For Sources of Funding and Disclosures, see page 41.Correspondence to: Chun Yuan, PhD, Department of Radiology, University of Washington, 850 Republican St, Seattle, WA 98109, Email [email protected]edu or Daniel S. Hippe, MS, University of Washington, Seattle, WA, Email [email protected]eduReferences1. Liu W, Balu N, Canton G, Hippe DS, Watase H, Waterton JC, Hatsukami T, Yuan C. Understanding atherosclerosis through an osteoarthritis data set.Arterioscler Thromb Vasc Biol. 2019; 39:1018–1025. doi: 10.1161/ATVBAHA.119.312513LinkGoogle Scholar2. Fawaz-Estrup F. The Osteoarthritis Initiative: an overview.Med Health R I. 2004; 87:169–171.MedlineGoogle Scholar3. Chen L, et al. Automated artery localization and vessel wall segmentation of magnetic resonance vessel wall images using tracklet refinement and polar conversion.arXiv.Google Scholar4. Sun J, Zhao XQ, Balu N, Hippe DS, Hatsukami TS, Isquith DA, Yamada K, Neradilek MB, Cantón G, Xue Y, et al. Carotid magnetic resonance imaging for monitoring atherosclerotic plaque progression: a multicenter reproducibility study.Int J Cardiovasc Imaging. 2015; 31:95–103. doi: 10.1007/s10554-014-0532-7CrossrefMedlineGoogle Scholar5. Chen L, Liu Q, Shi Z, Tian X, Peng W, Lu J. Interstudy reproducibility of dark blood high-resolution MRI in evaluating basilar atherosclerotic plaque at 3 Tesla.Diagn Interv Radiol. 2018; 24:237–242. doi: 10.5152/dir.2018.17373CrossrefMedlineGoogle Scholar Previous Back to top Next FiguresReferencesRelatedDetailsCited ByFlores A, Demsas F, Leeper N and Ross E (2021) Leveraging Machine Learning and Artificial Intelligence to Improve Peripheral Artery Disease Detection, Treatment, and Outcomes, Circulation Research, 128:12, (1833-1850), Online publication date: 11-Jun-2021.Canton G, Hippe D, Chen L, Waterton J, Liu W, Watase H, Balu N, Sun J, Hatsukami T and Yuan C (2021) Atherosclerotic Burden and Remodeling Patterns of the Popliteal Artery as Detected in the Magnetic Resonance Imaging Osteoarthritis Initiative Data Set, Journal of the American Heart Association, 10:11, Online publication date: 1-Jun-2021. February 2020Vol 13, Issue 1 Advertisement Article InformationMetrics © 2020 American Heart Association, Inc.https://doi.org/10.1161/CIRCGEN.119.002870PMID: 31928231 Originally publishedJanuary 12, 2020 Keywordsstatisticsartificial intelligenceatherosclerosisdeep learningmagnetic resonance imagingperipheral artery diseasePDF download Advertisement SubjectsAtherosclerosisCardiovascular DiseaseMachine Learning and Artificial IntelligenceMagnetic Resonance Imaging (MRI)Peripheral Vascular DiseaseRisk Factors