Severity and Consolidation Quantification of COVID-19 From CT Images Using Deep Learning Based on Hybrid Weak Labels
Dufan Wu,Kuang Gong,Chiara Daniela Arru,Fatemeh Homayounieh,Bernardo Bizzo,Varun Buch,Hui Ren,Kyungsang Kim,Nir Neumark,Pengcheng Xu,Zhiyuan Liu,Wei Fang,Nuobei Xie,Won Young Tak,Soo Young Park,Yu Rim Lee,Min Kyu Kang,Jung Gil Park,Alessandro Carriero,Luca Saba,Mahsa Masjedi,Hamidreza Talari,Rosa Babaei,Hadi Karimi Mobin,Shadi Ebrahimian,Ittai Dayan,Mannudeep K. Kalra,Quanzheng Li
DOI: https://doi.org/10.1109/jbhi.2020.3030224
IF: 7.7
2020-12-01
IEEE Journal of Biomedical and Health Informatics
Abstract:Early and accurate diagnosis of Coronavirus disease (COVID-19) is essential for patient isolation and contact tracing so that the spread of infection can be limited. Computed tomography (CT) can provide important information in COVID-19, especially for patients with moderate to severe disease as well as those with worsening cardiopulmonary status. As an automatic tool, deep learning methods can be utilized to perform semantic segmentation of affected lung regions, which is important to establish disease severity and prognosis prediction. Both the extent and type of pulmonary opacities help assess disease severity. However, manually pixel-level multi-class labelling is time-consuming, subjective, and non-quantitative. In this article, we proposed a hybrid weak label-based deep learning method that utilize both the manually annotated pulmonary opacities from COVID-19 pneumonia and the patient-level disease-type information available from the clinical report. A UNet was firstly trained with semantic labels to segment the total infected region. It was used to initialize another UNet, which was trained to segment the consolidations with patient-level information using the Expectation-Maximization (EM) algorithm. To demonstrate the performance of the proposed method, multi-institutional CT datasets from Iran, Italy, South Korea, and the United States were utilized. Results show that our proposed method can predict the infected regions as well as the consolidation regions with good correlation to human annotation.
computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems