Abstract:Background and Objective: Coronavirus disease 2019 (COVID-19) is a highly contagious virus spreading all around the world. Deep learning has been adopted as an effective technique to aid COVID-19 detection and segmentation from computed tomography (CT) images. The major challenge lies in the inadequate public COVID-19 datasets. Recently, transfer learning has become a widely used technique that leverages the knowledge gained while solving one problem and applying it to a different but related problem. However, it remains unclear whether various non-COVID19 lung lesions could contribute to segmenting COVID-19 infection areas and how to better conduct this transfer procedure. This paper provides a way to understand the transferability of non-COVID19 lung lesions and a better strategy to train a robust deep learning model for COVID-19 infection segmentation. Methods: Based on a publicly available COVID-19 CT dataset and three public non-COVID19 datasets, we evaluate four transfer learning methods using 3D U-Net as a standard encoder-decoder method. i) We introduce the multi-task learning method to get a multi-lesion pre-trained model for COVID-19 infection. ii) We propose and compare four transfer learning strategies with various performance gains and training time costs. Our proposed Hybrid-encoder Learning strategy introduces a Dedicated-encoder and an Adapted-encoder to extract COVID-19 infection features and general lung lesion features, respectively. An attention-based Selective Fusion unit is designed for dynamic feature selection and aggregation. Results: Experiments show that trained with limited data, proposed Hybrid-encoder strategy based on multi-lesion pre-trained model achieves a mean DSC, NSD, Sensitivity, F1-score, Accuracy and MCC of 0.704, 0.735, 0.682, 0.707, 0.994 and 0.716, respectively, with better genetalization and lower over-fitting risks for segmenting COVID-19 infection. Conclusions: The results reveal the benefits of transferring knowledge from non-COVID19 lung lesions, and learning from multiple lung lesion datasets can extract more general features, leading to accurate and robust pre-trained models. We further show the capability of the encoder to learn feature representations of lung lesions, which improves segmentation accuracy and facilitates training convergence. In addition, our proposed Hybrid-encoder learning method incorporates transferred lung lesion features from non-COVID19 datasets effectively and achieves significant improvement. These findings promote new insights into transfer learning for COVID-19 CT image segmentation, which can also be further generalized to other medical tasks.

Computer Aided Diagnosis for COVID-19 in CT Images Utilizing Transfer Learning and Attention Mechanism

Computed Tomography–based COVID–19 Triage Through a Deep Neural Network Using Mask–weighted Global Average Pooling

An Effective Deep Neural Network for Lung Lesions Segmentation From COVID-19 CT Images

MSD-Net: Multi-Scale Discriminative Network for COVID-19 Lung Infection Segmentation on CT

Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images

Auxiliary Diagnosis for COVID-19 with Deep Transfer Learning

D2A U-Net: Automatic segmentation of COVID-19 CT slices based on dual attention and hybrid dilated convolution

D2A U-Net: Automatic Segmentation of COVID-19 Lesions from CT Slices with Dilated Convolution and Dual Attention Mechanism

Attribute Analysis and Diagnosis of LUNG CT Images of COVID-19

Does non-COVID-19 lung lesion help? investigating transferability in COVID-19 CT image segmentation

HADCNet: Automatic segmentation of COVID-19 infection based on a hybrid attention dense connected network with dilated convolution

A Deep Adversarial Model for Segmentation-Assisted COVID-19 Diagnosis Using CT Images

Two-stage hybrid network for segmentation of COVID-19 pneumonia lesions in CT images: a multicenter study

Diagnosing COVID-19 from CT Image of Lung Segmentation & Classification with Deep Learning Based on Convolutional Neural Networks

Transfer Learning for Establishment of Recognition of COVID-19 on CT Imaging Using Small-Sized Training Datasets

COVID‐19 Lung Infection Segmentation from Chest CT Images Based on CAPA‐ResUNet

Does Non-COVID19 Lung Lesion Help? Investigating Transferability in COVID-19 CT Image Segmentation

CGS‐Net: A classification‐guided framework for automated infection segmentation of COVID‐19 from CT images

Self-supervised deep learning model for COVID-19 lung CT image segmentation highlighting putative causal relationship among age, underlying disease and COVID-19

Novel coronavirus pneumonia lesion segmentation in CT images

Attention-based Multi-flow Network for COVID-19 Classification and Lesion Localization from Chest CT