Abstract:Background and Objective: Coronavirus disease 2019 (COVID-19) is a highly contagious virus spreading all around the world. Deep learning has been adopted as an effective technique to aid COVID-19 detection and segmentation from computed tomography (CT) images. The major challenge lies in the inadequate public COVID-19 datasets. Recently, transfer learning has become a widely used technique that leverages the knowledge gained while solving one problem and applying it to a different but related problem. However, it remains unclear whether various non-COVID19 lung lesions could contribute to segmenting COVID-19 infection areas and how to better conduct this transfer procedure. This paper provides a way to understand the transferability of non-COVID19 lung lesions and a better strategy to train a robust deep learning model for COVID-19 infection segmentation. Methods: Based on a publicly available COVID-19 CT dataset and three public non-COVID19 datasets, we evaluate four transfer learning methods using 3D U-Net as a standard encoder-decoder method. i) We introduce the multi-task learning method to get a multi-lesion pre-trained model for COVID-19 infection. ii) We propose and compare four transfer learning strategies with various performance gains and training time costs. Our proposed Hybrid-encoder Learning strategy introduces a Dedicated-encoder and an Adapted-encoder to extract COVID-19 infection features and general lung lesion features, respectively. An attention-based Selective Fusion unit is designed for dynamic feature selection and aggregation. Results: Experiments show that trained with limited data, proposed Hybrid-encoder strategy based on multi-lesion pre-trained model achieves a mean DSC, NSD, Sensitivity, F1-score, Accuracy and MCC of 0.704, 0.735, 0.682, 0.707, 0.994 and 0.716, respectively, with better genetalization and lower over-fitting risks for segmenting COVID-19 infection. Conclusions: The results reveal the benefits of transferring knowledge from non-COVID19 lung lesions, and learning from multiple lung lesion datasets can extract more general features, leading to accurate and robust pre-trained models. We further show the capability of the encoder to learn feature representations of lung lesions, which improves segmentation accuracy and facilitates training convergence. In addition, our proposed Hybrid-encoder learning method incorporates transferred lung lesion features from non-COVID19 datasets effectively and achieves significant improvement. These findings promote new insights into transfer learning for COVID-19 CT image segmentation, which can also be further generalized to other medical tasks.

Transfer Learning-Hierarchical Segmentation on COVID CT Scans

COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework

An efficient deep neural network framework for COVID-19 lung infection segmentation

Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images

Automatic Deep Learning System for COVID-19 Infection Quantification in chest CT

A Sustainable Deep Learning-Based Framework for Automated Segmentation of COVID-19 Infected Regions: Using U-Net with an Attention Mechanism and Boundary Loss Function

CD-Net: Cascaded 3D Dilated Convolutional Neural Network for Pneumonia Lesion Segmentation

Computer Aided Diagnosis for COVID-19 in CT Images Utilizing Transfer Learning and Attention Mechanism

An Effective Deep Neural Network for Lung Lesions Segmentation From COVID-19 CT Images

Transfer Learning for Establishment of Recognition of COVID-19 on CT Imaging Using Small-Sized Training Datasets

AI-Powered Semantic Segmentation and Fluid Volume Calculation of Lung CT Images in COVID-19 Patients

A Deep Ensemble Learning Approach to Lung CT Segmentation for COVID-19 Severity Assessment

Multi-task Deep Learning Based CT Imaging Analysis For COVID-19: Classification and Segmentation

Does non-COVID-19 lung lesion help? investigating transferability in COVID-19 CT image segmentation

MSD-Net: Multi-Scale Discriminative Network for COVID-19 Lung Infection Segmentation on CT

Diagnosing COVID-19 from CT Image of Lung Segmentation & Classification with Deep Learning Based on Convolutional Neural Networks

HADCNet: Automatic segmentation of COVID-19 infection based on a hybrid attention dense connected network with dilated convolution

DCA-Net: A W-shaped Network for Segmenting COVID-19 Infected Area from Medical Images

LCOV-NET: A Lightweight Neural Network for COVID-19 Pneumonia Lesion Segmentation from 3D CT Images.

A Non-local Hierarchical Refinement Fully Convolutional Network for COVID-19 Infected Region Segmentation

Novel Deep CNNs Explore Regions, Boundaries, and Residual Learning for COVID-19 Infection Analysis in Lung CT