United adversarial learning for liver tumor segmentation and detection of multi-modality non-contrast MRI
Jianfeng Zhao,Dengwang Li,Xiaojiao Xiao,Fabio Accorsi,Harry Marshall,Tyler Cossetto,Dongkeun Kim,Daniel McCarthy,Cameron Dawson,Stefan Knezevic,Bo Chen,Shuo Li
DOI: https://doi.org/10.1016/j.media.2021.102154
IF: 10.9
2021-10-01
Medical Image Analysis
Abstract:<p>Simultaneous segmentation and detection of liver tumors (hemangioma and hepatocellular carcinoma (HCC)) by using multi-modality non-contrast magnetic resonance imaging (NCMRI) are crucial for the clinical diagnosis. However, it is still a challenging task due to: (1) the HCC information on NCMRI is insufficient makes extraction of liver tumors feature difficult; (2) diverse imaging characteristics in multi-modality NCMRI causes feature fusion and selection difficult; (3) no specific information between hemangioma and HCC on NCMRI cause liver tumors detection difficult. In this study, we propose a united adversarial learning framework (UAL) for simultaneous liver tumors segmentation and detection using multi-modality NCMRI. The UAL first utilizes a multi-view aware encoder to extract multi-modality NCMRI information for liver tumor segmentation and detection. In this encoder, a novel <em>edge dissimilarity feature pyramid module</em> is designed to facilitate the complementary multi-modality feature extraction. Secondly, the newly designed <em>fusion and selection channel</em> is used to fuse the multi-modality feature and make the decision of the feature selection. Then, the proposed mechanism of <em>coordinate sharing with padding</em> integrates the multi-task of segmentation and detection so that it enables multi-task to perform united adversarial learning in one discriminator. Lastly, an innovative <em>multi-phase radiomics guided discriminator</em> exploits the clear and specific tumor information to improve the multi-task performance via the adversarial learning strategy. The UAL is validated in corresponding multi-modality NCMRI (i.e. T1FS pre-contrast MRI, T2FS MRI, and DWI) and three phases contrast-enhanced MRI of 255 clinical subjects. The experiments show that UAL gains high performance with the dice similarity coefficient of 83.63%, the pixel accuracy of 97.75%, the intersection-over-union of 81.30%, the sensitivity of 92.13%, the specificity of 93.75%, and the detection accuracy of 92.94%, which demonstrate that UAL has great potential in the clinical diagnosis of liver tumors.</p>
engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging