Abdominal multi-organ segmentation in Multi-sequence MRIs based on visual attention guided network and knowledge distillation

Hao Fu,Jian Zhang,Bin Li,Lanlan Chen,Junzhong Zou,ZhuiYang Zhang,Hao Zou
DOI: https://doi.org/10.1016/j.ejmp.2024.103385
IF: 3.119
2024-05-30
Physica Medica
Abstract:Highlights • Multi-organ segmentation based on unpaired T1-DUAL and T2-SPIR sequence of MRI. • We developed a novel visual attention-guided method to extract contextual features. • A new loss is used to minimize the semantic disparity between two MRI sequences. • The evaluation shows the potential of our method for clinical application. Purpose: The segmentation of abdominal organs in magnetic resonance imaging (MRI) plays a pivotal role in various therapeutic applications. Nevertheless, the application of deep-learning methods to abdominal organ segmentation encounters numerous challenges, especially in addressing blurred boundaries and regions characterized by low-contrast. Methods: In this study, a multi-scale visual attention-guided network (VAG-Net) was proposed for abdominal multi-organ segmentation based on unpaired multi-sequence MRI. A new visual attention-guided (VAG) mechanism was designed to enhance the extraction of contextual information, particularly at the edge of organs. Furthermore, a new loss function inspired by knowledge distillation was introduced to minimize the semantic disparity between different MRI sequences. Results: The proposed method was evaluated on the CHAOS 2019 Challenge dataset and compared with six state-of-the-art methods. The results demonstrated that our model outperformed these methods, achieving DSC values of 91.83 ± 0.24% and 94.09 ± 0.66% for abdominal multi-organ segmentation in T1-DUAL and T2-SPIR modality, respectively. Conclusion: The experimental results show that our proposed method has superior performance in abdominal multi-organ segmentation, especially in the case of small organs such as the kidneys.
radiology, nuclear medicine & medical imaging
What problem does this paper attempt to address?