Abstract:BackgroundAccurate segmentation of brain glioma is a critical prerequisite for clinical diagnosis, surgical planning and treatment evaluation. In current clinical workflow, physicians typically perform delineation of brain tumor subregions slice-by-slice, which is more susceptible to variabilities in raters and also time-consuming. Besides, even though convolutional neural networks (CNNs) are driving progress, the performance of standard models still have some room for further improvement. PurposeTo deal with these issues, this paper proposes an attention-guided multi-scale context aggregation network (AMCA-Net) for the accurate segmentation of brain glioma in the magnetic resonance imaging (MRI) images with multi-modalities. MethodsAMCA-Net extracts the multi-scale features from the MRI images and fuses the extracted discriminative features via a self-attention mechanism for brain glioma segmentation. The extraction is performed via a series of down-sampling, convolution layers, and the global context information guidance (GCIG) modules are developed to fuse the features extracted for contextual features. At the end of the down-sampling, a multi-scale fusion (MSF) module is designed to exploit and combine all the extracted multi-scale features. Each of the GCIG and MSF modules contain a channel attention (CA) module that can adaptively calibrate feature responses and emphasize the most relevant features. Finally, multiple predictions with different resolutions are fused through different weightings given by a multi-resolution adaptation (MRA) module instead of the use of averaging or max-pooling to improve the final segmentation results. ResultsDatasets used in this paper are publicly accessible, that is, the Multimodal Brain Tumor Segmentation Challenges 2018 (BraTS2018) and 2019 (BraTS2019). BraTS2018 contains 285 patient cases and BraTS2019 contains 335 cases. Simulations show that the AMCA-Net has better or comparable performance against that of the other state-of-the-art models. In terms of the Dice score and Hausdorff 95 for the BraTS2018 dataset, 90.4% and 10.2 mm for the whole tumor region (WT), 83.9% and 7.4 mm for the tumor core region (TC), 80.2% and 4.3 mm for the enhancing tumor region (ET), whereas the Dice score and Hausdorff 95 for the BraTS2019 dataset, 91.0% and 10.7 mm for the WT, 84.2% and 8.4 mm for the TC, 80.1% and 4.8 mm for the ET. Conclusions: The proposed AMCA-Net performs comparably well in comparison to several state-of-the-art neural net models in identifying the areas involving the peritumoral edema, enhancing tumor, and necrotic and non-enhancing tumor core of brain glioma, which has great potential for clinical practice. In future research, we will further explore the feasibility of applying AMCA-Net to other similar segmentation tasks.

Automatic Pituitary Adenoma Segmentation and Identification of Cavernous Sinus Invasion Via Multi-task Learning

Multi-scale discriminative network for prostate cancer lesion segmentation in multiparametric MR images

Three-Dimensional Semantic Segmentation of Pituitary Adenomas Based on the Deep Learning Framework-nnU-Net: A Clinical Perspective.

Computer-aided Diagnosis of Pituitary Microadenoma on Dynamic Contrast-Enhanced MRI Based on Spatio-Temporal Features

Attention-guided Multi-Scale Context Aggregation Network for Multi-Modal Brain Glioma Segmentation

A dual-branch hybrid dilated CNN model for the AI-assisted segmentation of meningiomas in MR images

Automatic Detection of Pituitary Microadenoma from Magnetic Resonance Imaging Using Deep Learning Algorithms

Application of Convolutional Neural Network in the Diagnosis of Cavernous Sinus Invasion in Pituitary Adenoma.

Semi-supervised Model Based on Implicit Neural Representation and Mutual Learning (SIMN) for Multi-Center Nasopharyngeal Carcinoma Segmentation on MRI

3MT-Net: A Multi-modal Multi-task Model for Breast Cancer and Pathological Subtype Classification Based on a Multicenter Study

PDC-Net: Parallel Dilated Convolutional Network with Channel Attention Mechanism for Pituitary Adenoma Segmentation.

3D Reconstruction-Oriented Fully Automatic Multi-Modal Tumor Segmentation by Dual Attention-Guided VNet

Automatic Meningioma Segmentation and Grading Prediction: A Hybrid Deep-Learning Method

Multicenter Study of the Utility of Convolutional Neural Network and Transformer Models for the Detection and Segmentation of Meningiomas.

Image-driven classification of functioning and nonfunctioning pituitary adenoma by deep convolutional neural networks

Accurate segmentation algorithm of acoustic neuroma in the cerebellopontine angle based on ACP-TransUNet

Multi-center application of a convolutional neural network for preoperative detection of cavernous sinus invasion in pituitary adenomas

MMCA-NET: A Multimodal Cross Attention Transformer Network for Nasopharyngeal Carcinoma Tumor Segmentation Based on a Total-Body PET/CT System

DPAFNet: A Residual Dual-Path Attention-Fusion Convolutional Neural Network for Multimodal Brain Tumor Segmentation

MRI Brain Tumour Segmentation Using Multiscale Attention U-Net

Enhancing prostate cancer segmentation on multiparametric magnetic resonance imaging with background information and gland masks