Abstract:Purpose Glioma is the most common primary brain tumor, with varying degrees of aggressiveness and prognosis. Accurate glioma classification is very important for treatment planning and prognosis prediction. The main purpose of this study is to design a novel effective algorithm for further improving the performance of glioma subtype classification using multimodal MRI images. Method MRI images of four modalities for 221 glioma patients were collected from Computational Precision Medicine: Radiology-Pathology 2020 challenge, including T1, T2, T1ce, and fluid-attenuated inversion recovery (FLAIR) MRI images, to classify astrocytoma, oligodendroglioma, and glioblastoma. We proposed a multimodal MRI image decision fusion-based network for improving the glioma classification accuracy. First, the MRI images of each modality were input into a pre-trained tumor segmentation model to delineate the regions of tumor lesions. Then, the whole tumor regions were centrally clipped from original MRI images followed by max–min normalization. Subsequently, a deep learning-based network was designed based on a unified DenseNet structure, which extracts features through a series of dense blocks. After that, two fully connected layers were used to map the features into three glioma subtypes. During the training stage, we used the images of each modality after tumor segmentation to train the network to obtain its best accuracy on our testing set. During the inferring stage, a linear weighted module based on a decision fusion strategy was applied to assemble the predicted probabilities of the pre-trained models obtained in the training stage. Finally, the performance of our method was evaluated in terms of accuracy, area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), etc. Results The proposed method achieved an accuracy of 0.878, an AUC of 0.902, a sensitivity of 0.772, a specificity of 0.930, a PPV of 0.862, an NPV of 0.949, and a Cohen’s Kappa of 0.773, which showed a significantly higher performance than existing state-of-the-art methods. Conclusion Compared with current studies, this study demonstrated the effectiveness and superiority in the overall performance of our proposed multimodal MRI image decision fusion-based network method for glioma subtype classification, which would be of enormous potential value in clinical practice.

SASG-GCN: Self-Attention Similarity Guided Graph Convolutional Network for Multi-Type Lower-Grade Glioma Classification

Glioma Grading Based on 3D Multimodal Convolutional Neural Network and Privileged Learning.

Deep semi-supervised learning for brain tumor classification

Deep learning models for rapid discrimination of high-grade gliomas from solitary brain metastases using multi-plane T1-weighted contrast-enhanced (T1CE) images

Multimodal MRI Image Decision Fusion-Based Network for Glioma Classification

Pseudo-3D CNN with Inter-Slice Attention for Glioma Grading

Deep Multi-Scale 3D Convolutional Neural Network (CNN) for MRI Gliomas Brain Tumor Classification

Aided Diagnosis Model Based on Deep Learning for Glioblastoma, Solitary Brain Metastases, and Primary Central Nervous System Lymphoma with Multi-Modal MRI

A weakly supervised deep learning-based method for glioma subtype classification using WSI and mpMRIs

CNN-based glioma detection in MRI: A deep learning approach

Low-Grade Glioma Segmentation Based on CNN with Fully Connected CRF

Glioma Grading on Conventional MR Images: A Deep Learning Study With Transfer Learning

SSGNet: Selective Multi-Scale Receptive Field and Kernel Self-Attention Based on Group-Wise Modality for Brain Tumor Segmentation

A deep convolutional neural network for the automatic segmentation of glioblastoma brain tumor: Joint spatial pyramid module and attention mechanism network

GAM-SpCaNet: Gradient Awareness Minimization-Based Spinal Convolution Attention Network for Brain Tumor Classification.

Enhanced brain tumor classification using graph convolutional neural network architecture

Non-invasive classification of IDH mutation status of gliomas from multi-modal MRI using a 3D convolutional neural network

Glioma Grade Classification using CNNs and Segmentation with an Adaptive Approach using Histogram Features in Brain MRIs

Category guided attention network for brain tumor segmentation in MRI

A classification method of gastric cancer subtype based on residual graph convolution network

Comprehensive Genomic Subtyping of Glioma Using Semi-Supervised Multi-Task Deep Learning on Multimodal MRI