Abstract:Purpose Glioma is the most common primary brain tumor, with varying degrees of aggressiveness and prognosis. Accurate glioma classification is very important for treatment planning and prognosis prediction. The main purpose of this study is to design a novel effective algorithm for further improving the performance of glioma subtype classification using multimodal MRI images. Method MRI images of four modalities for 221 glioma patients were collected from Computational Precision Medicine: Radiology-Pathology 2020 challenge, including T1, T2, T1ce, and fluid-attenuated inversion recovery (FLAIR) MRI images, to classify astrocytoma, oligodendroglioma, and glioblastoma. We proposed a multimodal MRI image decision fusion-based network for improving the glioma classification accuracy. First, the MRI images of each modality were input into a pre-trained tumor segmentation model to delineate the regions of tumor lesions. Then, the whole tumor regions were centrally clipped from original MRI images followed by max–min normalization. Subsequently, a deep learning-based network was designed based on a unified DenseNet structure, which extracts features through a series of dense blocks. After that, two fully connected layers were used to map the features into three glioma subtypes. During the training stage, we used the images of each modality after tumor segmentation to train the network to obtain its best accuracy on our testing set. During the inferring stage, a linear weighted module based on a decision fusion strategy was applied to assemble the predicted probabilities of the pre-trained models obtained in the training stage. Finally, the performance of our method was evaluated in terms of accuracy, area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), etc. Results The proposed method achieved an accuracy of 0.878, an AUC of 0.902, a sensitivity of 0.772, a specificity of 0.930, a PPV of 0.862, an NPV of 0.949, and a Cohen’s Kappa of 0.773, which showed a significantly higher performance than existing state-of-the-art methods. Conclusion Compared with current studies, this study demonstrated the effectiveness and superiority in the overall performance of our proposed multimodal MRI image decision fusion-based network method for glioma subtype classification, which would be of enormous potential value in clinical practice.

Glioma Grading Based on 3D Multimodal Convolutional Neural Network and Privileged Learning.

Enhanced Multimodal Brain Tumor Classification in MR Images Using 2D ResNet As Backbone with Explicit Tumor Size Information

Multimodal 3D Convolutional Neural Networks for Brain Glioma Segmentation

Cerebral Glioma Grading Using Bayesian Network with Features Extracted from Multiple Modalities of Magnetic Resonance Imaging

Intelligent Glioma Grading Based on Deep Transfer Learning of MRI Radiomic Features

Hierarchical-order multimodal interaction fusion network for grading gliomas

Deep Multi-Scale 3D Convolutional Neural Network (CNN) for MRI Gliomas Brain Tumor Classification

3-D Convolutional Neural Networks for Glioblastoma Segmentation

Fully Automatic Binary Glioma Grading based on Pre-Therapy MRI using 3D Convolutional Neural Networks

Deep Learning and Multi-Sensor Fusion for Glioma Classification Using Multistream 2D Convolutional Networks.

Glioma Grading on Conventional MR Images: A Deep Learning Study With Transfer Learning

Computer-Aided Grading of Gliomas Combining Automatic Segmentation and Radiomics

3D Hyper-Dense Connected Convolutional Neural Network for Brain Tumor Segmentation

Multimodal MRI Image Decision Fusion-Based Network for Glioma Classification

Using slice-based deep learning and fusion of multi-modal mr images

Low-Grade Glioma Segmentation Based on CNN with Fully Connected CRF

An automatic glioma grading method based on multi-feature extraction and fusion.

Brain Tumor Classification with Multimodal MR and Pathology Images

Segmentation of Gliomas Based on a Double-Pathway Residual Convolution Neural Network Using Multi-Modality Information

Glioma Grade Classification using CNNs and Segmentation with an Adaptive Approach using Histogram Features in Brain MRIs

Convolutional Neural Networks for Glioma Segmentation and Prognosis: A Systematic Review