Abstract:Purpose Glioma is the most common primary brain tumor, with varying degrees of aggressiveness and prognosis. Accurate glioma classification is very important for treatment planning and prognosis prediction. The main purpose of this study is to design a novel effective algorithm for further improving the performance of glioma subtype classification using multimodal MRI images. Method MRI images of four modalities for 221 glioma patients were collected from Computational Precision Medicine: Radiology-Pathology 2020 challenge, including T1, T2, T1ce, and fluid-attenuated inversion recovery (FLAIR) MRI images, to classify astrocytoma, oligodendroglioma, and glioblastoma. We proposed a multimodal MRI image decision fusion-based network for improving the glioma classification accuracy. First, the MRI images of each modality were input into a pre-trained tumor segmentation model to delineate the regions of tumor lesions. Then, the whole tumor regions were centrally clipped from original MRI images followed by max–min normalization. Subsequently, a deep learning-based network was designed based on a unified DenseNet structure, which extracts features through a series of dense blocks. After that, two fully connected layers were used to map the features into three glioma subtypes. During the training stage, we used the images of each modality after tumor segmentation to train the network to obtain its best accuracy on our testing set. During the inferring stage, a linear weighted module based on a decision fusion strategy was applied to assemble the predicted probabilities of the pre-trained models obtained in the training stage. Finally, the performance of our method was evaluated in terms of accuracy, area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), etc. Results The proposed method achieved an accuracy of 0.878, an AUC of 0.902, a sensitivity of 0.772, a specificity of 0.930, a PPV of 0.862, an NPV of 0.949, and a Cohen’s Kappa of 0.773, which showed a significantly higher performance than existing state-of-the-art methods. Conclusion Compared with current studies, this study demonstrated the effectiveness and superiority in the overall performance of our proposed multimodal MRI image decision fusion-based network method for glioma subtype classification, which would be of enormous potential value in clinical practice.

Brain Tumor Classification with Multimodal MR and Pathology Images

Enhanced Multimodal Brain Tumor Classification in MR Images Using 2D ResNet As Backbone with Explicit Tumor Size Information

Brain tumor MRI classification and identification using an image classification model via Convolutional Neural Networks

Glioma Classification Using Multimodal Radiology and Histology Data

Multimodal Brain Tumor Classification Using Convolutional Tumnet Architecture

Deep Radiomics for Brain Tumor Detection and Classification from Multi-Sequence MRI

Multimodal Brain Tumor Classification Using Deep Learning and Robust Feature Selection: A Machine Learning Application for Radiologists

Enhancement of brain tumor classification from MRI images using multi-path convolutional neural network with SVM classifier

Brain Tumor Classification with Tumor Segmentations and a Dual Path Residual Convolutional Neural Network from MRI and Pathology Images

Automated Brain Tumor Classification System Using Convolutional Neural Networks from MRI Images

Multimodal MRI Image Decision Fusion-Based Network for Glioma Classification

Classification of Brain Tumors on MRI Images Using Convolutional Neural Network Model EfficientNet

Glioma Grading Based on 3D Multimodal Convolutional Neural Network and Privileged Learning.

Brain Tumor Radiogenomic Classification

Automatic brain tumor grading from MRI data using convolutional neural networks and quality assessment

Brain Tumor Classification Using Convolutional Neural Network and Feature Extraction

Brain tumor classification utilizing pixel distribution and spatial dependencies higher-order statistical measurements through explainable ML models

Automated Classification of Brain Tumors from Magnetic Resonance Imaging Using Deep Learning

Computational and Mathematical Methods in Medicine Glioma Brain Tumor Detection and Classification Using Convolutional Neural Network

Tumor Diagnosis Based on the GMM Feature Decision Classification of Brain MR Images

Detection and Classification of Brain tumors Using Deep Convolutional Neural Networks