Abstract:Purpose Glioma is the most common primary brain tumor, with varying degrees of aggressiveness and prognosis. Accurate glioma classification is very important for treatment planning and prognosis prediction. The main purpose of this study is to design a novel effective algorithm for further improving the performance of glioma subtype classification using multimodal MRI images. Method MRI images of four modalities for 221 glioma patients were collected from Computational Precision Medicine: Radiology-Pathology 2020 challenge, including T1, T2, T1ce, and fluid-attenuated inversion recovery (FLAIR) MRI images, to classify astrocytoma, oligodendroglioma, and glioblastoma. We proposed a multimodal MRI image decision fusion-based network for improving the glioma classification accuracy. First, the MRI images of each modality were input into a pre-trained tumor segmentation model to delineate the regions of tumor lesions. Then, the whole tumor regions were centrally clipped from original MRI images followed by max–min normalization. Subsequently, a deep learning-based network was designed based on a unified DenseNet structure, which extracts features through a series of dense blocks. After that, two fully connected layers were used to map the features into three glioma subtypes. During the training stage, we used the images of each modality after tumor segmentation to train the network to obtain its best accuracy on our testing set. During the inferring stage, a linear weighted module based on a decision fusion strategy was applied to assemble the predicted probabilities of the pre-trained models obtained in the training stage. Finally, the performance of our method was evaluated in terms of accuracy, area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), etc. Results The proposed method achieved an accuracy of 0.878, an AUC of 0.902, a sensitivity of 0.772, a specificity of 0.930, a PPV of 0.862, an NPV of 0.949, and a Cohen’s Kappa of 0.773, which showed a significantly higher performance than existing state-of-the-art methods. Conclusion Compared with current studies, this study demonstrated the effectiveness and superiority in the overall performance of our proposed multimodal MRI image decision fusion-based network method for glioma subtype classification, which would be of enormous potential value in clinical practice.

Brain Tumor Classification Based on MRI Images and Noise Reduced Pathology Images.

Brain Tumor Classification with Multimodal MR and Pathology Images

Enhanced Multimodal Brain Tumor Classification in MR Images Using 2D ResNet As Backbone with Explicit Tumor Size Information

A Hybrid Approach Based on Deep CNN and Machine Learning Classifiers for the Tumor Segmentation and Classification in Brain MRI

Multimodal MRI Image Decision Fusion-Based Network for Glioma Classification

Refining neural network algorithms for accurate brain tumor classification in MRI imagery

Enhancement of brain tumor classification from MRI images using multi-path convolutional neural network with SVM classifier

Brain Tumor Classification with Tumor Segmentations and a Dual Path Residual Convolutional Neural Network from MRI and Pathology Images

Brain Tumor Classification on MRI in Light of Molecular Markers

Classification of brain tumor types through MRIs using parallel CNNs and firefly optimization

Brain tumor MRI classification and identification using an image classification model via Convolutional Neural Networks

Brain tumor segmentation based on the dual-path network of multi-modal MRI images

Deep Radiomics for Brain Tumor Detection and Classification from Multi-Sequence MRI

Deep Neural Network Analysis of Pathology Images With Integrated Molecular Data for Enhanced Glioma Classification and Grading

An Integrated Deep Learning Framework for Effective Brain Tumor Localization, Segmentation, and Classification from Magnetic Resonance Images

A hybrid deep learning scheme for MRI-based preliminary multiclassification diagnosis of primary brain tumors

A weakly supervised deep learning-based method for glioma subtype classification using WSI and mpMRIs

Relax and focus on brain tumor segmentation

MRI brain tumor classification based on CNN features and machine learning classifiers

MRI-Based Brain Tumor Classification Using a Dilated Parallel Deep Convolutional Neural Network

An automated brain tumor classification in MR images using an enhanced convolutional neural network