Brain tumor segmentation and classification using transfer learning based CNN model with model agnostic concept interpretation
Maheswari, R.
DOI: https://doi.org/10.1007/s11042-024-20353-1
IF: 2.577
2024-10-19
Multimedia Tools and Applications
Abstract:In recent decades, brain tumors have been regarded as a severe illness that causes significant damage to the health of the individual, and finally it results to death. Hence, the Brain Tumor Segmentation and Classification (BTSC) has gained more attention among researcher communities. BTSC is the process of finding brain tumor tissues and classifying the tissues based on the tumor types. Manual tumor segmentation from is prone to error and a time-consuming task. A precise and fast BTSC model is developed in this manuscript based on a transfer learning-based Convolutional Neural Networks (CNN) model. The utilization of a variant of CNN is because of its superiority in distinct tasks. In the initial phase, the Magnetic Resonance Imaging (MRI) brain images are acquired from the Brain Tumor Image Segmentation Challenge (BRATS) 2019, 2020 and 2021 databases. Then the image augmentation is performed on the gathered images by using zoom-in, rotation, zoom-out, flipping, scaling, and shifting methods that effectively reduce overfitting issues in the classification model. The augmented images are segmented using the layers of the Visual-Geometry-Group (VGG-19) model. Then feature extraction using An Attribute Aware Attention (AWA) methodology is carried out on the segmented images following the segmentation block in the VGG-19 model. The crucial features are then selected using the attribute category reciprocal attention phase. These features are inputted to the Model Agnostic Concept Extractor (MACE) to generate the relevance score between the features for assisting in the final classification process. The obtained relevance scores from the MACE are provided to the max-pooling layer of the VGG-19 model. Then, the final classified output is obtained from the modified VGG-19 architecture. The implemented Relevance score with the AWA-based VGG-19 model is used to classify the tumor as the whole tumor, enhanced tumor, and tumor core. In the classification section, the proposed Relevance score with the AWA-based VGG-19 model has achieved 96.20%, 98.20%, and 99.40% enhanced accuracy on the BRATS 2019, 2020, and 2021 databases. In the segmentation section, the Relevance score with the AWA-based VGG-19 model has achieved 91.06%, 91.40%, and 94.86% higher Dice Similarity Coefficient (DSC) value, where the attained results are superior to the traditional CNN model. Validation regarding accuracy, specificity, and sensitivity is carried out to verify the classification performance, and the analysis in terms of DSC and HD is done to validate the segmentation performance. The performance of the implemented BTSC model is validated by comparing it against methods such as MAC-ARUNet3+, BTSC-TNAS, Mask R-CNN Resnet 101, CNN, SwinBTS, Residual mobile U-net, and Ensemble deep learning.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering