A multi-class brain tumor grading system based on histopathological images using a hybrid YOLO and RESNET networks

Naira Elazab,Wael A. Gab-Allah,Mohammed Elmogy

DOI: https://doi.org/10.1038/s41598-024-54864-6

IF: 4.6

2024-02-26

Scientific Reports

Abstract:Gliomas are primary brain tumors caused by glial cells. These cancers' classification and grading are crucial for prognosis and treatment planning. Deep learning (DL) can potentially improve the digital pathology investigation of brain tumors. In this paper, we developed a technique for visualizing a predictive tumor grading model on histopathology pictures to help guide doctors by emphasizing characteristics and heterogeneity in forecasts. The proposed technique is a hybrid model based on YOLOv5 and ResNet50. The function of YOLOv5 is to localize and classify the tumor in large histopathological whole slide images (WSIs). The suggested technique incorporates ResNet into the feature extraction of the YOLOv5 framework, and the detection results show that our hybrid network is effective for identifying brain tumors from histopathological images. Next, we estimate the glioma grades using the extreme gradient boosting classifier. The high-dimensional characteristics and nonlinear interactions present in histopathology images are well-handled by this classifier. DL techniques have been used in previous computer-aided diagnosis systems for brain tumor diagnosis. However, by combining the YOLOv5 and ResNet50 architectures into a hybrid model specifically designed for accurate tumor localization and predictive grading within histopathological WSIs, our study presents a new approach that advances the field. By utilizing the advantages of both models, this creative integration goes beyond traditional techniques to produce improved tumor localization accuracy and thorough feature extraction. Additionally, our method ensures stable training dynamics and strong model performance by integrating ResNet50 into the YOLOv5 framework, addressing concerns about gradient explosion. The proposed technique is tested using the cancer genome atlas dataset. During the experiments, our model outperforms the other standard ways on the same dataset. Our results indicate that the proposed hybrid model substantially impacts tumor subtype discrimination between low-grade glioma (LGG) II and LGG III. With 97.2% of accuracy, 97.8% of precision, 98.6% of sensitivity, and the Dice similarity coefficient of 97%, the proposed model performs well in classifying four grades. These results outperform current approaches for identifying LGG from high-grade glioma and provide competitive performance in classifying four categories of glioma in the literature.

multidisciplinary sciences

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to develop a multi - class brain tumor grading system based on deep learning in order to improve the accuracy of brain tumor diagnosis and treatment planning. Specifically, this research aims to create a hybrid model by combining the advantages of two deep - learning models, YOLOv5 and ResNet50, for accurately locating and classifying brain tumors from histopathological images and further predicting the grade of the tumors. This helps doctors more effectively identify different types of brain tumors in clinical practice, especially the distinction between low - grade gliomas (LGG II and LGG III) and high - grade gliomas. ### Main contributions of the paper: 1. **Developed an enhanced model**: This model is able to grade different types of brain tumors based on pathological images. 2. **Used transfer learning**: By combining the customized YOLOv5 and ResNet50 models, the accuracy of feature detection is improved. 3. **Optimized model performance**: By reducing the vanishing gradient problem and enhancing the gradient flow in back - propagation, the overall performance of the model is improved. 4. **Reduced computational complexity**: By modifying the backbone network of the YOLOv5 model, the number of parameters is reduced and the computational cost is lowered. 5. **Performance comparison**: Compared with the existing advanced methods, the results show that this framework performs best on multiple indicators. ### Specific problems solved: - **Accurate tumor location**: Utilize the powerful object - detection ability of YOLOv5 to accurately locate the tumor area in large - size histopathological whole - slide images (WSI). - **Detailed feature extraction**: Combine the deep - feature extraction ability of ResNet50 to extract subtle features from the located tumor area, which are crucial for accurate classification. - **Efficient tumor grading**: Use the extreme gradient boosting (XGBoost) classifier to handle high - dimensional features and nonlinear relationships and achieve efficient classification of different - grade brain tumors. - **Reduce the workload of manual annotation**: Through automated image processing and feature extraction, reduce the manual workload of pathologists and improve the diagnostic efficiency. In conclusion, the method proposed in this paper is not only innovative in technology but also has important clinical value in practical applications and can significantly improve the accuracy and efficiency of brain tumor diagnosis.

A multi-class brain tumor grading system based on histopathological images using a hybrid YOLO and RESNET networks

A robust MRI-based brain tumor classification via a hybrid deep learning technique

Deep learning‐based robust hybrid approaches for brain tumor classification in magnetic resonance images

A hybrid deep CNN model for brain tumor image multi-classification

Advancing brain tumor classification accuracy through deep learning: harnessing radimagenet pre-trained convolutional neural networks, ensemble learning, and machine learning classifiers on MRI brain images

Deep Learning Glioma Grading with the Tumor Microenvironment Analysis Protocol for A Comprehensive Learning, Discovering, and Quantifying Microenvironmental Features

A Hybrid Approach Based on Deep CNN and Machine Learning Classifiers for the Tumor Segmentation and Classification in Brain MRI

Enhancing Automated Brain Tumor Detection Accuracy Using Artificial Intelligence Approaches for Healthcare Environments

A hybrid deep learning scheme for MRI-based preliminary multiclassification diagnosis of primary brain tumors

Classification Framework for Medical Diagnosis of Brain Tumor with an Effective Hybrid Transfer Learning Model

Tumor grading model employing geometric analysis of histopathological images with characteristic nuclei dictionary

Accurate Detection of Brain Tumor Lesions From Medical Images Based on Improved YOLOv8 Algorithm

DeepLabV3, IBCO-based ALCResNet: A fully automated classification, and grading system for brain tumor

Multi-class Brain Tumor Classification and Segmentation using Hybrid Deep Learning Network Model

Advancing multi-categorization and segmentation in brain tumors using novel efficient deep learning approaches

Harnessing Deep Learning for Accurate Pathological Assessment of Brain Tumor Cell Types

Dynamic architecture based deep learning approach for glioblastoma brain tumor survival prediction

Detection and classification of brain tumor using hybrid deep learning models

An improved framework for brain tumor analysis using MRI based on YOLOv2 and convolutional neural network

A multi-center performance assessment for automated histopathological classification and grading of glioma using whole slide images

Glioma Grading Based on 3D Multimodal Convolutional Neural Network and Privileged Learning.