A Deep Learning Approach for Brain Tumor Classification and Segmentation Using a Multiscale Convolutional Neural Network

Francisco Javier Díaz-Pernas,Mario Martínez-Zarzuela,Míriam Antón-Rodríguez,David González-Ortega
DOI: https://doi.org/10.3390/healthcare9020153
2024-02-05
Abstract:In this paper, we present a fully automatic brain tumor segmentation and classification model using a Deep Convolutional Neural Network that includes a multiscale approach. One of the differences of our proposal with respect to previous works is that input images are processed in three spatial scales along different processing pathways. This mechanism is inspired in the inherent operation of the Human Visual System. The proposed neural model can analyze MRI images containing three types of tumors: meningioma, glioma, and pituitary tumor, over sagittal, coronal, and axial views and does not need preprocessing of input images to remove skull or vertebral column parts in advance. The performance of our method on a publicly available MRI image dataset of 3064 slices from 233 patients is compared with previously classical machine learning and deep learning published methods. In the comparison, our method remarkably obtained a tumor classification accuracy of 0.973, higher than the other approaches using the same database.
Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The paper attempts to address the problem of developing a deep learning-based method for the automatic classification and segmentation of brain tumors. Specifically, the authors propose a Multiscale Convolutional Neural Network (MCNN) model that can process input images at three different spatial scales, thereby improving the ability to accurately classify and segment different types of brain tumors, including meningiomas, gliomas, and pituitary tumors. ### Main Issues: 1. **Automatic Classification and Segmentation of Brain Tumors**: Traditional manual or semi-automatic methods are time-consuming and costly when dealing with large-scale medical image databases, necessitating an automated solution to improve efficiency and accuracy. 2. **Multiscale Feature Extraction**: By introducing multiscale processing paths, the model can extract features at different scales, better capturing the subtle differences between various types of brain tumors. 3. **No Preprocessing Required**: Unlike traditional methods, this model does not require the prior removal of skull or spine parts, simplifying the image processing workflow. ### Solution: - **Multiscale Convolutional Neural Network (MCNN)**: The model includes three processing paths, each handling features at different scales. This design is inspired by the multiscale processing mechanism of the human visual system. - **Sliding Window Technique**: The model uses a sliding window technique to process images pixel by pixel, achieving precise pixel-level classification. - **Data Augmentation**: Techniques such as elastic transformations are used to augment the training data, increasing its diversity and preventing overfitting. - **Performance Evaluation**: The model's classification and segmentation performance is evaluated using 5-fold cross-validation on a public MRI image dataset. ### Main Contributions: - **High Accuracy**: On the public MRI image dataset, the model achieves a tumor classification accuracy of 0.973, outperforming other classical machine learning and deep learning methods. - **Robustness**: The model performs excellently on different types of brain tumors (meningiomas, gliomas, and pituitary tumors), particularly in terms of sensitivity and predicted tumor type proportion score (pttas). In summary, this paper aims to provide strong support for clinical diagnosis and treatment by proposing a multiscale convolutional neural network model that achieves efficient and accurate automatic classification and segmentation of brain tumors.