Abstract:Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning approach that applies to a broader spectrum of brain tumors. We introduce HT-CNNs, an ensemble of Hybrid Transformers and Convolutional Neural Networks optimized through transfer learning for varied brain tumor segmentation. This method captures spatial and contextual details from MRI data, fine-tuned on diverse datasets representing common tumor types. Through transfer learning, HT-CNNs utilize the learned representations from one task to improve generalization in another, harnessing the power of pre-trained models on large datasets and fine-tuning them on specific tumor types. We preprocess diverse datasets from multiple international distributions, ensuring representativeness for the most common brain tumors. Our rigorous evaluation employs standardized quantitative metrics across all tumor types, ensuring robustness and generalizability. The proposed ensemble model achieves superior segmentation results across the BraTS validation datasets over the previous winning methods. Comprehensive quantitative evaluations using the DSC and HD95 demonstrate the effectiveness of our approach. Qualitative segmentation predictions further validate the high-quality outputs produced by our model. Our findings underscore the potential of transfer learning and ensemble approaches in medical image segmentation, indicating a substantial enhancement in clinical decision-making and patient care. Despite facing challenges related to post-processing and domain gaps, our study sets a new precedent for future research for brain tumor segmentation. The docker image for the code and models has been made publicly available, <a class="link-external link-https" href="https://hub.docker.com/r/razeineldin/ht-cnns" rel="external noopener nofollow">this https URL</a>.

Brain Tumor Classification with Tumor Segmentations and a Dual Path Residual Convolutional Neural Network from MRI and Pathology Images

Segmentation of Brain Gliomas Based on a Multi-modal Multi-scale Double-pathway 3D Residual CNN

Automatic Brain Tumor Segmentation By Exploring The Multi-Modality Complementary Information And Cascaded 3d Lightweight Cnns

Segmentation of Gliomas Based on a Double-Pathway Residual Convolution Neural Network Using Multi-Modality Information

DPAFNet: A Residual Dual-Path Attention-Fusion Convolutional Neural Network for Multimodal Brain Tumor Segmentation

Brain Tumor Segmentation Network with Multi-View Ensemble Discrimination and Kernel-Sharing Dilated Convolution.

Enhancement of brain tumor classification from MRI images using multi-path convolutional neural network with SVM classifier

Multimodal CNN Networks for Brain Tumor Segmentation in MRI: A BraTS 2022 Challenge Solution

Brain Tumor Segmentation Using Automatic 3D Multi-channel Feature Selection Convolutional Neural Network

Dual‐pathway DenseNets with Fully Lateral Connections for Multimodal Brain Tumor Segmentation

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

Three-Dimensional Parallel Convolution Neural Network Brain Tumor Segmentation Based on Dilated Convolution

Unified HT-CNNs Architecture: Transfer Learning for Segmenting Diverse Brain Tumors in MRI from Gliomas to Pediatric Tumors

Automatic Brain Tumor Segmentation Based on Cascaded Convolutional Neural Networks with Uncertainty Estimation

A Volumetric Convolutional Neural Network for Brain Tumor Segmentation

Dual-force Convolutional Neural Networks for Accurate Brain Tumor Segmentation

Modality-Pairing Learning for Brain Tumor Segmentation

Automatic Brain Tumor Segmentation Using Cascaded Anisotropic Convolutional Neural Networks

Automatic Segmentation of MRI of Brain Tumor Using Deep Convolutional Network

Brain Tumor Classification Based on MRI Images and Noise Reduced Pathology Images.

On Enhancing Brain Tumor Segmentation Across Diverse Populations with Convolutional Neural Networks