Abstract:Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning approach that applies to a broader spectrum of brain tumors. We introduce HT-CNNs, an ensemble of Hybrid Transformers and Convolutional Neural Networks optimized through transfer learning for varied brain tumor segmentation. This method captures spatial and contextual details from MRI data, fine-tuned on diverse datasets representing common tumor types. Through transfer learning, HT-CNNs utilize the learned representations from one task to improve generalization in another, harnessing the power of pre-trained models on large datasets and fine-tuning them on specific tumor types. We preprocess diverse datasets from multiple international distributions, ensuring representativeness for the most common brain tumors. Our rigorous evaluation employs standardized quantitative metrics across all tumor types, ensuring robustness and generalizability. The proposed ensemble model achieves superior segmentation results across the BraTS validation datasets over the previous winning methods. Comprehensive quantitative evaluations using the DSC and HD95 demonstrate the effectiveness of our approach. Qualitative segmentation predictions further validate the high-quality outputs produced by our model. Our findings underscore the potential of transfer learning and ensemble approaches in medical image segmentation, indicating a substantial enhancement in clinical decision-making and patient care. Despite facing challenges related to post-processing and domain gaps, our study sets a new precedent for future research for brain tumor segmentation. The docker image for the code and models has been made publicly available, <a class="link-external link-https" href="https://hub.docker.com/r/razeineldin/ht-cnns" rel="external noopener nofollow">this https URL</a>.

Ensemble CNN Networks for GBM Tumors Segmentation using Multi-parametric MRI

Multimodal CNN Networks for Brain Tumor Segmentation in MRI: A BraTS 2022 Challenge Solution

Automated Ensemble-Based Segmentation of Adult Brain Tumors: A Novel Approach Using the BraTS AFRICA Challenge Data

Model Ensemble for Brain Tumor Segmentation in Magnetic Resonance Imaging

Ensemble of CNNs for Segmentation of Glioma Sub-regions with Survival Prediction

Glioblastoma Tumor Segmentation using an Ensemble of Vision Transformers

Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features

Unified HT-CNNs Architecture: Transfer Learning for Segmenting Diverse Brain Tumors in MRI from Gliomas to Pediatric Tumors

Deep learning-based ensemble model for brain tumor segmentation using multi-parametric MR scans

Attention-Enhanced Hybrid Feature Aggregation Network for 3D Brain Tumor Segmentation

Ensemble Learning and 3D Pix2Pix for Comprehensive Brain Tumor Analysis in Multimodal MRI

Active deep neural network features selection for segmentation and recognition of brain tumors using MRI images

Multi-stage Deep Layer Aggregation for Brain Tumor Segmentation

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning

Segmentation of Brain Gliomas Based on a Multi-modal Multi-scale Double-pathway 3D Residual CNN

Advanced Tumor Segmentation in Medical Imaging: An Ensemble Approach for BraTS 2023 Adult Glioma and Pediatric Tumor Tasks

A Deep Multi-Task Learning Framework for Brain Tumor Segmentation

Automated ensemble method for pediatric brain tumor segmentation

On Enhancing Brain Tumor Segmentation Across Diverse Populations with Convolutional Neural Networks

Segmentation of Glioblastoma Multiforme Via - Attention Neural Network

Brain Tumor Segmentation Network with Multi-View Ensemble Discrimination and Kernel-Sharing Dilated Convolution.