Abstract:Brain tumor diagnostics rely heavily on Magnetic Resonance Imaging (MRI) for accurate diagnosis and treatment planning due to its non-invasive nature and detailed soft tissue visualization. Integrating multiple MRI modalities enhances diagnostic precision by providing complementary perspectives on tumor characteristics and spatial relationships. However, acquiring specific modalities like T1 Contrast Enhanced (T1CE) can be challenging, as they require contrast agents and longer scan times, which can cause discomfort, particularly in vulnerable patient groups such as the elderly, pregnant women, and infants. In the medical imaging domain, researchers face significant challenges in developing robust models due to data scarcity and data sparsity. Data scarcity, arising from limited access to diverse datasets, complex annotation processes, privacy concerns, and the difficulty of acquiring certain modalities in some patient groups, impedes the development of comprehensive brain tumor segmentation models. Data sparsity, driven by the highly imbalanced distribution between tumor subregions and background levels in annotated labels, complicates accurate segmentation. The study addresses these challenges by generating synthetic T1CE scans from T1 using an image-to-image translation framework, thereby reducing the reliance on hard-to-acquire modalities. A novel patch-based data sampling approach, Adaptive Random Patch Selection (ARPS), is introduced to combat data sparsity, ensuring detailed segmentation of intricate tumor structures while maintaining context through overlapping patches and context-aware sampling strategies. The impact of these synthetic images on segmentation performance is also assessed, emphasizing their role in addressing situations where certain modalities cannot be acquired. When integrated into the nnUNet model, this approach achieves a dice similarity coefficient (DSC) of 86.47, demonstrating its efficacy in handling complex MRI scans of brain tumors. An ablation study is also conducted to assess the individual contributions of the translated images and the proposed data sampling approach. This comprehensive evaluation allows us to understand the effectiveness of ARPS and the potential synergy between multi-modal translation and brain tumor segmentation.

Brain MR Atlas Construction Using Symmetric Deep Neural Inpainting

Fast and Lightweight Network Improves Serial Brain Section Stitching

Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology

A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

Advancing Brain Tumor Inpainting with Generative Models

An Atlas Based Level Set Method for 3D Brain Structures Segmentation

Subcortical Brain Segmentation Based on Atlas Registration and Linearized Kernel Sparse Representative Classifier

Deep learning-Based 3D inpainting of brain MR images

The Brain Tumor Segmentation (BraTS) Challenge: Local Synthesis of Healthy Brain Tissue via Inpainting

AFPNet: A 3D Fully Convolutional Neural Network with Atrous-Convolution Feature Pyramid for Brain Tumor Segmentation Via MRI Images.

Brain Extraction from Normal and Pathological Images: A Joint PCA/Image-Reconstruction Approach

NeuroAtlas: An Artificial Intelligence-based Framework for Annotation, Segmentation and Registration of Large Scale Biomedical Imaging Data

Automatic Brain Tissue Segmentation in MR Images Using Hybrid Atlas Forest Based on Confidence-Weighted Probability Matrix

Atlas-based Reconstruction of High Performance Brain MR Data

Synthetic MRI in action: A novel framework in data augmentation strategies for robust multi-modal brain tumor segmentation

3D dense connectivity network with atrous convolutional feature pyramid for brain tumor segmentation in magnetic resonance imaging of human heads

Unsupervised Region-based Anomaly Detection in Brain MRI with Adversarial Image Inpainting

Atlas construction via dictionary learning and group sparsity.

GAN-based metal artifacts region inpainting in brain MRI imaging with reflective registration

Automatic method for tracing regions of interest in rat brain magnetic resonance imaging studies.

Novel Robust Automatic Brain-Tumor Detection and Segmentation Using Magnetic Resonance Imaging