Abstract:Background and Objective As large sets of annotated MRI data are needed for training and validating deep learning based medical image analysis algorithms, the lack of sufficient annotated data is a critical problem. A possible solution is the generation of artificial data by means of physics-based simulations. Existing brain simulation data is limited in terms of anatomical models, tissue classes, fixed tissue characteristics, MR sequences and overall realism. Methods We propose a realistic simulation framework by incorporating patient-specific phantoms and Bloch equations-based analytical solutions for fast and accurate MRI simulations. A large number of labels are derived from open-source high-resolution T1w MRI data using a fully automated brain classification tool. The brain labels are taken as ground truth (GT) on which MR images are simulated using our framework. Moreover, we demonstrate that the T1w MR images generated from our framework along with GT annotations can be utilized directly to train a 3D brain segmentation network. To evaluate our model further on larger set of real multi-source MRI data without GT, we compared our model to existing brain segmentation tools, FSL-FAST and SynthSeg. Results Our framework generates 3D brain MRI for variable anatomy, sequence, contrast, SNR and resolution. The brain segmentation network for WM/GM/CSF trained only on T1w simulated data shows promising results on real MRI data from MRBrainS18 challenge dataset with a Dice scores of 0.818/0.832/0.828 . On OASIS data, our model exhibit a close performance to FSL, both qualitatively and quantitatively with a Dice scores of 0.901/0.939/0.937 . Conclusions Our proposed simulation framework is the initial step towards achieving truly physics-based MRI image generation, providing flexibility to generate large sets of variable MRI data for desired anatomy, sequence, contrast, SNR, and resolution. Furthermore, the generated images can effectively train 3D brain segmentation networks, mitigating the reliance on real 3D annotated data.

Physics-informed brain MRI segmentation

Simultaneous reconstruction and segmentation of MRI image by manifold learning

PILOT: Physics-Informed Learned Optimized Trajectories for Accelerated MRI

Deep learning with multiresolution handcrafted features for brain MRI segmentation

Brain MRI Segmentation with Fast and Globally Convex Multiphase Active Contours

Brain MR image simulation for deep learning based medical image analysis networks

Physics-Informed Latent Diffusion for Multimodal Brain MRI Synthesis

Domain-Agnostic Stroke Lesion Segmentation Using Physics-Constrained Synthetic Data

Multi-Parameter Molecular MRI Quantification using Physics-Informed Self-Supervised Learning

The Method of Multimodal MRI Brain Image Segmentation Based on Differential Geometric Features

Neural-network-based segmentation of multi-modal medical images: a comparative and prospective study

Markov Random Field Segmentation of Brain MR Images

A Multi-channel Network with Image Retrieval for Accurate Brain Tissue Segmentation

Generalizable synthetic MRI with physics-informed convolutional networks

Physics-Regularized Multi-Modal Image Assimilation for Brain Tumor Localization

Multi-task Deep Learning for Cerebrovascular Disease Classification and MRI-to-PET Translation

Data Preprocessing via Multi-sequences MRI Mixture to Improve Brain Tumor Segmentation

Brain tumor segmentation based on deep learning and an attention mechanism using MRI multi-modalities brain images

Multimodal Infant Brain Segmentation by Fuzzy-Informed Deep Learning

Computational MRI with Physics-based Constraints: Application to Multi-contrast and Quantitative Imaging

Unsupervised learning of MRI tissue properties using MRI physics models