Abstract:Longitudinal magnetic resonance imaging (MRI) is essential for studying the early development of the brain, as it allows to observe and analyze how the brain changes over time. Unfortunately, existing cohort research suffers from lacking sufficient MRI data for studying the development of fetal brains. Apart from research data, a viable alternative is the use of large-scale clinical fetal brain MRI data, which is currently the primary source for longitudinal studies. Although clinical data has several benefits, it is impeded by the inherent drawback of incomplete data. In the context of clinical practice, nearly all subjects undergo only one MRI scan throughout their entire pregnancy, resulting in a lack of longitudinal data for any fetus. To address this issue and obtain longitudinal clinical fetal brain MRI data, we propose to generate MR images for two adjacent gestational weeks (GWs) within one subject, thereby bridging the information gap between three consecutive GWs. This fetal MRI prediction task suffers from two significant challenges, including 1) heterogeneous generation and 2) the lack of paired training data at adjacent GWs. To tackle these two challenges, we propose a new approach, called the Development-driven Diffusion Model (DDM). Specifically, our approach first involves training a conditional diffusion model using population development information spanning all GWs. This allows the model to generate images at various GWs. Next, during the inference stage, we incorporate individual development information of a specific subject using a specially designed perception feature guidance module. The DDM enables the generated 3D MR images to encompass both the general characteristics representative of the targeted GWs, as well as the distinct feature specific to each individual. To assess the efficacy of our approach, extensive experiments were carried out on a large-scale clinical dataset obtained from three different medical centers. The experimental results unequivocally establish the effectiveness of DDM for generating longitudinal MR images of fetal brains.

FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Fetal Pose Estimation in Volumetric MRI using a 3D Convolution Neural Network

Development-driven Diffusion Model for Longitudinal Prediction of Fetal Brain MRI with Unpaired Data

Real-time fetal brain tracking for functional fetal MRI

Self-supervised Fetal MRI 3D Reconstruction Based on Radiation Diffusion Generation Model

Motion Correction and Volumetric Reconstruction for Fetal Functional Magnetic Resonance Imaging Data

Deep Predictive Motion Tracking in Magnetic Resonance Imaging: Application to Fetal Imaging

4D iterative reconstruction of brain fMRI in the moving fetus

In utero diffusion MRI: challenges, advances, and applications

Spatio-temporal motion correction and iterative reconstruction of in-utero fetal fMRI

Quantifying Residual Motion Artifacts in Fetal fMRI Data

Fetal MRI by robust deep generative prior reconstruction and diffeomorphic registration: application to gestational age prediction

FetusMap: Fetal Pose Estimation in 3D Ultrasound

Spatio-angular Consistent Construction of Neonatal Diffusion MRI Atlases.

Detailed delineation of the fetal brain in diffusion MRI via multi-task learning

Streamline tractography of the fetal brain in utero with machine learning

The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning

HAITCH: A Framework for Distortion and Motion Correction in Fetal Multi-Shell Diffusion-Weighted MRI

Synthesis of realistic fetal MRI with conditional Generative Adversarial Networks

STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised Learning