Abstract:Fetal magnetic resonance imaging (MRI) is challenged by uncontrollable, large, and irregular fetal movements. It is, therefore, performed through visual monitoring of fetal motion and repeated acquisitions to ensure diagnostic-quality images are acquired. Nevertheless, visual monitoring of fetal motion based on displayed slices, and navigation at the level of stacks-of-slices is inefficient. The current process is highly operator-dependent, increases scanner usage and cost, and significantly increases the length of fetal MRI scans which makes them hard to tolerate for pregnant women. To help build automatic MRI motion tracking and navigation systems to overcome the limitations of the current process and improve fetal imaging, we have developed a new real-time image-based motion tracking method based on deep learning that learns to predict fetal motion directly from acquired images. Our method is based on a recurrent neural network, composed of spatial and temporal encoder-decoders, that infers motion parameters from anatomical features extracted from sequences of acquired slices. We compared our trained network on held-out test sets (including data with different characteristics, e.g. different fetuses scanned at different ages, and motion trajectories recorded from volunteer subjects) with networks designed for estimation as well as methods adopted to make predictions. The results show that our method outperformed alternative techniques, and achieved real-time performance with average errors of 3.5 and 8 degrees for the estimation and prediction tasks, respectively. Our real-time deep predictive motion tracking technique can be used to assess fetal movements, to guide slice acquisitions, and to build navigation systems for fetal MRI.

4D iterative reconstruction of brain fMRI in the moving fetus

Spatio-temporal motion correction and iterative reconstruction of in-utero fetal fMRI

Mapping Fetal Brain Development Based on Automated Segmentation and 4D Brain Atlasing

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Real-time fetal brain tracking for functional fetal MRI

Motion Correction and Volumetric Reconstruction for Fetal Functional Magnetic Resonance Imaging Data

Quantifying Residual Motion Artifacts in Fetal fMRI Data

Improved 4D cardiac functional assessment for pediatric patients using motion-weighted image reconstruction

An Automated Framework for Localization, Segmentation and Super-Resolution Reconstruction of Fetal Brain MRI

Super-Resolution Reconstruction of Fetal Brain MRI with Prior Anatomical Knowledge

On Super-Resolution for Fetal Brain MRI

Fetal Pose Estimation in Volumetric MRI using a 3D Convolution Neural Network

Deep Predictive Motion Tracking in Magnetic Resonance Imaging: Application to Fetal Imaging

T2 Mapping from Super-Resolution-Reconstructed Clinical Fast Spin Echo Magnetic Resonance Acquisitions

FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model

Self-Supervised Isotropic Superresolution Fetal Brain MRI

Fetal MRI by robust deep generative prior reconstruction and diffeomorphic registration: application to gestational age prediction

Fetal behavior during MRI changes with age and relates to network dynamics

EchoFusion: Tracking and Reconstruction of Objects in 4D Freehand Ultrasound Imaging without External Trackers

AFFIRM: Affinity Fusion-based Framework for Iteratively Random Motion correction of multi-slice fetal brain MRI

Real-Time Automatic Fetal Brain Extraction in Fetal MRI by Deep Learning