Abstract:Background In magnetic resonance image (MRI)‐guided radiotherapy (MRgRT), 2D rapid imaging is commonly used to track moving targets with high temporal frequency to minimize gating latency. However, anatomical motion is not constrained to 2D, and a portion of the target may be missed during treatment if 3D motion is not evaluated. While some MRgRT systems attempt to capture 3D motion by sequentially tracking motion in 2D orthogonal imaging planes, this approach assesses 3D motion via independent 2D measurements at alternating instances, lacking a simultaneous 3D motion assessment in both imaging planes. Purpose We hypothesized that a motion model could be derived from prior 2D orthogonal imaging to estimate 3D motion in both planes simultaneously. We present a manifold learning technique to estimate 3D motion from 2D orthogonal imaging. Methods Five healthy volunteers were scanned under an IRB‐approved protocol using a 3.0 T Siemens Skyra simulator. Images of the liver dome were acquired during free breathing (FB) with a 2.6 mm × 2.6 mm in‐plane resolution for approximately 10 min in alternating sagittal and coronal planes at ∼5 frames per second. The motion model was derived using a combined manifold learning and alignment approach based on locally linear embedding (LLE). The model utilized the spatially overlapping MRI signal shared by both imaging planes to group together images that had similar signals, enabling motion estimation in both planes simultaneously. The model's motion estimates were compared to the ground truth motion derived in each newly acquired image using deformable registration. A simulated target was defined on the dome of the liver and used to evaluate model performance. The Dice similarity coefficient and distance between the model‐tracked and image‐tracked contour centroids were evaluated. Motion modeling error was estimated in the orthogonal plane by back‐propagating the motion to the currently imaged plane and by interpolating the motion between image acquisitions where ground truth motion was available. Results The motion observed in the healthy volunteer studies ranged from 12.6 to 38.7 mm. On average, the model demonstrated sub‐millimeter precision and > 0.95 Dice coefficient compared to the ground truth motion observed in the currently imaged plane. The average Dice coefficient and centroid distance between the model‐tracked and ground truth target contours were 0.96 ± 0.03 and 0.26 mm ± 0.27 mm respectively across all volunteer studies. The out‐of‐plane centroid motion error was estimated to be 0.85 mm ± 1.07 mm and 1.26 mm ± 1.38 mm using the back‐propagation (BP) and interpolation error estimation methods. Conclusions The healthy volunteer studies indicate promising results using the proposed motion modeling technique. Out‐of‐plane modeling error was estimated to be higher but still demonstrated sub‐voxel motion accuracy.

Real-time myocardial landmark tracking for MRI-guided cardiac radio-ablation using Gaussian Processes

Gaussian Processes for real-time 3D motion and uncertainty estimation during MR-guided radiotherapy

Fast, automated, real-time 3D passive balloon catheter tracking during MRI-guided cardiac catheterization using orthogonal projection imaging and real-time image-based catheter detection

PILOT: Physics-Informed Learned Optimized Trajectories for Accelerated MRI

MRgRT real-time target localization using foundation models for contour point tracking and promptable mask refinement

Evaluation of the impact of cardiac implantable electronic devices on cine MRI for real‐time adaptive cardiac radioablation on a 1.5 T MR‐linac

Deep learning-based image reconstruction and motion estimation from undersampled radial k-space for real-time MRI-guided radiotherapy

SMART tracking: Simultaneous anatomical imaging and real-time passive device tracking for MR-guided interventions

Real‐time Radial Reconstruction with domain transform manifold learning for MRI‐guided radiotherapy

Online 4D ultrasound guidance for real-time motion compensation by MLC tracking

Stereo vision-based tracking of soft tissue motion with application to online ablation control in laser microsurgery

Real-time automatic fiducial marker tracking in low contrast cine-MV images

First experimental investigation of simultaneously tracking two independently moving targets on an MRI-linac using real-time MRI and MLC tracking

Simultaneous Motion Monitoring and Truth-In-Delivery Analysis Imaging Framework for MR-guided Radiotherapy

MR signature matching (MRSIGMA) implementation for true real-time free-breathing volumetric imaging with sub-200 ms latency on an MR-Linac

Real-Time Automated Target Volume and Motion Quantification for Adaptive Four-Dimensional Mri/Ct Guided Radiation Therapy

Real‐time 3D MR guided radiation therapy through orthogonal MR imaging and manifold learning

Real-time markerless tumour tracking with patient-specific deep learning using a personalized data generation strategy: Proof of concept by phantom study

WE-AB-303-08: Direct Lung Tumor Tracking Using Short Imaging Arcs

Deformable cardiac surface tracking by adaptive estimation algorithms

A System for Real-Time, Online Mixed-Reality Visualization of Cardiac Magnetic Resonance Images