Abstract:Purpose: Ultrasound is often the preferred modality for image-guided therapy or treatment in organs such as liver due to real-time imaging capabilities. However, the reduced conspicuity of tumors in ultrasound images adversely impacts the precision and accuracy of treatment delivery. This problem is compounded by deformable motion due to breathing and other physiological activity. This creates the need for a fusion method to align interventional US with pre-interventional modalities that provide superior soft-tissue contrast (e.g., MRI) to accurately target a structure-of-interest and compensate for liver motion. Method: In this work, we developed a hybrid deformable fusion method to align 3D pre-interventional MRI and 3D interventional US volumes to target the structures-of-interest in liver accurately in real-time. The deformable multimodal fusion method involved an offline alignment of a pre-intervention MRI with a pre-intervention US volume using a traditional registration method, followed by real-time prediction of deformation using a trained deep-learning model between interventional US volumes across different respiratory states. This framework enables motion-compensated MRI-US image fusion in real-time for image-guided treatment. Results: The proposed hybrid deformable registration method was evaluated on three healthy volunteers across the pre-intervention MRI and 20 US volume pairs in the free-breathing respiratory cycle. The mean Euclidean landmark distance of three homologous targets in all three volunteers was less than 3 mm for percutaneous liver procedures. Conclusions: Preliminary results show that clinically acceptable registration accuracies for near real-time, deformable MRI-US fusion can be achieved by our proposed hybrid approach. The proposed combination of traditional and deep-learning deformable registration techniques is thus a promising approach for motion-compensated MRI-US fusion to improve targeting in image-guided liver interventions.

Three-dimensional multimodal image non-rigid registration and fusion in a High Intensity Focused Ultrasound system.

Three-dimensional nonrigid registration and fusion for image-guided surgery navigation system

A Hifu Localization System Based On Two-Dimensional Multimodality Image Registration

Free-form deformation based non-rigid registration on breast cancer MR imaging

Research on Non-rigid Registration in Uterine Fibroids MR Imaging

Registration Of 3d Fmt And Ct Images Of Mouse Via Affine Transformation Using Sequential Monte Carlo

Ultrasound Frame-to-Volume Registration via Deep Learning for Interventional Guidance

Experimental and Preliminary Clinical Study of Real-Time Registration in Liver Tumors During Respiratory Motion Based on a Multimodality Image Navigation System

Study of image location for the high intensity focused ultrasound therapy system.

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

Registration of 3D FMT and CT Images of Mouse Via Affine Transformation with Bayesian Iterative Closest Points

A hybrid deformable registration method to generate motion-compensated 3D virtual MRI for fusion with interventional real-time 3D ultrasound

A novel algorithm for CT-ultrasound registration

Modeling and Predicting Tissue Movement and Deformation for High Intensity Focused Ultrasound Therapy

Registration Of 3-D Ct And 2-D Flat Images Of Mouse Via Affine Transformation

A deep learning approach for 2D ultrasound and 3D CT/MR image registration in liver tumor ablation

Medical Image Registration Algorithm in Image-Guided Noninvasive Surgery

SU-E-U-11: Deformable Registration of CT and Ultrasound Images for Radiation Treatment of Skin Cancer

A Hybrid Genetic Algorithm for Multi-Modal Image Registration

Ultrasound to CT rigid image registration using CNN for the HIFU treatment of heart arrhythmias

Deep Regression 2D-3D Ultrasound Registration for Liver Motion Correction in Focal Tumor Thermal Ablation