Abstract:Purpose: Ultrasound is often the preferred modality for image-guided therapy or treatment in organs such as liver due to real-time imaging capabilities. However, the reduced conspicuity of tumors in ultrasound images adversely impacts the precision and accuracy of treatment delivery. This problem is compounded by deformable motion due to breathing and other physiological activity. This creates the need for a fusion method to align interventional US with pre-interventional modalities that provide superior soft-tissue contrast (e.g., MRI) to accurately target a structure-of-interest and compensate for liver motion. Method: In this work, we developed a hybrid deformable fusion method to align 3D pre-interventional MRI and 3D interventional US volumes to target the structures-of-interest in liver accurately in real-time. The deformable multimodal fusion method involved an offline alignment of a pre-intervention MRI with a pre-intervention US volume using a traditional registration method, followed by real-time prediction of deformation using a trained deep-learning model between interventional US volumes across different respiratory states. This framework enables motion-compensated MRI-US image fusion in real-time for image-guided treatment. Results: The proposed hybrid deformable registration method was evaluated on three healthy volunteers across the pre-intervention MRI and 20 US volume pairs in the free-breathing respiratory cycle. The mean Euclidean landmark distance of three homologous targets in all three volunteers was less than 3 mm for percutaneous liver procedures. Conclusions: Preliminary results show that clinically acceptable registration accuracies for near real-time, deformable MRI-US fusion can be achieved by our proposed hybrid approach. The proposed combination of traditional and deep-learning deformable registration techniques is thus a promising approach for motion-compensated MRI-US fusion to improve targeting in image-guided liver interventions.

Three-dimensional nonrigid registration and fusion for image-guided surgery navigation system

Three-dimensional multimodal image non-rigid registration and fusion in a High Intensity Focused Ultrasound system.

A Hifu Localization System Based On Two-Dimensional Multimodality Image Registration

Medical Image Registration Algorithm in Image-Guided Noninvasive Surgery

Free-form deformation based non-rigid registration on breast cancer MR imaging

Ultrasound Frame-to-Volume Registration via Deep Learning for Interventional Guidance

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

Registration of 3D FMT and CT Images of Mouse Via Affine Transformation with Bayesian Iterative Closest Points

Registration Of 3d Fmt And Ct Images Of Mouse Via Affine Transformation Using Sequential Monte Carlo

Registration Of 3-D Ct And 2-D Flat Images Of Mouse Via Affine Transformation

Experimental and Preliminary Clinical Study of Real-Time Registration in Liver Tumors During Respiratory Motion Based on a Multimodality Image Navigation System

3D ultrasound guided navigation system with hybrid image fusion

A novel algorithm for CT-ultrasound registration

Methods of three dimensional registration in the image guided surgery

2D/3D registration based on biplanar X-ray and CT images for surgical navigation

SU-E-U-11: Deformable Registration of CT and Ultrasound Images for Radiation Treatment of Skin Cancer

A Hybrid Genetic Algorithm for Multi-Modal Image Registration

A deep learning approach for 2D ultrasound and 3D CT/MR image registration in liver tumor ablation

Research on Non-rigid Registration in Uterine Fibroids MR Imaging

A hybrid deformable registration method to generate motion-compensated 3D virtual MRI for fusion with interventional real-time 3D ultrasound

Non-rigid registration of 3D ultrasound for neurosurgery using automatic feature detection and matching