Abstract:Background: Ultrasound (US) has demonstrated to be an effective guidance technique for lumbar spine injections, enabling precise needle placement without exposing the surgeon or the patient to ionizing radiation. However, noise and acoustic shadowing artifacts make US data interpretation challenging. To mitigate these problems, many authors suggested using computed tomography (CT)-to-US registration to align the spine in pre-operative CT to intra-operative US data, thus providing localization of spinal landmarks. Purpose: In this paper, we propose a deep learning (DL) pipeline for CT-to-US registration and address the problem of a need for annotated medical data for network training. Firstly, we design a data generation method to generate paired CT-US data where the spine is deformed in a physically consistent manner. Secondly, we train a point cloud (PC) registration network using anatomy-aware losses to enforce anatomically consistent predictions. Methods: Our proposed pipeline relies on training the network on realistic generated data. In our data generation method, we model the properties of the joints and disks between vertebrae based on biomechanical measurements in previous studies. We simulate the supine and prone position deformation by applying forces on the spine models. We choose the spine models from 35 patients in VerSe dataset. Each spine is deformed 10 times to create a noise-free data with ground-truth segmentation at hand. In our experiments, we use one-leave-out cross-validation strategy to measure the performance and the stability of the proposed method. For each experiment, we choose generated PCs from three spines as the test set. From the remaining, data from 3 spines act as the validation set and we use the rest of the data for training the algorithm. To train our network, we introduce anatomy-aware losses and constraints on the movement to match the physics of the spine, namely, rigidity loss and bio-mechanical loss. We define rigidity loss based on the fact that each vertebra can only transform rigidly while the disks and the surrounding tissue are deformable. Second, by using bio-mechanical loss we stop the network from inferring extreme movements by penalizing the force needed to get to a certain pose. Results: To validate the effectiveness of our fully automated data generation pipeline, we qualitatively assess the fidelity of the generated data. This assessment involves verifying the realism of the spinal deformation and subsequently confirming the plausibility of the simulated ultrasound images. Next, we demonstrate that the introduction of the anatomy-aware losses brings us closer to state-of-the-art (SOTA) and yields a reduction of 0.25 mm in terms of target registration error (TRE) compared to using only mean squared error (MSE) loss on the generated dataset. Furthermore, by using the proposed losses, the rigidity loss in inference decreases which shows that the inferred deformation respects the rigidity of the vertebrae and only introduces deformations in the soft tissue area to compensate the difference to the target PC. We also show that our results are close to the SOTA for the simulated US dataset with TRE of 3.89 mm and 3.63 mm for the proposed method and SOTA respectively. In addition, we show that our method is more robust against errors in the initialization in comparison to SOTA and significantly achieves better results (TRE of 4.88 mm compared to 5.66 mm) in this experiment. Conclusions: In conclusion, we present a pipeline for spine CT-to-US registration and explore the potential benefits of utilizing anatomy-aware losses to enhance registration results. Additionally, we propose a fully automatic method to synthesize paired CT-US data with physically consistent deformations, which offers the opportunity to generate extensive datasets for network training. The generated dataset and the source code for data generation and registration pipeline can be accessed via https://github.com/mfazampour/medphys_ct_us_registration.

Thoracic Cartilage Ultrasound-CT Registration using Dense Skeleton Graph

Skeleton Graph-based Ultrasound-CT Non-rigid Registration

Class-Aware Cartilage Segmentation for Autonomous US-CT Registration in Robotic Intercostal Ultrasound Imaging

Compliant Joint Based Robotic Ultrasound Scanning System for Imaging Human Spine

Soft-tissue sound-speed-aware ultrasound-CT registration method for computer-assisted orthopedic surgery

Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion

A novel algorithm for CT-ultrasound registration

Registration of CT and Ultrasound Images of the Spine with Neural Network and Orientation Code Mutual Information.

Anatomy-aware computed tomography-to-ultrasound spine registration

Cartilage estimation in noncontrast thoracic CT

Intelligent Coordinate Registration Method For Computer-Assisted Surgery

Unsupervised learning for deformable registration of thoracic CT and cone‐beam CT based on multiscale features matching with spatially adaptive weighting

Deformable 3D/3D CT-to-digital-tomosynthesis image registration in image-guided bronchoscopy interventions

Enabling Augmented Segmentation and Registration in Ultrasound-Guided Spinal Surgery via Realistic Ultrasound Synthesis from Diagnostic CT Volume

2D/3D registration based on biplanar X-ray and CT images for surgical navigation

3D Registration of Ultrasound Images Based on Morphology Skeleton.

Estimation of Cartilaginous Region in Noncontrast CT of the Chest

Fluid registration between lung CT and stationary chest tomosynthesis images

4D-CT Lung registration using anatomy-based multi-level multi-resolution optical flow analysis and thin-plate splines

Rigid point cloud registration based on correspondence cloud for image‐to‐patient registration in image‐guided surgery

Rigid Registration of Freehand 3D Ultrasound and CT-Scan Kidney Images