Abstract:In image-guided spine surgery, robust three-dimensional to two-dimensional (3D-2D) registration of preoperative computed tomography (CT) and intraoperative radiographs can be challenged by the image content mismatch associated with the presence of surgical instrumentation and implants as well as soft-tissue resection or deformation. This work investigates image similarity metrics in 3D-2D registration offering improved robustness against mismatch, thereby improving performance and reducing or eliminating the need for manual masking. The performance of four gradient-based image similarity metrics (gradient information (GI), gradient correlation (GC), gradient information with linear scaling (GS), and gradient orientation (GO)) with a multi-start optimization strategy was evaluated in an institutional review board-approved retrospective clinical study using 51 preoperative CT images and 115 intraoperative mobile radiographs. Registrations were tested with and without polygonal masks as a function of the number of multistarts employed during optimization. Registration accuracy was evaluated in terms of the projection distance error (PDE) and assessment of failure modes (PDE > 30 mm) that could impede reliable vertebral level localization. With manual polygonal masking and 200 multistarts, the GC and GO metrics exhibited robust performance with 0% gross failures and median PDE < 6.4 mm (±4.4 mm interquartile range (IQR)) and a median runtime of 84 s (plus upwards of 1-2 min for manual masking). Excluding manual polygonal masks and decreasing the number of multistarts to 50 caused the GC-based registration to fail at a rate of >14%; however, GO maintained robustness with a 0% gross failure rate. Overall, the GI, GC, and GS metrics were susceptible to registration errors associated with content mismatch, but GO provided robust registration (median PDE = 5.5 mm, 2.6 mm IQR) without manual masking and with an improved runtime (29.3 s). The GO metric improved the registration accuracy and robustness in the presence of strong image content mismatch. This capability could offer valuable assistance and decision support in spine level localization in a manner consistent with clinical workflow.

2D/3D Multimode Medical Image Registration Based on Normalized Cross-Correlation

An Image Registration Approach Based on 3D Geometric Projection Similarity of the Human Head

Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimization

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

An Iterative Method for Gastroscopic Image Registration.

3D–2D image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch

Methods of three dimensional registration in the image guided surgery

Registration of 2D C-Arm and 3D CT Images for a C-Arm Image-Assisted Navigation System for Spinal Surgery

Enhancing the depth perception of DSA images with 2D–3D registration

Multi-step 3D/2D Image Registration for Image-guided Spinal Surgery

2D/3D registration based on biplanar X-ray and CT images for surgical navigation

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Non-rigid Registration of Multimodality Medical Images Based on ITK

Multi-Step 2D/3D Image Registration in Image-Guided Spine Surgery

Automated Global Optimization Surface-Matching Registration Method for Image-to-Patient Spatial Registration in an Image-Guided Neurosurgery System

Fast Registration of Intraoperative Ultrasound and Preoperative MR Images Based on Calibrations of 2D and 3D Ultrasound Probes

Global Optimization Surface-Based Registration for Image-to-Patient Registration Using Gaussian Mixture Model

Robust and efficient 3D registration via depth map-based feature point matching in image-guided neurosurgery

2D/3D registration and motion tracking for surgical interventions

Non-rigid image registration using spatially region-weighted correlation ratio and GPU-acceleration

Multimodal Medical Image Registration Using Geometric Flow and Gabor Filter