Abstract:Objective: The goal of this work was to methodically evaluate, optimize, and validate a self-supervised machine learning algorithm capable of real-time automatic registration and fluoroscopic localization of the spine using a single radiograph or fluoroscopic frame. Methods: The authors propose a two-dimensional to three-dimensional (2D-3D) registration algorithm that maximizes an image similarity metric between radiographic images to identify the position of a C-arm relative to a 3D volume. This work utilizes digitally reconstructed radiographs (DRRs), which are synthetic radiographic images generated by simulating the x-ray projections as they would pass through a CT volume. To evaluate the algorithm, the authors used cone-beam CT data for 127 patients obtained from an open-source de-identified registry of cervical, thoracic, and lumbar scans. They systematically evaluated and tuned the algorithm, then quantified the convergence rate of the model by simulating C-arm registrations with 80 randomly simulated DRRs for each CT volume. The endpoints of this study were time to convergence, accuracy of convergence for each of the C-arm's degrees of freedom, and overall registration accuracy based on a voxel-by-voxel measurement. Results: A total of 10,160 unique radiographic images were simulated from 127 CT scans. The algorithm successfully converged to the correct solution 82% of the time with an average of 1.96 seconds of computation. The radiographic images for which the algorithm converged to the solution demonstrated 99.9% registration accuracy despite utilizing only single-precision computation for speed. The algorithm was found to be optimized for convergence when the search space was limited to a ± 45° offset in the right anterior oblique/left anterior oblique, cranial/caudal, and receiver rotation angles with the radiographic isocenter contained within 8000 cm3 of the volumetric center of the CT volume. Conclusions: The investigated machine learning algorithm has the potential to aid surgeons in level localization, surgical planning, and intraoperative navigation through a completely automated 2D-3D registration process. Future work will focus on algorithmic optimizations to improve the convergence rate and speed profile.

Hardware Accelerated Ray Cast of Volume Data and Volume Gradient for an Optimized Splines-Based Multi-Resolution 2D-3D Registration

An Optimized Spline-Based Registration of a 3D CT to a Set of C-Arm Images.

[Accurate 3D free-form registration between fan-beam CT and cone-beam CT].

Multiple Segmentation for Medical 2D/3D Registration

Real-time 6DoF pose recovery from X-ray images using library-based DRR and hybrid optimization

Fast DRR splat rendering using common consumer graphics hardware

Non-rigid Free-Form 2D–3D Registration Using a B-spline-based Statistical Deformation Model

2D-3D Regularized Deformable B-Spline Registration: Application to the Proximal Femur.

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

A novel approach to 2D/3D registration of X-ray images using Grangeat's relation

Fast reconstructed radiographs from octree-compressed volumetric data

Rapid 2D-3D Medical Image Registration Based on CUDA

DRR acceleration using inexpensive GPUs for model-image registration based joint kinematic measurements

2D-3D Medical Image Registration Based on GPU

Nonrigid Registration Based on Multi-level B-spline Interpolation Approach

Automatic Intensity-Based 3D-to-2d Registration of CT Volume and Dual-Energy Digital Radiography for the Detection of Cardiac Calcification

A Method of 3D‐3D Multi‐stage Non‐rigid Registration of the Spine Based on Binocular Structured Light

Non-rigid image registration using spatially region-weighted correlation ratio and GPU-acceleration

Artifacts Reduction in 4D-CBCT Via a Joint Free-form Registration Method of Projection Match and Gradient Constraint

Automatic 3D-to-2d Registration for Ct and Dual-Energy Digital Radiography for Calcification Detection

Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph