Abstract:Objective: The goal of this work was to methodically evaluate, optimize, and validate a self-supervised machine learning algorithm capable of real-time automatic registration and fluoroscopic localization of the spine using a single radiograph or fluoroscopic frame. Methods: The authors propose a two-dimensional to three-dimensional (2D-3D) registration algorithm that maximizes an image similarity metric between radiographic images to identify the position of a C-arm relative to a 3D volume. This work utilizes digitally reconstructed radiographs (DRRs), which are synthetic radiographic images generated by simulating the x-ray projections as they would pass through a CT volume. To evaluate the algorithm, the authors used cone-beam CT data for 127 patients obtained from an open-source de-identified registry of cervical, thoracic, and lumbar scans. They systematically evaluated and tuned the algorithm, then quantified the convergence rate of the model by simulating C-arm registrations with 80 randomly simulated DRRs for each CT volume. The endpoints of this study were time to convergence, accuracy of convergence for each of the C-arm's degrees of freedom, and overall registration accuracy based on a voxel-by-voxel measurement. Results: A total of 10,160 unique radiographic images were simulated from 127 CT scans. The algorithm successfully converged to the correct solution 82% of the time with an average of 1.96 seconds of computation. The radiographic images for which the algorithm converged to the solution demonstrated 99.9% registration accuracy despite utilizing only single-precision computation for speed. The algorithm was found to be optimized for convergence when the search space was limited to a ± 45° offset in the right anterior oblique/left anterior oblique, cranial/caudal, and receiver rotation angles with the radiographic isocenter contained within 8000 cm3 of the volumetric center of the CT volume. Conclusions: The investigated machine learning algorithm has the potential to aid surgeons in level localization, surgical planning, and intraoperative navigation through a completely automated 2D-3D registration process. Future work will focus on algorithmic optimizations to improve the convergence rate and speed profile.

Fully Automatic Detection Of Cylindrical Object From Calibrated C-Arm Images

RANSAC-based EM Algorithm for Robust Detection and Segmentation of Cylindrical Fragments from Calibrated C-arm Images.

Automated Detection and Segmentation of Cylindrical Fragments from Calibrated C-arm Images for Long Bone Fracture Reduction

An automatic calibration algorithm for endoscopic structured light sensors in cylindrical environment

Automated Detection and Segmentation of Diaphyseal Bone Fragments from Registered C-Arm Images for Long Bone Fracture Reduction

A Fully Automatic Fiducial Detection and Correspondence Establishing Method for Online C-arm Calibration

Robust Automatic Detection and Removal of Fiducial Projections in Fluoroscopy Images: an Integrated Solution

Fully automatic online geometric calibration for non‐circular cone‐beam CT orbits using fiducials with unknown placement

Automatic Extraction Of Proximal Femur Contours From Calibrated X-Ray Images Using 3d Statistical Models: An In Vitro Study

Automatic pose recovery of the distal locking holes from single calibrated fluoroscopic image for computer-assisted intramedullary nailing of femoral shaft fractures

Automatic Extraction of Femur Contours from Calibrated X-Ray Images Using Statistical Information

Calibration of X-ray Radiographs and Its Feasible Application for 2D/3D Reconstruction of the Proximal Femur

Automatic Extraction of Femur Contours from Calibrated Fluoroscopic Images

Automatic Reconstruction Of A Patient-Specific Surface Model Of A Proximal Femur From Calibrated X-Ray Images Via Bayesian Filters

Automatic Extraction of Proximal Femur Contours from Calibrated X-Ray Images Using 3D Statistical Models

Automatic intraoperative stitching of nonoverlapping cone-beam CT acquisitions

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

Automatic Extraction of Femur Contours from Calibrated X-Ray Images: A Bayesian Inference Approach

Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph

Automatic Identification and Autonomous Sorting of Cylindrical Parts in Cluttered Scene Based on Monocular Vision 3D Reconstruction

X-ray image calibration and its application to clinical orthopedics