Abstract:The use of preoperative CT and intraoperative fluoroscopic-guided surgical robotic assistance for spinal disease treatment has gained significant attention among surgeons. However, the intraoperative robotic systems lack guidance based on three-dimensional anatomical structures, rendering them unusable when there is a mismatch between preoperative CT and intraoperative fluoroscopy. Additionally, the continuous X-ray imaging during fluoroscopy exposes the patient to significant radiation risks. This paper proposes a 2D/3D registration method to reconstruct 3D patient spine geometry from frontal-view X-ray images. Our aim is to combine this method with intraoperative robotic assistance for spine procedures, enabling three-dimensional spatial navigation for the robotic system and reducing patient radiation exposure. By utilizing 45 frontal-view X-ray images of patients with scoliosis, we trained a 3D trunk anatomy SSM specific to scoliosis. For the registration, a 2D registration-back projection strategy was employed, which first generates the simulated X-ray projection image of the 3D SSM, then non-rigidly registers the projection image with the patient X-ray image, and finally back-project the 2D registration into 3D to guide the shape deformation of the 3D SSM. This approach was evaluated using X-ray images of 10 scoliosis patients. The results demonstrate the ability to reconstruct the anatomical structure and curvature of the spine in X-ray images. The registration accuracy of the SSM was assessed by visualizing the alignment between the registered model and X-ray images, as well as calculating the average distance between the vertebral disc center points of the model and expert-annotated anatomical landmarks in the patient’s X-rays. The average distance between the registered model’s vertebral disc centers and the patient’s X-ray anatomical positions was 11.38 mm. The registered model exhibited a high degree of alignment with the curvature of the spine in X-ray images.

Compliant Joint Based Robotic Ultrasound Scanning System for Imaging Human Spine

Self-Adaptive Ultrasound Scanning System for Imaging Human Spine

Ultrasound Robotic System to Multi-Approach Puncture for Endoscopic Spinal Surgery

A Robot-Assisted Spine Surgery System Based on Intraoperative 2D Fluoroscopy Navigation

A Virtual Scanning Framework for Robotic Spinal Sonography with Automatic Real-time Recognition of Standard Views

Class-Aware Cartilage Segmentation for Autonomous US-CT Registration in Robotic Intercostal Ultrasound Imaging

Precise Repositioning of Robotic Ultrasound: Improving Registration-Based Motion Compensation Using Ultrasound Confidence Optimization

Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion

Autonomous ultrasound scanning robotic system based on human posture recognition and image servo control: an application for cardiac imaging

Robot-assisted ultrasound reconstruction for spine surgery: from bench-top to pre-clinical study

Automatic ultrasound scanning robotic system with optical waveguide-based force measurement

Motion-Aware Robotic 3D Ultrasound

2D/3D Shape Model Registration with X-ray Images for Patient-Specific Spine Geometry Reconstruction.

Force-Ultrasound Fusion: Bringing Spine Robotic-US to the Next "Level"

Towards Safe and Collaborative Robotic Ultrasound Tissue Scanning in Neurosurgery

Kinematics and Cooperative Control of a Robotic Spinal Surgery System

Follow the Curve: Robotic-Ultrasound Navigation with Learning Based Localization of Spinous Processes for Scoliosis Assessment

Comanipulation Robotic Platform for Spine Surgery With Exteroceptive Visual Coupling: Development and Experimentation

Ultrasound Image Guided and Mixed Reality-Based Surgical System With Real-Time Soft Tissue Deformation Computing for Robotic Cervical Pedicle Screw Placement

Robotic Arm Based Automatic Ultrasound Scanning for Three-Dimensional Imaging

Guiding the Last Centimeter: Novel Anatomy-Aware Probe Servoing for Standardized Imaging Plane Navigation in Robotic Lung Ultrasound