Abstract:Background: Surgical robots are gaining increasing popularity because of their capability to improve the precision of pedicle screw placement. However, current surgical robots rely on unimodal computed tomography (CT) images as baseline images, limiting their visualization to vertebral bone structures and excluding soft tissue structures such as intervertebral discs and nerves. This inherent limitation significantly restricts the applicability of surgical robots. To address this issue and further enhance the safety and accuracy of robot-assisted pedicle screw placement, this study will develop a software system for surgical robots based on multimodal image fusion. Such a system can extend the application range of surgical robots, such as surgical channel establishment, nerve decompression, and other related operations. Methods: Initially, imaging data of the patients included in the study are collected. Professional workstations are employed to establish, train, validate, and optimize algorithms for vertebral bone segmentation in CT and magnetic resonance (MR) images, intervertebral disc segmentation in MR images, nerve segmentation in MR images, and registration fusion of CT and MR images. Subsequently, a spine application model containing independent modules for vertebrae, intervertebral discs, and nerves is constructed, and a software system for surgical robots based on multimodal image fusion is designed. Finally, the software system is clinically validated. Discussion: We will develop a software system based on multimodal image fusion for surgical robots, which can be applied to surgical access establishment, nerve decompression, and other operations not only for robot-assisted nail placement. The development of this software system is important. First, it can improve the accuracy of pedicle screw placement, percutaneous vertebroplasty, percutaneous kyphoplasty, and other surgeries. Second, it can reduce the number of fluoroscopies, shorten the operation time, and reduce surgical complications. In addition, it would be helpful to expand the application range of surgical robots by providing key imaging data for surgical robots to realize surgical channel establishment, nerve decompression, and other operations.

The New Progress of Stereotactic Surgery Planning System

Key Technologies and Progresses of Miniaturized Microscopic Imaging System(Invited)

A Virtual Brain for Stereotactic Planning and Supporting Neurosurgery.

Three dimensional printing technology in neurosurgery

A Novel Method and System for Stereotactic Surgical Procedures

Automatic Path-Planning Techniques for Minimally Invasive Stereotactic Neurosurgical Procedures-A Systematic Review

A Semi-Autonomous Stereotactic Brain Biopsy Robotic System With Enhanced Surgical Safety and Surgeon-Robot Collaboration

ACCURATE STEREOTAXIC LOCALIZATION USING COMPUTERIZED TOMOGRAPHY WITH GEOMETRIC CORRECTION

Stereotactic Co-Axial Projection Imaging for Augmented Reality Neuronavigation: a Proof-of-concept Study

The 3-Dimensional Intelligent Structured Light Technique: A New Registration Method in Stereotactic Neurosurgery

Study on robot-assisted minimally invasive neurosurgery and its clinical application

Robotic System for MRI-Guided Stereotactic Neurosurgery

Orthotopic Coaxial Projective Imaging for Neurosurgical Navigation

Optical augmented reality assisted nagivation system for neurosurgery teaching and planning

Development of a software system for surgical robots based on multimodal image fusion: study protocol

Interactive Multi-Stage Robotic Positioner for Intra-Operative MRI-Guided Stereotactic Neurosurgery

Space registration and practice of a brain surgery robot based on optical localization

Application of Multimodal Image Fusion Technology in Brain Tumor Surgical Procedure

Accurate preoperative path planning with coarse-to-refine segmentation for image guided deep brain stimulation

The application progress of PET-MRI new technique

Patient Registration of Intelligent Surgical Navigation System--Based on Improved ICP Algorithm