Abstract:Background: Surgical robots are gaining increasing popularity because of their capability to improve the precision of pedicle screw placement. However, current surgical robots rely on unimodal computed tomography (CT) images as baseline images, limiting their visualization to vertebral bone structures and excluding soft tissue structures such as intervertebral discs and nerves. This inherent limitation significantly restricts the applicability of surgical robots. To address this issue and further enhance the safety and accuracy of robot-assisted pedicle screw placement, this study will develop a software system for surgical robots based on multimodal image fusion. Such a system can extend the application range of surgical robots, such as surgical channel establishment, nerve decompression, and other related operations. Methods: Initially, imaging data of the patients included in the study are collected. Professional workstations are employed to establish, train, validate, and optimize algorithms for vertebral bone segmentation in CT and magnetic resonance (MR) images, intervertebral disc segmentation in MR images, nerve segmentation in MR images, and registration fusion of CT and MR images. Subsequently, a spine application model containing independent modules for vertebrae, intervertebral discs, and nerves is constructed, and a software system for surgical robots based on multimodal image fusion is designed. Finally, the software system is clinically validated. Discussion: We will develop a software system based on multimodal image fusion for surgical robots, which can be applied to surgical access establishment, nerve decompression, and other operations not only for robot-assisted nail placement. The development of this software system is important. First, it can improve the accuracy of pedicle screw placement, percutaneous vertebroplasty, percutaneous kyphoplasty, and other surgeries. Second, it can reduce the number of fluoroscopies, shorten the operation time, and reduce surgical complications. In addition, it would be helpful to expand the application range of surgical robots by providing key imaging data for surgical robots to realize surgical channel establishment, nerve decompression, and other operations.

Research and development of intraoperative medical images and texts recording report system and its clinical application

Establishment and application of a multimedia real-time teaching and training system for laparoscopic operation

Intraoperative medical images and texts recording report:explore the new models of digital precision teaching

The development of real-time tracking of soft tissue deformation based on electromagnetic ;positioning

Analysis of Intraoperative Microscopy Imaging Techniques and Their Future Applications

Exploration Of New Teaching Mode Of Precision Digital Surgery-Voice-Controlled Video Recording & Documentation System For Surgical Operations

Development of a Micro Intelligent Surgery Lighting Camera

Intelligent digital spinal operation device

A Research and Development of a Patient Oriented Multimedia Computer Patient Record System

Automatic retinal image diagnosis system for mass health screenings

Computer-aided analysis system for hypertensive retinal image and its clinical application

Intra-operative Real-Time 3-D Information Display System Based on Integral Videography

The preliminary application and establishment of the remote digital diagnosis and treatment system for facial prostheses

[A computer-aided image diagnosis and study system]

3 D interactive surgical visualization system 2 3 D Interactive Surgical Visualization System using Mobile Spatial Information Acquisition and Autostereoscopic Display

Development of a software system for surgical robots based on multimodal image fusion: study protocol

Development of Real-Time 3D Navigation System for Intra-operative Information by Integral Videography

Computer System for Medical Imaging Diagnostic Reports

A System Design of Image-Guided Automated Surgery Robot.

Application of KinectTM and wireless technology for patient data recording and viewing system in the course of surgery

A Novel Intraoperative Brain Mapping Integrated Task-Presentation Platform.