Spine Vision X-Ray Image based GUI Planning of Pedicle Screws Using Enhanced YOLOv5 for Vertebrae Segmentation

Yashwanth Rao,Gaurisankar S,Durga R,Aparna Purayath,Vivek Maik,Manojkumar Lakshmanan,Mohanasankar Sivaprakasm

2024-07-11

Abstract:In this paper, we propose an innovative Graphical User Interface (GUI) aimed at improving preoperative planning and intra-operative guidance for precise spinal screw placement through vertebrae segmentation. The methodology encompasses both front-end and back-end computations. The front end comprises a GUI that allows surgeons to precisely adjust the placement of screws on X-Ray images, thereby improving the simulation of surgical screw insertion in the patient's spine. On the other hand, the back-end processing involves several steps, including acquiring spinal X-ray images, performing pre-processing techniques to reduce noise, and training a neural network model to achieve real-time segmentation of the vertebrae. The integration of vertebral segmentation in the GUI ensures precise screw placement, reducing complications like nerve injury and ultimately improving surgical outcomes. The Spine-Vision provides a comprehensive solution with innovative features like synchronous AP-LP planning, accurate screw positioning via vertebrae segmentation, effective screw visualization, and dynamic position adjustments. This X-ray image-based GUI workflow emerges as a valuable tool, enhancing precision and safety in spinal screw placement and planning procedures.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to improve the accuracy and safety of preoperative planning and intraoperative guidance for spinal pedicle screw placement. Specifically, the authors proposed a graphical user interface (GUI) system based on X - ray images - Spine Vision, which is used for pedicle screw planning and placement.

### Main problems and solutions

1. **Limitations of existing methods**:
- Existing spinal surgery planning systems mainly rely on 3D CT scans or tools, and these methods have some limitations in practical applications, such as high equipment costs and complex operations.
- The traditional manual planning process is prone to human errors, especially in complex spinal surgeries, which may lead to complications such as nerve damage.

2. **Innovations of the Spine Vision system**:
- **Integrated GUI and deep learning**: By combining the graphical user interface and the enhanced YOLOv5 algorithm, real - time segmentation and localization of vertebral bodies from X - ray images are achieved.
- **Synchronized AP - LP views**: It provides the synchronous planning function of anteroposterior (AP) and lateral (LP) views, ensuring the coordination between the two perspectives.
- **Accurate screw placement**: By using the improved YOLOv5 model, more accurate vertebral body segmentation is achieved, thereby improving the accuracy of screw placement.
- **Efficient workflow**: The entire system includes the front - end GUI design and the back - end image processing, allowing doctors to adjust the screw position in a simulated environment, reducing the uncertainty and risk during surgery.

### Technical details

- **Enhanced YOLOv5 model**: The Adaptive Fusion (AF) module and the Co - ordinate Attention (CA) mechanism are introduced to better capture the complex features in spinal X - ray images.
- **Multi - scale representation**: The Spatial Pyramid Pooling - Fast (SPPF) module is used to process objects at different scales, improving the accuracy and efficiency of feature extraction.
- **Real - time performance**: The inference time of the model is only 2.8 milliseconds, enabling real - time processing on high - performance laptops.

### Conclusion

Through the above innovations, the Spine Vision system aims to provide a comprehensive and efficient solution, significantly improve the accuracy and safety of pedicle screw placement in spinal surgeries, reduce the risk of surgical complications, and improve the prognosis of patients.