Abstract:This study tackles key obstacles in adopting surgical navigation in orthopedic surgeries, including time, cost, radiation, and workflow integration challenges. Recently, our work X23D showed an approach for generating 3D anatomical models of the spine from only a few intraoperative fluoroscopic images. This negates the need for conventional registration-based surgical navigation by creating a direct intraoperative 3D reconstruction of the anatomy. Despite these strides, the practical application of X23D has been limited by a domain gap between synthetic training data and real intraoperative images. In response, we devised a novel data collection protocol for a paired dataset consisting of synthetic and real fluoroscopic images from the same perspectives. Utilizing this dataset, we refined our deep learning model via transfer learning, effectively bridging the domain gap between synthetic and real X-ray data. A novel style transfer mechanism also allows us to convert real X-rays to mirror the synthetic domain, enabling our in-silico-trained X23D model to achieve high accuracy in real-world settings. Our results demonstrated that the refined model can rapidly generate accurate 3D reconstructions of the entire lumbar spine from as few as three intraoperative fluoroscopic shots. It achieved an 84% F1 score, matching the accuracy of our previous synthetic data-based research. Additionally, with a computational time of only 81.1 ms, our approach provides real-time capabilities essential for surgery integration. Through examining ideal imaging setups and view angle dependencies, we've further confirmed our system's practicality and dependability in clinical settings. Our research marks a significant step forward in intraoperative 3D reconstruction, offering enhancements to surgical planning, navigation, and robotics.

Domain adaptation using AdaBN and AdaIN for high-resolution IVD mesh reconstruction from clinical MRI

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

An intensity-based self-supervised domain adaptation method for intervertebral disc segmentation in magnetic resonance imaging

Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks

Embracing the disharmony in medical imaging: A Simple and effective framework for domain adaptation

Domain Adaptation using Silver Standard Masks for Lateral Ventricle Segmentation in FLAIR MRI

Domain Adaptation for Real-World Single View 3D Reconstruction

Data Augmentation-Based Unsupervised Domain Adaptation In Medical Imaging

Knowledge distillation for semi-supervised domain adaptation

A Novel Domain Adaptation Framework for Medical Image Segmentation.

PnP-AdaNet: Plug-and-Play Adversarial Domain Adaptation Network at Unpaired Cross-Modality Cardiac Segmentation

Domain adaptation strategies for 3D reconstruction of the lumbar spine using real fluoroscopy data

DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

PnP-AdaNet: Plug-and-Play Adversarial Domain Adaptation Network with a Benchmark at Cross-modality Cardiac Segmentation

Deep learning for unsupervised domain adaptation in medical imaging: Recent advancements and future perspectives

Domain Expansion via Network Adaptation for Solving Inverse Problems

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

Leveraging 2D Deep Learning ImageNet-trained models for Native 3D Medical Image Analysis

Prospective Deployment of Deep Learning in MRI: A Framework for Important Considerations, Challenges, and Recommendations for Best Practices

Adaptive Local Neighborhood-based Neural Networks for MR Image Reconstruction from Undersampled Data