Abstract:Background: Image-guided neurosurgery requires high localization and registration accuracy to enable effective treatment and avoid complications. However, accurate neuronavigation based on preoperative magnetic resonance (MR) or computed tomography (CT) images is challenged by brain deformation occurring during the surgical intervention. Purpose: To facilitate intraoperative visualization of brain tissues and deformable registration with preoperative images, a 3D deep learning (DL) reconstruction framework (termed DL-Recon) was proposed for improved intraoperative cone-beam CT (CBCT) image quality. Methods: The DL-Recon framework combines physics-based models with deep learning CT synthesis and leverages uncertainty information to promote robustness to unseen features. A 3D generative adversarial network (GAN) with a conditional loss function modulated by aleatoric uncertainty was developed for CBCT-to-CT synthesis. Epistemic uncertainty of the synthesis model was estimated via Monte Carlo (MC) dropout. Using spatially varying weights derived from epistemic uncertainty, the DL-Recon image combines the synthetic CT with an artifact-corrected filtered back-projection (FBP) reconstruction. In regions of high epistemic uncertainty, DL-Recon includes greater contribution from the FBP image. Twenty paired real CT and simulated CBCT images of the head were used for network training and validation, and experiments evaluated the performance of DL-Recon on CBCT images containing simulated and real brain lesions not present in the training data. Performance among learning- and physics-based methods was quantified in terms of structural similarity (SSIM) of the resulting image to diagnostic CT and Dice similarity metric (DSC) in lesion segmentation compared to ground truth. A pilot study was conducted involving seven subjects with CBCT images acquired during neurosurgery to assess the feasibility of DL-Recon in clinical data. Results: CBCT images reconstructed via FBP with physics-based corrections exhibited the usual challenges to soft-tissue contrast resolution due to image non-uniformity, noise, and residual artifacts. GAN synthesis improved image uniformity and soft-tissue visibility but was subject to error in the shape and contrast of simulated lesions that were unseen in training. Incorporation of aleatoric uncertainty in synthesis loss improved estimation of epistemic uncertainty, with variable brain structures and unseen lesions exhibiting higher epistemic uncertainty. The DL-Recon approach mitigated synthesis errors while maintaining improvement in image quality, yielding 15%-22% increase in SSIM (image appearance compared to diagnostic CT) and up to 25% increase in DSC in lesion segmentation compared to FBP. Clear gains in visual image quality were also observed in real brain lesions and in clinical CBCT images. Conclusions: DL-Recon leveraged uncertainty estimation to combine the strengths of DL and physics-based reconstruction and demonstrated substantial improvements in the accuracy and quality of intraoperative CBCT. The improved soft-tissue contrast resolution could facilitate visualization of brain structures and support deformable registration with preoperative images, further extending the utility of intraoperative CBCT in image-guided neurosurgery.

A digital twin for simulating the vertebroplasty procedure and its impact on mechanical stability of vertebra in cancer patients

Patient-specific virtual spine straightening and vertebra inpainting: An automatic framework for osteoplasty planning

A continuum mechanical porous media model for vertebroplasty: Numerical simulations and experimental validation

Three-dimensional Finite Element Analysis of Optimal Distribution Model of Vertebroplasty.

Finite element analysis of vertebroplasty in the osteoporotic T11‐L1 vertebral body: Effects of bone cement formulation

Visual Simulation Surgery for Distal Femoral Fractures

A Three-Dimensional Cement Quantification Method for Decision Prediction of Vertebral Recompression after Vertebroplasty

Stereotactic Vertebroplasty for Spinal Metastases with Multilevel Bilateral Pedicle Fractures: A Technical Note

An Innovative Technique for Osteoporotic Vertebral Compression Fractures - Vertebral Osteotome with Side-Opening Cannula

Optimization of Tumor Volume Reduction and Cement Augmentation in Percutaneous Vertebroplasty for Prophylactic Treatment of Spinal Metastases

Combining physics-based models with deep learning image synthesis and uncertainty in intraoperative cone-beam CT of the brain

Preliminary Report of Three-Dimensional Reconstructive Intraoperative C-Arm in Percutaneous Vertebroplasty

Clinical Application of Three-Dimensional Printing Technology in Percutaneous Vertebroplasty

Evaluation of multidetector CT Hounsfield unit measurements as a predictor of efficacy and complications in percutaneous vertebroplasty for osteoporotic vertebral compression fractures

Effect of cement volume on biomechanical response of a spine segment treated with a PEEK polymer implant: a finite element comparative study with vertebroplasty

CT-based finite element simulating spatial bone damage accumulation predicts metastatic human vertebrae strength and stiffness

Experimental Study of Percutaneous Vertebroplasty with a Novel Bone Void Filling Container System

Combining Virtual Surgical Planning and Patient-Specific 3D-Printing as a Solution to Complex Spinal Revision Surgery

Virtual Surgical Planning and Pre-operative Simulation for Maxillofacial Reconstruction with 3D Printing Technology in Tumor-affected Facial Deformity

Development of Digital Twins to Optimize Trauma Surgery and Postoperative Management. A Case Study Focusing on Tibial Plateau Fracture

Bone-GAN: Generation of virtual bone microstructure of high resolution peripheral quantitative computed tomography