Abstract:Background: Image-guided neurosurgery requires high localization and registration accuracy to enable effective treatment and avoid complications. However, accurate neuronavigation based on preoperative magnetic resonance (MR) or computed tomography (CT) images is challenged by brain deformation occurring during the surgical intervention. Purpose: To facilitate intraoperative visualization of brain tissues and deformable registration with preoperative images, a 3D deep learning (DL) reconstruction framework (termed DL-Recon) was proposed for improved intraoperative cone-beam CT (CBCT) image quality. Methods: The DL-Recon framework combines physics-based models with deep learning CT synthesis and leverages uncertainty information to promote robustness to unseen features. A 3D generative adversarial network (GAN) with a conditional loss function modulated by aleatoric uncertainty was developed for CBCT-to-CT synthesis. Epistemic uncertainty of the synthesis model was estimated via Monte Carlo (MC) dropout. Using spatially varying weights derived from epistemic uncertainty, the DL-Recon image combines the synthetic CT with an artifact-corrected filtered back-projection (FBP) reconstruction. In regions of high epistemic uncertainty, DL-Recon includes greater contribution from the FBP image. Twenty paired real CT and simulated CBCT images of the head were used for network training and validation, and experiments evaluated the performance of DL-Recon on CBCT images containing simulated and real brain lesions not present in the training data. Performance among learning- and physics-based methods was quantified in terms of structural similarity (SSIM) of the resulting image to diagnostic CT and Dice similarity metric (DSC) in lesion segmentation compared to ground truth. A pilot study was conducted involving seven subjects with CBCT images acquired during neurosurgery to assess the feasibility of DL-Recon in clinical data. Results: CBCT images reconstructed via FBP with physics-based corrections exhibited the usual challenges to soft-tissue contrast resolution due to image non-uniformity, noise, and residual artifacts. GAN synthesis improved image uniformity and soft-tissue visibility but was subject to error in the shape and contrast of simulated lesions that were unseen in training. Incorporation of aleatoric uncertainty in synthesis loss improved estimation of epistemic uncertainty, with variable brain structures and unseen lesions exhibiting higher epistemic uncertainty. The DL-Recon approach mitigated synthesis errors while maintaining improvement in image quality, yielding 15%-22% increase in SSIM (image appearance compared to diagnostic CT) and up to 25% increase in DSC in lesion segmentation compared to FBP. Clear gains in visual image quality were also observed in real brain lesions and in clinical CBCT images. Conclusions: DL-Recon leveraged uncertainty estimation to combine the strengths of DL and physics-based reconstruction and demonstrated substantial improvements in the accuracy and quality of intraoperative CBCT. The improved soft-tissue contrast resolution could facilitate visualization of brain structures and support deformable registration with preoperative images, further extending the utility of intraoperative CBCT in image-guided neurosurgery.

Robust deep learning estimation of cortical bone porosity from MR T1-weighted images for individualized transcranial focused ultrasound planning

Pseudo-CTs from T1-weighted MRI for planning of low-intensity transcranial focused ultrasound neuromodulation: an open-source tool

Synthetic CT Skull Generation for Transcranial MR Imaging-Guided Focused Ultrasound Interventions with Conditional Adversarial Networks

Model-based navigation of transcranial focused ultrasound neuromodulation in humans: Application to targeting the amygdala and thalamus

Multi-modal networks for real-time monitoring of intracranial acoustic field during transcranial focused ultrasound therapy

Evaluation of Synthetically Generated CT for use in Transcranial Focused Ultrasound Procedures

Generating Patient-Specific Acoustic Simulations for Transcranial Focused Ultrasound Procedures Based on Optical Tracking Information

Classical and learned MR to pseudo-CT mappings for accurate transcranial ultrasound simulation

Synthetic Skull CT Generation with Generative Adversarial Networks to Train Deep Learning Models for Clinical Transcranial Ultrasound

tFUSFormer: Physics-Guided Super-Resolution Transformer for Simulation of Transcranial Focused Ultrasound Propagation in Brain Stimulation

A deep-learning model for one-shot transcranial ultrasound simulation and phase aberration correction

The impact of CT image parameters and skull heterogeneity modeling on the accuracy of transcranial focused ultrasound simulations

A novel transcranial MR Guided focused ultrasound method based on the ultrashort echo time skull acoustic model and phase retrieval techniques

A Deep Learning‐Based Approach to Characterize Skull Physical Properties: A Phantom Study

Deep Learning-based Ultrasound Computed Tomography for Cortical Bone Imaging

Combining physics-based models with deep learning image synthesis and uncertainty in intraoperative cone-beam CT of the brain

MRI-based Material Mass Density and Relative Stopping Power Estimation via Deep Learning for Proton Therapy

Predicting skull lesions after clinical transcranial MRI-guided focused ultrasound with acoustic and thermal simulations

A transducer positioning method for transcranial focused ultrasound treatment of brain tumors

Multi-resolution simulation of focused ultrasound propagation through ovine skull from a single-element transducer

MRI-only based material mass density and relative stopping power estimation via deep learning for proton therapy: a preliminary study