Abstract:PURPOSE: The accuracy of minimally invasive, intracranial neurosurgery can be challenged by deformation of brain tissue - e.g., up to 10 mm due to egress of cerebrospinal fluid during neuroendoscopic approach. We report an unsupervised, deep learning-based registration framework to resolve such deformations between preoperative MR and intraoperative CT with fast runtime for neurosurgical guidance.METHOD: The framework incorporates subnetworks for MR and CT image synthesis with a dual-channel registration subnetwork (with synthesis uncertainty providing spatially varying weights on the dual-channel loss) to estimate a diffeomorphic deformation field from both the MR and CT channels. An end-to-end training is proposed that jointly optimizes both the synthesis and registration subnetworks. The proposed framework was investigated using three datasets: (1) paired MR/CT with simulated deformations; (2) paired MR/CT with real deformations; and (3) a neurosurgery dataset with real deformation. Two state-of-the-art methods (Symmetric Normalization and VoxelMorph) were implemented as a basis of comparison, and variations in the proposed dual-channel network were investigated, including single-channel registration, fusion without uncertainty weighting, and conventional sequential training of the synthesis and registration subnetworks.RESULTS: The proposed method achieved: (1) Dice coefficient = 0.82±0.07 and TRE = 1.2 ± 0.6 mm on paired MR/CT with simulated deformations; (2) Dice coefficient = 0.83 ± 0.07 and TRE = 1.4 ± 0.7 mm on paired MR/CT with real deformations; and (3) Dice = 0.79 ± 0.13 and TRE = 1.6 ± 1.0 mm on the neurosurgery dataset with real deformations. The dual-channel registration with uncertainty weighting demonstrated superior performance (e.g., TRE = 1.2 ± 0.6 mm) compared to single-channel registration (TRE = 1.6 ± 1.0 mm, p < 0.05 for CT channel and TRE = 1.3 ± 0.7 mm for MR channel) and dual-channel registration without uncertainty weighting (TRE = 1.4 ± 0.8 mm, p < 0.05). End-to-end training of the synthesis and registration subnetworks also improved performance compared to the conventional sequential training strategy (TRE = 1.3 ± 0.6 mm). Registration runtime with the proposed network was ∼3 s.CONCLUSION: The deformable registration framework based on dual-channel MR/CT registration with spatially varying weights and end-to-end training achieved geometric accuracy and runtime that was superior to state-of-the-art baseline methods and various ablations of the proposed network. The accuracy and runtime of the method may be compatible with the requirements of high-precision neurosurgery.

Point Cloud Registration for Measuring Shape Dependence of Soft Tissue Deformation by Digital Twins in Head and Neck Surgery

Artificial intelligence directed development of a digital twin to measure soft tissue shift during head and neck surgery

2D-3D Deformable Image Registration of Histology Slide and Micro-CT with ML-based Initialization

Twin-S: A Digital Twin for Skull-base Surgery

Model-Independent, Multimodality Deformable Image Registration by Local Matching of Anatomical Features and Minimization of Elastic Energy

Real-time Prediction of Soft Tissue Deformations Using Data-driven Nonlinear Presurgical Simulations

Deformable 3D/3D CT-to-digital-tomosynthesis image registration in image-guided bronchoscopy interventions

A Machine Learning Approach for Real-Time Modelling of Tissue Deformation in Image-Guided Neurosurgery

Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

High-resolution laser surface scanning for patient registration in cranial computer-assisted surgery

Soft Tissue Changes Measured With Three-Dimensional Software Provides New Insights for Surgical Predictions

Enriching 3D optical surface scans with prior knowledge: tissue thickness computation by exploiting local neighborhoods

S16-01 session 16: planning/imaging – part ii quantification of head shape from 3d photography for automatic detection of craniosynostosis

A morphing-Based 3D point cloud reconstruction framework for medical image processing

Radiation-free Quantification of Head Malformations in Craniosynostosis Patients from 3D Photography.

Deformable Registration of Lateral Cephalogram and Cone-Beam Computed Tomography Image

Virtual Facial Reconstruction Based on Accurate Registration and Fusion of 3D Facial and MSCT Scans

A Novel Digital Tomosynthesis (DTS) Reconstruction Method Using a Deformation Field Map

Quantitative Evaluation of Local Head Malformations from 3 Dimensional Photography: Application to Craniosynostosis.

Exploring CT pixel and voxel size effect on anatomic modeling in mandibular reconstruction

2D/3D registration and motion tracking for surgical interventions