Abstract:PURPOSE: The accuracy of minimally invasive, intracranial neurosurgery can be challenged by deformation of brain tissue - e.g., up to 10 mm due to egress of cerebrospinal fluid during neuroendoscopic approach. We report an unsupervised, deep learning-based registration framework to resolve such deformations between preoperative MR and intraoperative CT with fast runtime for neurosurgical guidance.METHOD: The framework incorporates subnetworks for MR and CT image synthesis with a dual-channel registration subnetwork (with synthesis uncertainty providing spatially varying weights on the dual-channel loss) to estimate a diffeomorphic deformation field from both the MR and CT channels. An end-to-end training is proposed that jointly optimizes both the synthesis and registration subnetworks. The proposed framework was investigated using three datasets: (1) paired MR/CT with simulated deformations; (2) paired MR/CT with real deformations; and (3) a neurosurgery dataset with real deformation. Two state-of-the-art methods (Symmetric Normalization and VoxelMorph) were implemented as a basis of comparison, and variations in the proposed dual-channel network were investigated, including single-channel registration, fusion without uncertainty weighting, and conventional sequential training of the synthesis and registration subnetworks.RESULTS: The proposed method achieved: (1) Dice coefficient = 0.82±0.07 and TRE = 1.2 ± 0.6 mm on paired MR/CT with simulated deformations; (2) Dice coefficient = 0.83 ± 0.07 and TRE = 1.4 ± 0.7 mm on paired MR/CT with real deformations; and (3) Dice = 0.79 ± 0.13 and TRE = 1.6 ± 1.0 mm on the neurosurgery dataset with real deformations. The dual-channel registration with uncertainty weighting demonstrated superior performance (e.g., TRE = 1.2 ± 0.6 mm) compared to single-channel registration (TRE = 1.6 ± 1.0 mm, p < 0.05 for CT channel and TRE = 1.3 ± 0.7 mm for MR channel) and dual-channel registration without uncertainty weighting (TRE = 1.4 ± 0.8 mm, p < 0.05). End-to-end training of the synthesis and registration subnetworks also improved performance compared to the conventional sequential training strategy (TRE = 1.3 ± 0.6 mm). Registration runtime with the proposed network was ∼3 s.CONCLUSION: The deformable registration framework based on dual-channel MR/CT registration with spatially varying weights and end-to-end training achieved geometric accuracy and runtime that was superior to state-of-the-art baseline methods and various ablations of the proposed network. The accuracy and runtime of the method may be compatible with the requirements of high-precision neurosurgery.

Joint affine and deformable three‐dimensional networks for brain MRI registration

Multiscale feature fusion network for 3D head MRI image registration

Networks for Joint Affine and Non-parametric Image Registration

AMNet: Adaptive Multi-Level Network for Deformable Registration of 3D Brain MR Images

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

A Joint Super-Resolution and Deformable Registration Network for 3D Brain Images.

Adversarial Learning for Deformable Registration of Brain MR Image Using a Multi-Scale Fully Convolutional Network

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

Longitudinal Deformable MRI Registration Via Dual-Feasible Deep Learning-Based Framework

Deform U-Net: Unsupervised Deformable 3D Biomedical Image Registration Network

Deep learning-based 3D brain multimodal medical image registration

Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

Functional Magnetic Resonance Imaging Progressive Deformable Registration Based on a Cascaded Convolutional Neural Network

Linear and Deformable Image Registration with 3D Convolutional Neural Networks

A New Unsupervised Learning Method for 3D Deformable Medical Image Registration

An Unsupervised Registration Method for Brain Images Based on Contour Guidance

Deformable Registration Using Average Geometric Transformations for Brain MR Images

Deformable registration of chest CT images using a 3D convolutional neural network based on unsupervised learning

NCNet: deformable medical image registration network based on neighborhood cross-attention combined with multi-resolution constraints.

Non-rigid MRI-CT Image Registration with Unsupervised Deep Learning-Based Deformation Prediction

Recurrent Tissue-Aware Network for Deformable Registration of Infant Brain MR Images