Abstract:PURPOSE: The accuracy of minimally invasive, intracranial neurosurgery can be challenged by deformation of brain tissue - e.g., up to 10 mm due to egress of cerebrospinal fluid during neuroendoscopic approach. We report an unsupervised, deep learning-based registration framework to resolve such deformations between preoperative MR and intraoperative CT with fast runtime for neurosurgical guidance.METHOD: The framework incorporates subnetworks for MR and CT image synthesis with a dual-channel registration subnetwork (with synthesis uncertainty providing spatially varying weights on the dual-channel loss) to estimate a diffeomorphic deformation field from both the MR and CT channels. An end-to-end training is proposed that jointly optimizes both the synthesis and registration subnetworks. The proposed framework was investigated using three datasets: (1) paired MR/CT with simulated deformations; (2) paired MR/CT with real deformations; and (3) a neurosurgery dataset with real deformation. Two state-of-the-art methods (Symmetric Normalization and VoxelMorph) were implemented as a basis of comparison, and variations in the proposed dual-channel network were investigated, including single-channel registration, fusion without uncertainty weighting, and conventional sequential training of the synthesis and registration subnetworks.RESULTS: The proposed method achieved: (1) Dice coefficient = 0.82±0.07 and TRE = 1.2 ± 0.6 mm on paired MR/CT with simulated deformations; (2) Dice coefficient = 0.83 ± 0.07 and TRE = 1.4 ± 0.7 mm on paired MR/CT with real deformations; and (3) Dice = 0.79 ± 0.13 and TRE = 1.6 ± 1.0 mm on the neurosurgery dataset with real deformations. The dual-channel registration with uncertainty weighting demonstrated superior performance (e.g., TRE = 1.2 ± 0.6 mm) compared to single-channel registration (TRE = 1.6 ± 1.0 mm, p < 0.05 for CT channel and TRE = 1.3 ± 0.7 mm for MR channel) and dual-channel registration without uncertainty weighting (TRE = 1.4 ± 0.8 mm, p < 0.05). End-to-end training of the synthesis and registration subnetworks also improved performance compared to the conventional sequential training strategy (TRE = 1.3 ± 0.6 mm). Registration runtime with the proposed network was ∼3 s.CONCLUSION: The deformable registration framework based on dual-channel MR/CT registration with spatially varying weights and end-to-end training achieved geometric accuracy and runtime that was superior to state-of-the-art baseline methods and various ablations of the proposed network. The accuracy and runtime of the method may be compatible with the requirements of high-precision neurosurgery.

Symmetric Deformable Registration via Learning a Pseudomean for MR Brain Images

Deformable Image Registration Using a Cue-Aware Deep Regression Network

A Symmetric Dynamic Learning Framework for Diffeomorphic Medical Image Registration

Adversarial Learning for Deformable Registration of Brain MR Image Using a Multi-Scale Fully Convolutional Network

Symmetric Pyramid Network for Medical Image Inverse Consistent Diffeomorphic Registration

Inverse-Consistent Deep Networks for Unsupervised Deformable Image Registration

Non-rigid MRI-CT Image Registration with Unsupervised Deep Learning-Based Deformation Prediction

SearchMorph:Multi-scale Correlation Iterative Network for Deformable Registration

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

Unsupervised End-to-end Learning for Deformable Medical Image Registration

MsMorph: An Unsupervised pyramid learning network for brain image registration

AMNet: Adaptive Multi-Level Network for Deformable Registration of 3D Brain MR Images

DeepASDM: a Deep Learning Framework for Affine and Deformable Image Registration Incorporating a Statistical Deformation Model

An Unsupervised Convolution Neural Network for Deformable Registration of Mono/Multi-Modality Medical Images

Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

Pair-Wise and Group-Wise Deformation Consistency in Deep Registration Network

SITReg: Multi-resolution architecture for symmetric, inverse consistent, and topology preserving image registration

Non-iterative Pyramid Network for Unsupervised Deformable Medical Image Registration

A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

A Novel Unsupervised Learning Model for Diffeomorphic Image Registration

Multi-strategy Mutual Learning Network for Deformable Medical Image Registration