Abstract:BACKGROUND Deep learning based unsupervised registration utilizes the intensity information to align images. To avoid the influence of intensity variation and improve the registration accuracy, unsupervised and weakly-supervised registration are combined, namely, dually-supervised registration. However, the estimated dense deformation fields (DDFs) will focus on the edges among adjacent tissues when the segmentation labels are directly used to drive the registration progress, which will decrease the plausibility of brain MRI registration. PURPOSE In order to increase the accuracy of registration and ensure the plausibility of registration at the same time, we combine the local-signed-distance fields (LSDFs) and intensity images to dually supervise the registration progress. The proposed method not only uses the intensity and segmentation information but also uses the voxelwise geometric distance information to the edges. Hence, the accurate voxelwise correspondence relationships are guaranteed both inside and outside the edges. METHODS The proposed dually-supervised registration method mainly includes three enhancement strategies. Firstly, we leverage the segmentation labels to construct their LSDFs to provide more geometrical information for guiding the registration process. Secondly, to calculate LSDFs, we construct an LSDF-Net, which is composed of 3D dilation layers and erosion layers. Finally, we design the dually-supervised registration network (VMLSDF ) by combining the unsupervised VoxelMorph (VM) registration network and the weakly-supervised LSDF-Net, to utilize intensity and LSDF information, respectively. RESULTS In this paper, experiments were then carried out on four public brain image datasets: LPBA40, HBN, OASIS1, and OASIS3. The experimental results show that the Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD) of VMLSDF are higher than those of the original unsupervised VM and the dually-supervised registration network (VMseg ) using intensity images and segmentation labels. At the same time, the percentage of negative Jacobian determinant (NJD) of VMLSDF is lower than VMseg . Our code is freely available at https://github.com/1209684549/LSDF. CONCLUSIONS The experimental results show that LSDFs can improve the registration accuracy compared with VM and VMseg , and enhance the plausibility of the DDFs compared with VMseg . This article is protected by copyright. All rights reserved.

Symmetric Diffeomorphic Image Registration with Multi-Label Segmentation Masks

One registration is worth two segmentations

A Variational Model for Simultaneous Registration-Segmentation to Brain MR Images

Deep learning based brain MRI registration driven by local-signed-distance fields of segmentation maps.

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Deformable Registration of Ultrasound and Magnetic Resonance Imaging Using A New Self-Similarity Based Neighborhood Descriptor

Image Segmentation with Adaptive Spatial Priors from Joint Registration

Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor.

Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology

Interactive Registration and Segmentation for Multi-Atlas-Based Labeling of Brain MR Image

Efficient Diffeomorphic Metric Image Registration Via Stationary Velocity.

A Novel Unsupervised Learning Model for Diffeomorphic Image Registration

Multi-parameter Registration Model for Brain MR Image Segmentation Based on Label Fusion

Multi-modal diffeomorphic demons registration based on mutual information

Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images

A Target-Oriented Segmentation Method for Specific Tissues in MRI Images of the Brain

A Symmetric Dynamic Learning Framework for Diffeomorphic Medical Image Registration

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

The Method of Multimodal MRI Brain Image Segmentation Based on Differential Geometric Features

Multi-individual Mammographic Image Registration Based on Global-local Integrated Transformations

Integrating Segmentation Information for Improved MRF-Based Elastic Image Registration