Abstract:Background : Image registration technology has become an important medical image preprocessing step with the wide application of computer‐aided diagnosis technology in various medical image analysis tasks. Purpose : We propose a multiscale feature fusion registration based on deep learning to achieve the accurate registration and fusion of head magnetic resonance imaging (MRI) and solve the problem that general registration methods cannot handle the complex spatial information and position information of head MRI. Methods : Our proposed multiscale feature fusion registration network consists of three sequentially trained modules. The first is an affine registration module that implements affine transformation; the second is to realize non‐rigid transformation, a deformable registration module composed of top‐down and bottom‐up feature fusion subnetworks in parallel; and the third is a deformable registration module that also realizes non‐rigid transformation and is composed of two feature fusion subnetworks in series. The network decomposes the deformation field of large displacement into multiple deformation fields of small displacement by multiscale registration and registration, which reduces the difficulty of registration. Moreover, multiscale information in head MRI is learned in a targeted manner, which improves the registration accuracy, by connecting the two feature fusion subnetworks. Results : We used 29 3D head MRIs for training and seven volumes for testing and calculated the values of the registration evaluation metrics for the new algorithm to register anterior and posterior lateral pterygoid muscles. The Dice similarity coefficient was 0.745±0.021, the Hausdorff distance was 3.441±0.935 mm, the Average surface distance was 0.738±0.098 mm, and the Standard deviation of the Jacobian matrix was 0.425±0.043. Our new algorithm achieved a higher registration accuracy compared with state‐of‐the‐art registration methods. Conclusions : Our proposed multiscale feature fusion registration network can realize end‐to‐end deformable registration of 3D head MRI, which can effectively cope with the characteristics of large deformation displacement and the rich details of head images and provide reliable technical support for the diagnosis and analysis of head diseases. This article is protected by copyright. All rights reserved

Multimodal MR Image Registration Using Weakly Supervised Constrained Affine Network

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Weakly-supervised convolutional neural networks for multimodal image registration

Label-driven weakly-supervised learning for multimodal deformable image registration

Deep Learning based Inter-Modality Image Registration Supervised by Intra-Modality Similarity

Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration

An Unsupervised Convolution Neural Network for Deformable Registration of Mono/Multi-Modality Medical Images

A coarse-to-fine framework for unsupervised multi-contrast MR image deformable registration with dual consistency constraint

A Coarse-to-Fine Deformable Transformation Framework for Unsupervised Multi-Contrast MR Image Registration with Dual Consistency Constraint

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

Explicit–implicit symmetric diffeomorphic deformable image registration with convolutional neural network

MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation

Deep learning-based 3D brain multimodal medical image registration

DELR-Net: a network for 3D multimodal medical image registration in more lightweight application scenarios

Multiscale feature fusion network for 3D head MRI image registration

Learning Multi-Modal Volumetric Prostate Registration with Weak Inter-Subject Spatial Correspondence

Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision

MAIRNet: weakly supervised anatomy-aware multimodal articulated image registration network

Networks for Joint Affine and Non-parametric Image Registration