Abstract:Background : Image registration technology has become an important medical image preprocessing step with the wide application of computer‐aided diagnosis technology in various medical image analysis tasks. Purpose : We propose a multiscale feature fusion registration based on deep learning to achieve the accurate registration and fusion of head magnetic resonance imaging (MRI) and solve the problem that general registration methods cannot handle the complex spatial information and position information of head MRI. Methods : Our proposed multiscale feature fusion registration network consists of three sequentially trained modules. The first is an affine registration module that implements affine transformation; the second is to realize non‐rigid transformation, a deformable registration module composed of top‐down and bottom‐up feature fusion subnetworks in parallel; and the third is a deformable registration module that also realizes non‐rigid transformation and is composed of two feature fusion subnetworks in series. The network decomposes the deformation field of large displacement into multiple deformation fields of small displacement by multiscale registration and registration, which reduces the difficulty of registration. Moreover, multiscale information in head MRI is learned in a targeted manner, which improves the registration accuracy, by connecting the two feature fusion subnetworks. Results : We used 29 3D head MRIs for training and seven volumes for testing and calculated the values of the registration evaluation metrics for the new algorithm to register anterior and posterior lateral pterygoid muscles. The Dice similarity coefficient was 0.745±0.021, the Hausdorff distance was 3.441±0.935 mm, the Average surface distance was 0.738±0.098 mm, and the Standard deviation of the Jacobian matrix was 0.425±0.043. Our new algorithm achieved a higher registration accuracy compared with state‐of‐the‐art registration methods. Conclusions : Our proposed multiscale feature fusion registration network can realize end‐to‐end deformable registration of 3D head MRI, which can effectively cope with the characteristics of large deformation displacement and the rich details of head images and provide reliable technical support for the diagnosis and analysis of head diseases. This article is protected by copyright. All rights reserved

Multimodal 3D Image Registration for Mapping Brain Disorders

Unsupervised deep learning registration model for multimodal brain images

Deep learning-based 3D brain multimodal medical image registration

Deep coupled registration and segmentation of multimodal whole-brain images

Digital Analysis of Smart Registration Methods for Magnetic Resonance Images in Public Healthcare

NeuReg: Domain-invariant 3D Image Registration on Human and Mouse Brains

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

MDH-Net: Advancing 3D Brain MRI Registration with Multi-Stage Transformer and Dual-Stream Feature Refinement Hybrid Network

Multimodal 3D Convolutional Neural Networks for Classification of Brain Disease Using Structural MR and FDG-PET Images.

Robust Image Registration with Absent Correspondences in Pre-operative and Follow-up Brain MRI Scans of Diffuse Glioma Patients

Multiscale feature fusion network for 3D head MRI image registration

Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor.

Cerebral ASL, SPECT and MRI image registration, enhancing fusion and joint analysis system

Three-dimensional Image Registration Based on Modified Structural Similarity

A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

Multimodal Predictive Modeling: Scalable Imaging Informed Approaches to Predict Future Brain Health

Image Registration Combining Cross-Scale Point Matching and Multi-Scale Feature Fusion

Unsupervised Deformable Image Registration with Absent Correspondences in Pre-operative and Post-Recurrence Brain Tumor MRI Scans

Deformable Registration of Ultrasound and Magnetic Resonance Imaging Using A New Self-Similarity Based Neighborhood Descriptor

3D Inception-Based TransMorph: Pre- and Post-operative Multi-contrast MRI Registration in Brain Tumors

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration