Abstract:Background : Image registration technology has become an important medical image preprocessing step with the wide application of computer‐aided diagnosis technology in various medical image analysis tasks. Purpose : We propose a multiscale feature fusion registration based on deep learning to achieve the accurate registration and fusion of head magnetic resonance imaging (MRI) and solve the problem that general registration methods cannot handle the complex spatial information and position information of head MRI. Methods : Our proposed multiscale feature fusion registration network consists of three sequentially trained modules. The first is an affine registration module that implements affine transformation; the second is to realize non‐rigid transformation, a deformable registration module composed of top‐down and bottom‐up feature fusion subnetworks in parallel; and the third is a deformable registration module that also realizes non‐rigid transformation and is composed of two feature fusion subnetworks in series. The network decomposes the deformation field of large displacement into multiple deformation fields of small displacement by multiscale registration and registration, which reduces the difficulty of registration. Moreover, multiscale information in head MRI is learned in a targeted manner, which improves the registration accuracy, by connecting the two feature fusion subnetworks. Results : We used 29 3D head MRIs for training and seven volumes for testing and calculated the values of the registration evaluation metrics for the new algorithm to register anterior and posterior lateral pterygoid muscles. The Dice similarity coefficient was 0.745±0.021, the Hausdorff distance was 3.441±0.935 mm, the Average surface distance was 0.738±0.098 mm, and the Standard deviation of the Jacobian matrix was 0.425±0.043. Our new algorithm achieved a higher registration accuracy compared with state‐of‐the‐art registration methods. Conclusions : Our proposed multiscale feature fusion registration network can realize end‐to‐end deformable registration of 3D head MRI, which can effectively cope with the characteristics of large deformation displacement and the rich details of head images and provide reliable technical support for the diagnosis and analysis of head diseases. This article is protected by copyright. All rights reserved

Method of fusing two-dimensional magnetic resonance spectrum and three-dimensional magnetic resonance navigation image

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Three-dimensional Simultaneous Brain Mapping of T1, T2, T2*and Magnetic Susceptibility with MR Multitasking

MRI and PET image fusion using the nonparametric density model and the theory of variable-weight

Three-Dimensional Reconstruction of Registered and Fused Chinese Visible Human and Patient Mri Images

FMB: Dual-view fusion and registration of 2D DSA images and 3D MRA images for neurointerventional-based procedures

MRI and PET/SPECT fusion with pseudo spatial frequency in local laplacian filter domain

Fusion of Color Doppler and Magnetic Resonance Images of the Heart

High-Quality Fusion and Visualization for MR-PET Brain Tumor Images via Multi-Dimensional Features

The Way of Medical Image Fusion Using the Legendre Orthogonal Moment

Multi-modality Anatomical and Functional Medical Image Fusion Based on Simplified-spatial Frequency-pulse Coupled Neural Networks and Region Energy-weighted Average Strategy in Non-sub Sampled Contourlet Transform Domain.

HID: The Hybrid Image Decomposition Model for MRI and CT Fusion

Multiscale feature fusion network for 3D head MRI image registration

MRI-ultrasound Fusion Based on Magnetic Microbubble Contrast Agent

An advanced MRI and MRSI data fusion scheme for enhancing unsupervised brain tumor differentiation

Three dimensional image alignment, registration and fusion

Three-Dimensional Medical Image Fusion with Deformable Cross-Attention

Brain Tumor Segmentation through Data Fusion of T2-Weighted Image and MR Spectroscopy

Ultrasound and CT Image Fusion Based on Optical Positioning-The Key Technology Research and Preliminary Application of Craniomaxillofacial Soft Tissue Navigation

Joint k-ω Space Image Reconstruction and Data Fitting for Chemical Exchange Saturation Transfer Magnetic Resonance Imaging

Cerebral ASL, SPECT and MRI image registration, enhancing fusion and joint analysis system