Abstract:Background : Image registration technology has become an important medical image preprocessing step with the wide application of computer‐aided diagnosis technology in various medical image analysis tasks. Purpose : We propose a multiscale feature fusion registration based on deep learning to achieve the accurate registration and fusion of head magnetic resonance imaging (MRI) and solve the problem that general registration methods cannot handle the complex spatial information and position information of head MRI. Methods : Our proposed multiscale feature fusion registration network consists of three sequentially trained modules. The first is an affine registration module that implements affine transformation; the second is to realize non‐rigid transformation, a deformable registration module composed of top‐down and bottom‐up feature fusion subnetworks in parallel; and the third is a deformable registration module that also realizes non‐rigid transformation and is composed of two feature fusion subnetworks in series. The network decomposes the deformation field of large displacement into multiple deformation fields of small displacement by multiscale registration and registration, which reduces the difficulty of registration. Moreover, multiscale information in head MRI is learned in a targeted manner, which improves the registration accuracy, by connecting the two feature fusion subnetworks. Results : We used 29 3D head MRIs for training and seven volumes for testing and calculated the values of the registration evaluation metrics for the new algorithm to register anterior and posterior lateral pterygoid muscles. The Dice similarity coefficient was 0.745±0.021, the Hausdorff distance was 3.441±0.935 mm, the Average surface distance was 0.738±0.098 mm, and the Standard deviation of the Jacobian matrix was 0.425±0.043. Our new algorithm achieved a higher registration accuracy compared with state‐of‐the‐art registration methods. Conclusions : Our proposed multiscale feature fusion registration network can realize end‐to‐end deformable registration of 3D head MRI, which can effectively cope with the characteristics of large deformation displacement and the rich details of head images and provide reliable technical support for the diagnosis and analysis of head diseases. This article is protected by copyright. All rights reserved

Clinical Significance of Creative 3D-Image Fusion Across( CT+MR) Modalities Based on Approach of Characteristic Co-Registration

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Three dimensional image alignment, registration and fusion

2D-Image Fusion Attempt of Cross PET+MRI Modality Based on Localization Registration Approach Of"9-Point & 3-Plane"

Three-Dimensional Reconstruction of Registered and Fused Chinese Visible Human and Patient Mri Images

Registration Of 3-D Ct And 2-D Flat Images Of Mouse Via Affine Transformation

Accuracy of 3D Volumetric Image Registration Based on CT, MR and PET/CT Phantom Experiments

Registration Of 3d Fmt And Ct Images Of Mouse Via Affine Transformation Using Sequential Monte Carlo

Registration of 3D FMT and CT Images of Mouse Via Affine Transformation with Bayesian Iterative Closest Points

CT and MR Image Fusion Technique and Its Clinical Application

Cerebral ASL, SPECT and MRI image registration, enhancing fusion and joint analysis system

A New Approach of Building 3D Visualization Framework for Multimodal Medical Images Display and Computed Assisted Diagnosis

A Registration Method Based on Contour Point Cloud for 3D Whole-Body PET and CT Images.

High-Quality Fusion and Visualization for MR-PET Brain Tumor Images via Multi-Dimensional Features

HID: The Hybrid Image Decomposition Model for MRI and CT Fusion

A novel 3D volumetric voxel registration technique for volume-view-guided image registration of multiple imaging modalities.

Three-Dimensional Medical Image Fusion with Deformable Cross-Attention

FMB: Dual-view fusion and registration of 2D DSA images and 3D MRA images for neurointerventional-based procedures

Multiscale feature fusion network for 3D head MRI image registration

Image fusion in craniofacial virtual reality modeling based on CT and 3dMD photogrammetry

Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations