Abstract:Multimodal deformable registration is designed to solve dense spatial transformations and is used to align images of two different modalities It is a key issue in many medical image analysis applications Multimodal image registration based on traditional methods aims to solve the optimization problem of each pair of images, and usually achieves excellent registration performance, but the calculation cost is high and the running time is long The deep learning method greatly reduces the running time by learning the network used to perform registration These learning-based methods are very effective for single-modality registration However, the intensity distribution of different modal images is unknown and complex Most existing methods rely heavily on label data Faced with these challenges, this paper proposes a deep multimodal registration framework based on unsupervised learning Specifically, the framework consists of feature learning based on matching amount and deformation field learning based on maximum posterior probability, and realizes unsupervised training by means of spatial conversion function and differentiable mutual information loss function In the 3D image registration tasks of MRI T1, MRI T2 and CT, the proposed method is compared with the existing advanced multi-modal registration methods In addition, the registration performance of the proposed method is demonstrated on the latest COVID-19 CT data A large number of results show that the proposed method has a competitive advantage in registration accuracy compared with other methods, and greatly reduces the calculation time © 2021, Editorial Board of JBUAA All right reserved

Assembly Method for Multimodal Image Registration

Regional Weighted Mutual Information For Multimodal Rigid Registration

Image Registration Method for Multimodal Images

A New Registration Algorithm for Multimodal Remote Sensing Images.

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Multimodal Image Registration Using Histogram of Oriented Gradient Distance and Data-Driven Grey Wolf Optimizer

Multimodal Remote Sensing Image Registration Based on Image Transfer and Local Features

Adjacent Self-Similarity 3-D Convolution for Multimodal Image Registration

Automatic Registration of Multisensor Images Using an Integrated Spatial and Mutual Information (SMI) Metric.

An Automatic Registration Method for Multi-Modal Images Based on Alignment Metric

A Robust Method For Multimodal Image Registration Based On Vector Field Consensus

Local joint entropy based non-rigid multimodality image registration

Multimodal image registration based on orientation-moment

Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information

Advances and Challenges in Multimodal Remote Sensing Image Registration

Automated Registration of Multimodality Images by Maximization of A Region Similarity Measure

Multimodal Deformable Registration Based on Unsupervised Learning

A More Robust Method for Multi-modality Medical Image Registration

Robust Multimodal Remote Sensing Image Registration Based on Local Statistical Frequency Information

A combined similarity measure for multimodal image registration

Medical Image Registration Based on Normalized Multidimensional Mutual Information