Abstract:Multi-modal medical image registration takes an essential role in image-based clinical diagnosis and surgical planning. It is not trivial due to appearance variations across different modalities. Rigidly aligning two images is used to register rigid body structure, and it is also usually the first step for deformable registration with a large discrepancy. In the field of computer vision, one well-established method for image alignment is to find corresponding points from two images, and image alignment is based on identified corresponding points. Our method lies in this category. Feature representation is crucial in finding corresponding points. However, conventional feature representation like SIFT does not take multi-modal information into account, and thus, it fails. In this paper, we propose a Convolution Neural Network Feature-based Registration (CNNFR) method for aligning the multi-modal medical image. The important component in this method is learning keypoint descriptors using contrastive metric learning, which minimizes the difference between two feature representations from two corresponding points and maximizes difference of two feature representation from two distant points. Also, a transfer learning-based CNNRF (TrCNNRF) is proposed to improve the generalization learning performance when the training data are insufficient. Experimental results demonstrate that the proposed methods can achieve superior performance regarding both accuracy and robustness, which can be used to rigidly register multi-modal images and provide an initial estimation for non-rigid registration in clinical practices.

An accelerative method for multimodality medical image registration based on CUDA

Rapid 2D-3D Medical Image Registration Based on CUDA

Accelerating Mutual-Information-Based Registration on Multi-Core Systems

Fast Rotation-Free Feature-Based Image Registration Using Improved N-SIFT and GMM-Based Parallel Optimization

Mutual Information Neural Estimation in CNN-based End-to-end Medical Image Registration

Mutual information neural estimation in CNN-based end-to-end medical image registration

Medical Image Registration Based on Self-Adapting Pulse-Coupled Neural Networks and Mutual Information

An Improved Medical Image Registration Algorithm Based on Mutual Information

Accelerating Neuroimage Registration Through Parallel Computation of Similarity Metric

Design and Storage Optimization of GPU-based Parallel Program of Image Registration for Remote Sensing

A Mixed-Type Registration Approach in Medical Image Processing

2D-3D Medical Image Registration Based on GPU

MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation

Multi-modal Medical Image Registration Based on Adaptive Combination of Intensity and Gradient Field Mutual Information

Registration of multimodal bone images based on edge similarity metaheuristic

Heterogeneous registration of medical images based on local mutual information and automatic update

Deep learning-based 3D brain multimodal medical image registration

A Hybrid Genetic Algorithm for Multi-Modal Image Registration

Medical Image Registration Based on Normalized Multidimensional Mutual Information

Realization of CUDA-based Real-Time Registration and Target Localization for High-Resolution Video Images

Towards Accurate and Robust Multi-Modal Medical Image Registration Using Contrastive Metric Learning.