Research on Multi-Modality Medical Image Registration Based on Mutual Information

Hu Yongxiang,Jiang Hong

DOI: https://doi.org/10.3969/j.issn.1673-9833.2007.03.014

2007-01-01

Abstract:After analyzing the principle of registration based on MI,it presents an adaptation of MI by using the entropy of different image and comparing several kinds of similarity measure.Results show that the combined MI with spatial informa-tion has better anti-interference.

What problem does this paper attempt to address?

Multi-modality Medical Image Registration Using High Dimension Mutual Information

HU Yong-xiang,TANG Jing-tian,JIANG Hong

DOI: https://doi.org/10.3321/j.issn:1002-8331.2007.24.070

2007-01-01

Abstract:Mutual Information(MI) based similarity measure has been widely used in multi-modal medical image registration.One drawback of MI,however,is that it fails to take into account the spatial information of image.In this paper,we propose a novel extension to MI called High-dimension Mutual Information(HMI).This extension takes advantage of neighbor pixels to construct a set of high dimension vector,and then evaluates high dimension entropy using an algorithm based on Nearest Neighbor Search(NNS).In order to compute HMI effectively,we adopt an algorithm called approximate nearest neighbor search.Experiments demonstrate the validation of the extended methods.
Regional Weighted Mutual Information For Multimodal Rigid Registration

Lu Bai,Guang Li,Chuanwei Zhu,Enhe Wu,Ruibing Ma

DOI: https://doi.org/10.1109/CISP-BMEI.2018.8633037

2018-01-01

Abstract:Mutual information is a widely successfully used similarity metric in multimodality medical image registration. However, it employs the global intensity statistical parameters and lacks of spatial information. In order to combine the advantages of spatial information, a regional weighted mutual information is proposed for image registration especially for multimodal rigid registration with large rotation and translation. Experiments on 132 sets of CT and MR data (including different sequences) show that the regional weighted mutual information is robust similarity metric. It can align the multimodal data with large rotations, even if mutual information fails. Because the regional weighed mutual information can be simultaneously and parallel analyzed, the computation efficiency is not inferior to the mutual information method.
Multi-Modal Image Registration Based on Multi-Feature Mutual Information

Xueli Liu,Manning Wang,Zhijian Song

DOI: https://doi.org/10.1166/jmihi.2019.2554

2019-01-01

Journal of Medical Imaging and Health Informatics

Abstract:Multi-modal medical image registration is an essential technology in the field of medical image computing. Mutual information (MI) is one of the most common multi-modal medical image registration method. However, traditional MI only calculates the correlation of the global intensity, but ignores the local and structural information. Therefore, it is not robust against noise and spatially varying intensity inhomogeneity. In this paper, we bring the chain rule of information into high-dimensional MI and propose a multi-modal registration method based on multi-feature mutual information (MfMI). In MfMI, the mutual information between a set of features of the target and moving images is maximized. The feature set includes image's original intensity and structural features calculated from local derivatives and Hessians. In the experiment, we verified the robustness and accuracy of our method with synthetic and real patients' data. The results show that MfMI is robust to noise and inhomogeneity and outperform common registration methods to achieve higher accuracy. The mean target registration error (mTRE) of our method were 2.33 compared to 2.88 and 2.50 of LMI and alpha-MI in MR-US registration, respectively.
THE RESEARCH ON APPLICATION OF MUTUAL INFORMATION TO MULTIMODALITY MEDICAL IMAGE REGISTRATION

Yang Chunlan,Zheng Lian,Li Xiaoming

DOI: https://doi.org/10.3969/j.issn.1000-386X.2008.03.053

2008-01-01

Abstract:Multimodality image registration is an important issue in medical image analysis.Mutual information is the most widely used method in multimodality registration.Both the accuracy and the robustness are satisfactory.The practicability of mutual information is validated with experiments.In addition,other extension similarity measures such as high-order mutual information and gradient information incorporated methods are analyzed,and the importance of spatial information is demonstrated.
Medical image registration method based on mixed mutual information

ZHANG Hong-ying,ZHANG Jia-wan,SUN Ji-zhou

2006-01-01

Journal of Computer Applications

Abstract:Traditionally, the similarity metric is based on Shannon's entropy. Through the analysis of Renyi's entropy, it is found that Renyi's entropy can remove some unwanted local optimum, smooth out difficult optimization terrain accordingly; Shannon's entropy has the "depth" of the basin of attraction, making the registration function easier to be optimized. So a new similarity measure based on mixed mutual information was proposed. The measures based on different entropy were used in different searching phases, and global optimization algorithm and local one were used individually. At first, the global optimization algorithm was used to find the local extrema of generalized mutual information measure based on Renyi's entropy. Then, the local one was used to locate the global optimal solution by searching the current local optimal ones, and the generalized mutual information measure based on Shannon's entropy was taken as the objective function.
Medical Image Registration Based on Mutual Information Entropy Combined with Edge Correlation Feature

Benzheng Wei,Jie Gan,Yilong Yin

DOI: https://doi.org/10.16337/j.1004-9037.2018.02.007

2018-01-01

Abstract:Image registration is a valuable technique for medical diagnosis and treatment.Due to the inferiority of image registration using maximum mutual information,a new hybrid method of multimodality medical image registration based on mutual information of spatial information is proposed.The new measure that combines mutual information,spatial information and feature characteristics,is proposed.Edge points are used as features and obtained from a morphology gradient detector.Feature characteristics like location,edge strength and orientation are taken into account to compute a joint probability distribution of corresponding edge points in two images.Mutual information based on this function is minimized to find the best alignment parameters.Finally,the translation parameters are calculated by using a gradient descent algorithm.The experimental results demonstrate the high validation precision and excellent accelerating capability of the algorithm.
Multi-modal Medical Image Registration Based on Adaptive Combination of Intensity and Gradient Field Mutual Information

Jiangang Liu,Jie Tian,Yakang Dai

DOI: https://doi.org/10.1109/iembs.2006.260489

2006-01-01

Abstract:Mutual information (MI) is an effective criterion for multi-modal image registration. However the traditional MI function only includes intensity information of images and lacks sufficient spatial information to accurately measure the degree of alignment of two images, and besides, it is apt to be influenced by intensity interpolation, therefore presents many local maxima which frequently lead to misregistration. Our paper proposes a criterion of adaptive combination of intensity and gradient field mutual information (ACMI). Unlike the intensity MI computed from two original images, the gradient field MI of two images is calculated from their gradient code maps (GCM) constructed by coding the gradient field information of corresponding original image. Because of their complementary properties, these two MI functions are combined to form ACMI by a nonlinear weight function which can be adaptively regulated according to their performances and make the better dominant in the combination. Experimental results demonstrate that the ACMI outperforms the traditional MI and furthermore the former is much less sensitive than the latter to the reduction of resolution or overlapped region of images
Multi-modal image registration by mutual information based on optimal region selection

Liu Zhaoying,Zhou Fugen,Bai XiangZhi,Wang Hui

DOI: https://doi.org/10.1109/ICINA.2010.5636737

2010-01-01

Abstract:Mutual information (MI) has been commonly used in multi-modal image registration. In this paper, we presented an optimal region selection method for MI based multi-modal image registration. Firstly, image preprocessing and initial registration were applied on the two images. Then we applied two region selection procedures to improve the performance of MI-based registration. The first procedure is hierarchical region detection that selects regions with more structure information in each of the two images. In this procedure, the images were divided into sub-images progressively, and candidate image blocks with high usability were selected based on entropy. The second procedure is optimal matching region selection based on local registration using MI. In this procedure, the regions selected in the first procedure were registered with MI, then the results are used to choose optimal matching regions with high reliability. Finally, the optimal regions were used for the entire image registration by computing the MI of the regions. The experiment results showed that this method could improve the efficiency and accuracy for MI-based image registration.
Multi-Modality Medical Image Registration Based on Regional Joint Rényi Entropy

Shao-min ZHANG,Li-jia ZHI,Da-zhe ZHAO,Hong ZHAO,Jin-zhu YANG

DOI: https://doi.org/10.3321/j.issn:0372-2112.2009.10.036

2009-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:For medical image registration of high-accuracy, robustness and speed requirements, this paper proposes a new multi-modality image registration algorithm based on regional joint Renyi entropy. This algorithm incorporates regional information into the joint Renyi entropy, and then estimates joint Renyi entropy directly by minimum spanning tree. Thus, the new algorithm improves the losing spatial information of the traditional registration methods, and also avoids the "dimension disaster" problem encountered when using high-dimensional joint histogram to estimate the entropy. Experimental results show that in the images with noise, non-uniform intensity and large scope of the initial misalignment case, the algorithm achieves better robustness and higher speed while maintaining good registration accuracy. As a general registration algorithm,it can be used in wider areas, such as image retrieval, object recognition.
[Advances in Medical Image Registration Based on Mutual Information].

Lin Feng,Huijuan Guan,Hongfei Teng

2005-01-01

Abstract:The matching algorithm based on mutual information, which has the advantages of high speed, good automation and superion accuracy, is widely used in medical image registration. In this paper are presented the basic conception of mutual information, the transform model, the insert value algorithm, the optimization algorithm and the strategy in computing mutual information. Furthermore, we introduce some efficient methods for solving the problems in registration technique based on mutual information, and look forward to the future research work.
Multi-Mode Image Registration Based on Mutual Information of Region of Interests

刘兆英,周付根,白相志,薛斌党,王晖,谭东杰,郭世伟

DOI: https://doi.org/10.3969/j.issn.1673-5048.2011.04.002

2011-01-01

Abstract:Mutual information（MI） based method has been widely used for solving multi-mode image registration problem.This paper presents an improved multi-mode image registration method based on MI of region of interests（ROIs）.Improvements are made from the following two aspects.Firstly,in order to increase the performance of this algorithm,image preprocessing is applied to suppress the effect of noises,and image grey levels down sampling by means of rescaling intensity levels properly is operated to reduce calculation time.Secondly,the method of using local regions with high intensity variation instead of whole image calculating MI is used to improve the efficiency of the intensities used in the algorithm and the accuracy and reliability of MI based registration.The experiment results show that this method could effectively extract regions with high correlation and improve the efficiency and accuracy of MI-based image registration.
Computation of Mutual Information in Medical Image Registration Based on Mutual Information

Jianwei Zhang,Guoqiang Han

DOI: https://doi.org/10.3321/j.issn:1001-5515.2008.01.003

2008-01-01

Abstract:Registration based on mutual information is a typical method in medical image registration. Mutual information is a common similarity measure in image registration, which has excellent robustness and accuracy, but large calculation amount makes it difficult to be applied to clinics. In this paper, a registration algorithm based on multi-resolution and hybrid optimization is adopted to implement 2-dimension monomodal and multimodal registrations of MRI and CT images of human heads with different numbers of gray bins. Results of experiments show that registration precisions have not notable change with 32, 64 gray bins, compared with 256 gray bins, whereas the computation costs decrease remarkably.
Multimodality Image Registration Using Local Linear Embedding and Hybrid Entropy

Qi Li,Hongbing Ji

DOI: https://doi.org/10.1016/j.neucom.2012.11.032

IF: 6

2013-01-01

Neurocomputing

Abstract:Robust registration of multimodality medical images has become an active area of research in medical image processing and applications. Although mutual information (MI) has been successfully applied to image registration, it is worth noting that MI-based registration measure only takes statistical intensity information into account and does not use spatial features. In this paper, we propose a local linear embedding (LLE) and hybrid entropy based registration method that combines spatial information into registration measure. Due to the robustness to absolute intensity information of image pixels and stability in noisy environment, the ordinal features (OFs) with different orientations are extracted to represent spatial information in medical images. For high dimensional OFs, the LLE algorithm is used to dimensionality reduction and the inverse mapping of LLE is used to fuse complementary information of OFs together. Then a novel similarity measure based on hybrid entropy which integrates intensity with OF is defined to register multimodality images. The experimental results show that the proposed registration algorithm can effectively suppress and eliminate the influence of noise in images. Compared with some existing methods, the proposed algorithm is of higher precision and better robustness.
Multi-modal Medical Image Registration Based on Phase Congruency and Quantitative-Qualitative Mutual Information

Shan Zhang,Hongbin Han,Zhaoying Liu,Bo Liu,Fugen Zhou

DOI: https://doi.org/10.1117/12.901917

2011-01-01

Abstract:A new approach of multi-modal medical image registration is proposed to overcome the drawbacks of mutual information as taking no consideration of the space information, taking all intensities without distinction, and being sensitive to noise. The proposed method firstly extracts the phase congruencies of the reference and floating image, secondly, it computes quantitative-qualitative mutual information with the phase congruency mappings, finally, the geometric transform is optimized by Particle Swarm Optimization. The quantitative-qualitative mutual information used in our algorithm select the pixels whose utility are larger than the threshold of 1. In addition, Mutual information incorporating phase congruency assimilates the information of both intensity and space. Experiment results show that our approach is more robust in suppressing noise and can achieve higher accuracy.
Multi-sensor Image Automatic Registration Using Mutual Information

Jiang Jing,Zhang Xuesong

DOI: https://doi.org/10.1117/12.2010877

2011-01-01

Energy Procedia

Abstract:A novel multi-sensor image registration algorithm was introduced, which was based on wavelet transform and the maximization of mutual information. Firstly, the region of interest was determined by search of wavelet magnitude maxima in the preprocessing step of images, and the affine transform was chosen as the image transform model. Secondly, the probability distribution of grey value was estimated by interpolation of pixel values to calculate image intensity histogram. Finally, the simulated annealing algorithm was used to approximate the global optimum. The experiment data show that the algorithm was effective and feasible.
Ultrasound-MR image registration based on improved conditional mutual information

李文,舒华忠

DOI: https://doi.org/10.3969/j.issn.1006-6675-B.2011.06.099

2011-01-01

Abstract:General mutual information （GMI） is a popular similarity measure for medical image registration due to its high accuracy and robustness. Extending GMI with spatial distribution is an active field of research. We propose a novel approach： improved mutual information, which combines the quality of conditional mutual information and Tsallis entropy. The experimental result demonstrates that proposed method significantly outperforms GMI for ultrasound-MR image registration.
Multimodality image registration by maximization of mutual information

F Maes,A Collignon,D Vandermeulen,G Marchal,P Suetens,F. Maes,A. Collignon,D. Vandermeulen,G. Marchal,P. Suetens

DOI: https://doi.org/10.1109/42.563664

IF: 10.6

1997-04-01

IEEE Transactions on Medical Imaging

Abstract:A new approach to the problem of multimodality medical image registration is proposed, using a basic concept from information theory, mutual information (MI), or relative entropy, as a new matching criterion. The method presented in this paper applies MI to measure the statistical dependence or information redundancy between the image intensities of corresponding voxels in both images, which is assumed to be maximal if the images are geometrically aligned. Maximization of MI is a very general and powerful criterion, because no assumptions are made regarding the nature of this dependence and no limiting constraints are imposed on the image content of the modalities involved. The accuracy of the MI criterion is validated for rigid body registration of computed tomography (CT), magnetic resonance (MR), and photon emission tomography (PET) images by comparison with the stereotactic registration solution, while robustness is evaluated with respect to implementation issues, such as interpolation and optimization, and image content, including partial overlap and image degradation. Our results demonstrate that subvoxel accuracy with respect to the stereotactic reference solution can be achieved completely automatically and without any prior segmentation, feature extraction, or other preprocessing steps which makes this method very well suited for clinical applications.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Medical Image Registration Using Fuzzy Theory.

Meisen Pan,Jingtian Tang,Qi Xiong

DOI: https://doi.org/10.1080/10255842.2011.557372

2012-01-01

Abstract:Mutual information (MI)-based registration, which uses MI as the similarity measure, is a representative method in medical image registration. It has an excellent robustness and accuracy, but with the disadvantages of a large amount of calculation and a long processing time. In this paper, by computing the medical image moments, the centroid is acquired. By applying fuzzy c-means clustering, the coordinates of the medical image are divided into two clusters to fit a straight line, and the rotation angles of the reference and floating images are computed, respectively. Thereby, the initial values for registering the images are determined. When searching the optimal geometric transformation parameters, we put forward the two new concepts of fuzzy distance and fuzzy signal-to-noise ratio (FSNR), and we select FSNR as the similarity measure between the reference and floating images. In the experiments, the Simplex method is chosen as multi-parameter optimisation. The experimental results show that this proposed method has a simple implementation, a low computational cost, a fast registration and good registration accuracy. Moreover, it can effectively avoid trapping into the local optima. It is adapted to both mono-modality and multi-modality image registrations.
Multi-model image registration based on weighted orientation correlation and mutual information

谭东杰,张安

DOI: https://doi.org/10.3969/j.issn.1007-2276.2013.03.067

2013-01-01

Abstract:An improved multi-model image registration method was proposed for visible and infrared image registration, which was based on optimal region mutual information (MI) and edge orientation correlation (OC). Firstly, with proper principle, local regions with rich information were selected by image partition. Then, in order to include spatial information, image edge orientation was introduced to construct an edge orientation map. Finally, by integrating the correlation of edge orientation map and MI of optimal regions with a trade-off weight, a new similarity metric was constructed. Experiment results show that by combining edge orientation correlation, this new metric can effectively improve the accuracy of MI based method, and processing with local optimal regions instead of whole image can improve the efficiency.
Non-rigid Registration of Multiphase Contrast-Enhanced Abdomen CT Image

Zhiliang Zhu,Ji Li,Huiyan Jiang,Libo Zhang,Benqiang Yang

2012-01-01

Abstract:Mutual information is a widely-used metric in medical image registration, which achieves many good results; however, it may lead to misregistration because of the absence of spatial information. In order to solve this problem, this paper proposes an improved hybrid metric combining mutual information and spatial information. The spatial information is obtained through calculating Hausdorff fraction. In experiments, mutual information is used as a comparative method. Experiments show that the proposed method performs well in multiphase contrast-enhanced abdomen CT image non-rigid registration problems.

Research on Multi-Modality Medical Image Registration Based on Mutual Information

Multi-modality Medical Image Registration Using High Dimension Mutual Information

Regional Weighted Mutual Information For Multimodal Rigid Registration

Multi-Modal Image Registration Based on Multi-Feature Mutual Information

THE RESEARCH ON APPLICATION OF MUTUAL INFORMATION TO MULTIMODALITY MEDICAL IMAGE REGISTRATION

Medical image registration method based on mixed mutual information

Medical Image Registration Based on Mutual Information Entropy Combined with Edge Correlation Feature

Multi-modal Medical Image Registration Based on Adaptive Combination of Intensity and Gradient Field Mutual Information

Multi-modal image registration by mutual information based on optimal region selection

Multi-Modality Medical Image Registration Based on Regional Joint Rényi Entropy

[Advances in Medical Image Registration Based on Mutual Information].

Multi-Mode Image Registration Based on Mutual Information of Region of Interests

Computation of Mutual Information in Medical Image Registration Based on Mutual Information

Multimodality Image Registration Using Local Linear Embedding and Hybrid Entropy

Multi-modal Medical Image Registration Based on Phase Congruency and Quantitative-Qualitative Mutual Information

Multi-sensor Image Automatic Registration Using Mutual Information

Ultrasound-MR image registration based on improved conditional mutual information

Multimodality image registration by maximization of mutual information

Medical Image Registration Using Fuzzy Theory.

Multi-model image registration based on weighted orientation correlation and mutual information

Non-rigid Registration of Multiphase Contrast-Enhanced Abdomen CT Image