Abstract:Objective: Blurry medical images affect the accuracy and efficiency of multimodal image registration, whose existing methods require further improvement. Methods: We propose an edge-based similarity registration method optimised for multimodal medical images, especially bone images, by a balance optimiser. First, we use a GPU (graphics processing unit) rendering simulation to convert computed tomography data into digitally reconstructed radiographs. Second, we introduce the improved cascaded edge network (ICENet), a convolutional neural network that extracts edge information of blurry medical images. Then, the bilateral Gaussian-weighted similarity of pairs of X-ray images and digitally reconstructed radiographs is measured. The a balanced optimiser is iteratively applied to finally estimate the best pose to perform image registration. Results: Experimental results show that, on average, the proposed method with ICENet outperforms other edge detection networks by 20%, 12%, 18.83%, and 11.93% in the overall Dice similarity, overall intersection over union, peak signal-to-noise ratio, and structural similarity index, respectively, with a registration success rate up to 90% and average reduction of 220% in registration time. Conclusion: The proposed method with ICENet can achieve a high registration success rate even for blurry medical images, and its efficiency and robustness are higher than those of existing methods. Significance: Our proposal may be suitable for supporting medical diagnosis, radiation therapy, image-guided surgery, and other clinical applications.

A novel image registration method based on edge fitting

Local Registration of Medical Images Using Feature Point and Intensity Information

Medical Image Elastic Registration Based on Contour and Feature Points

Optimizing Overlap Reductions of Feature Regions for Image Registration

An Medical Image Registration Approach Using Improved Hausdorff Distance Combined with Particle Swarm Optimization

Free-form Deformation Image Registration Using Edge Information Measure

Registration of Medical Images Using Points and Curves

A Novel Image Registration Algorithm Using Wavelet Transform and Matrix-Multiply Discrete Fourier Transform

Edge Consistency Feature Extraction Method for Multi-Source Image Registration

Medical image registration based on SIFT and edge points matching

Constrained Branch-and-Bound Algorithm for Image Registration

A Novel Image Registration Method Based on Geometrical Outlier Removal

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

Novel Edge Detection Method Based on Multiple Information Measures Fusion

A hybrid registration of medical images using intensity information and landmark points

Image registration based on corner detection and affine transformation

A New Curves-Based Local Image Registration Method

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Robust Image Registration Based on Wavelet and Increment Sign Correlation

Automatic Remote Sensing Image Registration Algorithm Based on SIFT

Registration of multimodal bone images based on edge similarity metaheuristic