Abstract:Medical image fusion refers to the process of fusing images of different modes of the same object using image processing technology to maximize the mining of image information and improve image quality. At present, many methods are available to study image fusion, but they usually have shortcomings such as low image contrast and a weak ability to retain image details and edges. To solve these problems, we propose a new multimodal medical image fusion method. In this algorithm, the original image is decomposed into high-frequency and low-frequency information by non-subsampled shearlet transform (NSST). Low-frequency information is fused by visual saliency maps, which avoids edge loss caused by direct use of the coefficient maximum fusion rule. High-frequency information is fused by a method jointly guided by the improved multi-scale morphology gradient and weighted sum of eight-neighborhood-based modified Laplacian, which retains the texture details and the edge of the image. Finally, the fused image is generated by the NSST inverse transform. This strategy solves the problem of insufficient detail extraction in traditional algorithms, improves the overall appearance of the fused image, and enhances the contrast. To verify the effectiveness of the algorithm, we applied this technique to four different medical image modality combinations, compared the results with nine image fusion methods published in recent years, and evaluated the fused images using image quality evaluation indexes. Our algorithm achieved better results in terms of subjective vision and objective image quality evaluations and therefore should be competitive with existing technologies.

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Fast detail-preserving exposure fusion

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Multi-focus Color Image Fusion in the HSI Space Using the Sum-Modified-laplacian and a Coarse Edge Map

Image Fusion Using Multiscale Edge-Preserving Decomposition Based on Weighted Least Squares Filter

Fusion for visible and infrared images using visual weight analysis and bilateral filter-based multi scale decomposition

Detail Enhancement Multi-Exposure Image Fusion Based on Homomorphic Filtering

Multi-Exposure Image Fusion Based on Weighted Average Adaptive Factor and Local Detail Enhancement

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

Salience Preserving Multi-Focus Image Fusion

Infrared and visible image fusion based on edge-preserving filter and weighted least square optimization

Multi-weight and multi-granularity fusion of underwater image enhancement

Coarse-to-fine multi-scale attention-guided network for multi-exposure image fusion

Salience Preserving Multifocus Image Fusion With Dynamic Range Compression

An enhanced multi-scale weight assignment strategy of two-exposure fusion

Multi-modal Image Fusion with the Hybrid ℓ0ℓ1 Layer Decomposing and Multi-Directional Filter Banks

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction