Abstract:This paper presents a novel and fast EMD-based (empirical mode decomposition-based) image fusion approach via morphological filter. Firstly, we develop a multi-channel bidimensional EMD method based on morphological filter to conduct image fusion. It uses the morphological expansion and erosion filters to compute the upper and lower envelopes of a multi-channel image in the sifting processing, and can decompose the input source images into several intrinsic mode functions (IMFs) with different scales and a residue. It significantly improves the computation efficiency of EMD for multi-channel images while maintaining the decomposition quality. Secondly, we adopt a patch-based fusion strategy with overlapping partition to fuse the IMFs and residue instead of the pixel-based fusion way usually used in EMD-based image fusion, where an energy-based maximum selection rule is designed to fuse the IMFs, and the feature information extracted by IMFs is used as a guide to merge the residue. Such strategy can extract the salient information of the source images well and can also reduce the spatial artifacts introduced by the noisy characteristics of the pixel-wise maps. A large number of comparative experiments on the fusion of several commonly used image data sets with multi-focus and multi-modal images, show that our newly proposed fusion method can obtain much better results than the existing EMD-based image fusion approaches. Furthermore, it is very competitive with the state-of-the-art image fusion methods in visualization, objective metrics, and time performance. The code of the proposed method can be downloaded from: https://github.com/neepuhjp/MFMBEMD-ImageFusion.

Fast mutual modulation fusion for multi-sensor images

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Multi-Sensor Image Fusion Using Optimized Support Vector Machine and Multiscale Weighted Principal Component Analysis

A fast multi-resolution image fusion method based on visual features

The Realistic Fusion of Multi-spectral Images

Image Fusion with Morphological Component Analysis

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

Fast and Stable Hyperspectral Multispectral Image Fusion Technique Using Moore–Penrose Inverse Solver

Multi-source image fusion algorithm based on fast weighted guided filter

Multi-modal Image Fusion with the Hybrid ℓ0ℓ1 Layer Decomposing and Multi-Directional Filter Banks

Bridging the Gap between Multi-focus and Multi-modal: A Focused Integration Framework for Multi-modal Image Fusion

Multi-Modal Image Fusion Via Sparse Representation and Multi-Scale Anisotropic Guided Measure

Multiresolutional multisource image fusion algorithm

A new method for multi-source remote sensing image fusion

A Novel Pixel-Level and Feature-Level Combined Multisensor Image Fusion Scheme

Image Fusion Based on Feature Decoupling and Proportion Preserving.

Novel and Fast EMD-based Image Fusion Via Morphological Filter

An Automatic Image Fusion Algorithm for Unregistered Multiply Multifocus Images

Multi-Focus Image Fusion Algorithm in Sensor Networks

Novel Multi-Resolution Image Fusion Algorithm Based on Kalman Filtering

MGFuse: An Infrared and Visible Image Fusion Algorithm Based on Multiscale Decomposition Optimization and Gradient-Weighted Local Energy