Abstract:Multi-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images captured by cameras produce anisotropic blur and unregistration. This paper proposes a new multi-focus image fusion method based on the multi-scale decomposition of complementary information. Firstly, this method uses two groups of large-scale and small-scale decomposition schemes that are structurally complementary, to perform two-scale double-layer singular value decomposition of the image separately and obtain low-frequency and high-frequency components. Then, the low-frequency components are fused by a rule that integrates image local energy with edge energy. The high-frequency components are fused by the parameter-adaptive pulse-coupled neural network model (PA-PCNN), and according to the feature information contained in each decomposition layer of the high-frequency components, different detailed features are selected as the external stimulus input of the PA-PCNN. Finally, according to the two-scale decomposition of the source image that is structure complementary, and the fusion of high and low frequency components, two initial decision maps with complementary information are obtained. By refining the initial decision graph, the final fusion decision map is obtained to complete the image fusion. In addition, the proposed method is compared with 10 state-of-the-art approaches to verify its effectiveness. The experimental results show that the proposed method can more accurately distinguish the focused and non-focused areas in the case of image pre-registration and unregistration, and the subjective and objective evaluation indicators are slightly better than those of the existing methods.

Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

Multi-focus image fusion with deep residual learning and focus property detection

A multi-focus image fusion network with local-global joint attention module

Multi-Scale Visual Attention Deep Convolutional Neural Network for Multi-Focus Image Fusion

Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network.

MCRD-Net: an Unsupervised Dense Network with Multi-Scale Convolutional Block Attention for Multi-Focus Image Fusion

A Deep and Supervised Atrous Convolutional Model for Multi-Focus Image Fusion

Multi-focus Image Fusion Based on Fully Convolutional Networks.

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

Multi-scale Convolutional Neural Network for Multi-Focus Image Fusion.

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Multi-focus Image Fusion Using Fully Convolutional Two-stream Network for Visual Sensors.

Multi-Focus Color Image Fusion Algorithm Based on Super-Resolution Reconstruction and Focused Area Detection

Multi-Focus Image Fusion with a Natural Enhancement Via a Joint Multi-Level Deeply Supervised Convolutional Neural Network

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary

End-to-End Learning for Simultaneously Generating Decision Map and Multi-Focus Image Fusion Result

Color Multi-Focus Image Fusion Based on Transfer Learning.

Exploit the Best of Both End-to-End and Map-Based Methods for Multi-Focus Image Fusion