Abstract:Multi-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images captured by cameras produce anisotropic blur and unregistration. This paper proposes a new multi-focus image fusion method based on the multi-scale decomposition of complementary information. Firstly, this method uses two groups of large-scale and small-scale decomposition schemes that are structurally complementary, to perform two-scale double-layer singular value decomposition of the image separately and obtain low-frequency and high-frequency components. Then, the low-frequency components are fused by a rule that integrates image local energy with edge energy. The high-frequency components are fused by the parameter-adaptive pulse-coupled neural network model (PA-PCNN), and according to the feature information contained in each decomposition layer of the high-frequency components, different detailed features are selected as the external stimulus input of the PA-PCNN. Finally, according to the two-scale decomposition of the source image that is structure complementary, and the fusion of high and low frequency components, two initial decision maps with complementary information are obtained. By refining the initial decision graph, the final fusion decision map is obtained to complete the image fusion. In addition, the proposed method is compared with 10 state-of-the-art approaches to verify its effectiveness. The experimental results show that the proposed method can more accurately distinguish the focused and non-focused areas in the case of image pre-registration and unregistration, and the subjective and objective evaluation indicators are slightly better than those of the existing methods.

MA-MFIF: When misaligned multi-focus Image fusion meets deep homography estimation

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

Multi-focus image fusion with deep residual learning and focus property detection

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

Mutli-focus image fusion based on guided filter and image matting network

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Exploit the Best of Both End-to-End and Map-Based Methods for Multi-Focus Image Fusion

New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model

Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary

Multi-Exposure Image Fusion via Deformable Self-Attention

Bridging the Gap between Multi-focus and Multi-modal: A Focused Integration Framework for Multi-modal Image Fusion

Multi-focus image fusion: A Survey of the state of the art

Multi-focus image fusion based on fractional order differentiation and closed image matting

An Automatic Image Fusion Algorithm for Unregistered Multiply Multifocus Images

Multi-focus Image Fusion with Structure-Driven Adaptive Regions

Multi-focus Image Fusion Using Fully Convolutional Two-stream Network for Visual Sensors.

Multi-focus image fusion with a deep convolutional neural network

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

A Deep Learning Framework for Infrared and Visible Image Fusion Without Strict Registration

SESF-Fuse: an unsupervised deep model for multi-focus image fusion