Abstract:As is well known, activity level measurement and fusion rule are two crucial factors in image fusion. For most existing fusion methods, either in spatial domain or in a transform domain like wavelet, the activity level measurement is essentially implemented by designing local filters to extract high-frequency details, and the calculated clarity information of different source images are then compared using some elaborately designed rules to obtain a clarity/focus map. Consequently, the focus map contains the integrated clarity information, which is of great significance to various image fusion issues, such as multi-focus image fusion, multi-modal image fusion, etc. However, in order to achieve a satisfactory fusion performance, these two tasks are usually difficult to finish. In this study, we address this problem with a deep learning approach, aiming to learn a direct mapping between source images and focus map. To this end, a deep convolutional neural network (CNN) trained by high-quality image patches and their blurred versions is adopted to encode the mapping. The main novelty of this idea is that the activity level measurement and fusion rule can be jointly generated through learning a CNN model, which overcomes the difficulty faced by the existing fusion methods. Based on the above idea, a new multi-focus image fusion method is primarily proposed in this paper. Experimental results demonstrate that the proposed method can obtain state-of-the-art fusion performance in terms of both visual quality and objective assessment. The computational speed of the proposed method using parallel computing is fast enough for practical usage. The potential of the learned CNN model for some other-type image fusion issues is also briefly exhibited in the experiments.

ZMFF: Zero-shot multi-focus image fusion

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

Incrementally Adapting Pretrained Model Using Network Prior for Multi-Focus Image Fusion

A Self-Supervised Residual Feature Learning Model for Multifocus Image Fusion

Mutli-focus image fusion based on guided filter and image matting network

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model

FusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models

Multi-focus image fusion with a deep convolutional neural network

Multiscale Feature Interactive Network for Multifocus Image Fusion

Multi-focus image fusion with deep residual learning and focus property detection

MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion

MFFW: A new dataset for multi-focus image fusion

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

SESF-Fuse: an unsupervised deep model for multi-focus image fusion

Exploit the Best of Both End-to-End and Map-Based Methods for Multi-Focus Image Fusion

Learning to Fuse Multi-Focus Image via Convolutional Network Modeling

Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network