Abstract:Despite the fact that there is a remarkable achievement on multifocus image fusion, most of the existing methods only generate a low-resolution image if the given source images suffer from low resolution. Obviously, a naive strategy is to independently conduct image fusion and image super-resolution. However, this two-step approach would inevitably introduce and enlarge artifacts in the final result if the result from the first step meets artifacts. To address this problem, in this article, we propose a novel method to simultaneously achieve image fusion and super-resolution in one framework, avoiding step-by-step processing of fusion and super-resolution. Since a small receptive field can discriminate the focusing characteristics of pixels in detailed regions, while a large receptive field is more robust to pixels in smooth regions, a subnetwork is first proposed to compute the affinity of features under different types of receptive fields, efficiently increasing the discriminability of focused pixels. Simultaneously, in order to prevent from distortion, a gradient embedding-based super-resolution subnetwork is also proposed, in which the features from the shallow layer, the deep layer, and the gradient map are jointly taken into account, allowing us to get an upsampled image with high resolution. Compared with the existing methods, which implemented fusion and super-resolution independently, our proposed method directly achieves these two tasks in a parallel way, avoiding artifacts caused by the inferior output of image fusion or super-resolution. Experiments conducted on the real-world dataset substantiate the superiority of our proposed method compared with state of the arts.

SMFuse: Multi-Focus Image Fusion Via Self-Supervised Mask-Optimization

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

Learning to Fuse Multi-Focus Image via Convolutional Network Modeling

MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion

FuseGAN: Learning to fuse Multi-focus Image via Conditional Generative Adversarial Network

SESF-Fuse: an unsupervised deep model for multi-focus image fusion

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

A Self-Supervised Residual Feature Learning Model for Multifocus Image Fusion

ZMFF: Zero-shot multi-focus image fusion

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

MixFuse: an Iterative Mix-Attention Transformer for Multi-Modal Image Fusion

Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network

New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model

Multifocus Image Fusion Based on Fast Guided Filter and Focus Pixels Detection

Restoration and Fusion Optimization Scheme of Multifocus Image Using Genetic Search Strategies

Multi-focus images fusion via residual generative adversarial network

Multi-focus Image Fusion Based on Nonsubsampled Contourlet Transform and Residual Removal.

Exploit the Best of Both End-to-End and Map-Based Methods for Multi-Focus Image Fusion

MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion