Abstract:Despite the fact that there is a remarkable achievement on multifocus image fusion, most of the existing methods only generate a low-resolution image if the given source images suffer from low resolution. Obviously, a naive strategy is to independently conduct image fusion and image super-resolution. However, this two-step approach would inevitably introduce and enlarge artifacts in the final result if the result from the first step meets artifacts. To address this problem, in this article, we propose a novel method to simultaneously achieve image fusion and super-resolution in one framework, avoiding step-by-step processing of fusion and super-resolution. Since a small receptive field can discriminate the focusing characteristics of pixels in detailed regions, while a large receptive field is more robust to pixels in smooth regions, a subnetwork is first proposed to compute the affinity of features under different types of receptive fields, efficiently increasing the discriminability of focused pixels. Simultaneously, in order to prevent from distortion, a gradient embedding-based super-resolution subnetwork is also proposed, in which the features from the shallow layer, the deep layer, and the gradient map are jointly taken into account, allowing us to get an upsampled image with high resolution. Compared with the existing methods, which implemented fusion and super-resolution independently, our proposed method directly achieves these two tasks in a parallel way, avoiding artifacts caused by the inferior output of image fusion or super-resolution. Experiments conducted on the real-world dataset substantiate the superiority of our proposed method compared with state of the arts.

Multi-focus Image Fusion Via Gradient Guidance Progressive Network.

Gradient-based multi-focus image fusion method using convolution neural network

Multi-focus Noisy Image Fusion Based on Gradient Regularized Convolutional Sparse Representatione.

Focus Relationship Perception for Unsupervised Multi-Focus Image Fusion.

Color Multi-Focus Image Fusion Based on Transfer Learning.

Multi-Focus Image Fusion Through Gradient-Based Decision Map Construction And Mathematical Morphology

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Multi-focus Image Fusion with Joint Guided Image Filtering

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

Multi-focus Image Fusion Based on Fully Convolutional Networks.

MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion

A multi-focus image fusion network with local-global joint attention module

Multi-focus image fusion with deep residual learning and focus property detection

Salience Preserving Multi-Focus Image Fusion

Learning to Fuse Multi-Focus Image via Convolutional Network Modeling

A Deep Model for Multi-Focus Image Fusion Based on Gradients and Connected Regions

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Multi-focus image fusion by progressive pixel extraction

A Multi-Focus Image Fusion Framework Based on Multi-Scale Sparse Representation in Gradient Domain

Multi-focus Image Fusion Using Fully Convolutional Two-stream Network for Visual Sensors.

Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network