Abstract:Despite the fact that there is a remarkable achievement on multifocus image fusion, most of the existing methods only generate a low-resolution image if the given source images suffer from low resolution. Obviously, a naive strategy is to independently conduct image fusion and image super-resolution. However, this two-step approach would inevitably introduce and enlarge artifacts in the final result if the result from the first step meets artifacts. To address this problem, in this article, we propose a novel method to simultaneously achieve image fusion and super-resolution in one framework, avoiding step-by-step processing of fusion and super-resolution. Since a small receptive field can discriminate the focusing characteristics of pixels in detailed regions, while a large receptive field is more robust to pixels in smooth regions, a subnetwork is first proposed to compute the affinity of features under different types of receptive fields, efficiently increasing the discriminability of focused pixels. Simultaneously, in order to prevent from distortion, a gradient embedding-based super-resolution subnetwork is also proposed, in which the features from the shallow layer, the deep layer, and the gradient map are jointly taken into account, allowing us to get an upsampled image with high resolution. Compared with the existing methods, which implemented fusion and super-resolution independently, our proposed method directly achieves these two tasks in a parallel way, avoiding artifacts caused by the inferior output of image fusion or super-resolution. Experiments conducted on the real-world dataset substantiate the superiority of our proposed method compared with state of the arts.

A Multi-Focus Image Fusion Framework Based on Multi-Scale Sparse Representation in Gradient Domain

Multi-focus Image Fusion with Geometrical Sparse Representation.

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Multi-focus image fusion based on multi-scale sparse representation

New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model

Multi-focus Noisy Image Fusion Based on Gradient Regularized Convolutional Sparse Representatione.

Focus Relationship Perception for Unsupervised Multi-Focus Image Fusion.

Multi-focus Image Fusion Based on Multi-Scale Focus Measures and Generalized Random Walk

The Multi-Focus-Image-Fusion Method Based on Convolutional Neural Network and Sparse Representation.

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

3M: A Multi-Scale and Multi-Directional Method for Multi-Focus Image Fusion

A Novel Sparse-Representation-based Multi-Focus Image Fusion Approach

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Multi-focus Image Fusion with Joint Guided Image Filtering

Robust Multi-Focus Image Fusion Using Focus Property Detection and Deep Image Matting.

Multi-Focus Image Fusion Through Gradient-Based Decision Map Construction And Mathematical Morphology

Multi-focus image fusion using residual removal and fractional order differentiation focus measure

Multi-Focus Image Fusion Based on Hessian Matrix Decomposition and Salient Difference Focus Detection

Multi-Focus Image Fusion Based on Multi-Level and Iterative Method

Multi-focus Image Fusion Based on Sparse Decomposition and Background Detection.

Multi-Focus Image Fusion via Boundary Finding and Multi-Scale Morphological Focus-Measure