Abstract:Despite the fact that there is a remarkable achievement on multifocus image fusion, most of the existing methods only generate a low-resolution image if the given source images suffer from low resolution. Obviously, a naive strategy is to independently conduct image fusion and image super-resolution. However, this two-step approach would inevitably introduce and enlarge artifacts in the final result if the result from the first step meets artifacts. To address this problem, in this article, we propose a novel method to simultaneously achieve image fusion and super-resolution in one framework, avoiding step-by-step processing of fusion and super-resolution. Since a small receptive field can discriminate the focusing characteristics of pixels in detailed regions, while a large receptive field is more robust to pixels in smooth regions, a subnetwork is first proposed to compute the affinity of features under different types of receptive fields, efficiently increasing the discriminability of focused pixels. Simultaneously, in order to prevent from distortion, a gradient embedding-based super-resolution subnetwork is also proposed, in which the features from the shallow layer, the deep layer, and the gradient map are jointly taken into account, allowing us to get an upsampled image with high resolution. Compared with the existing methods, which implemented fusion and super-resolution independently, our proposed method directly achieves these two tasks in a parallel way, avoiding artifacts caused by the inferior output of image fusion or super-resolution. Experiments conducted on the real-world dataset substantiate the superiority of our proposed method compared with state of the arts.

Simultaneous Image Fusion and Super-Resolution Using Sparse Representation

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Multispectral Image Super-Resolution Via RGB Image Fusion and Radiometric Calibration

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Superresolution Fusion of Multi-Focus Image Based on Multiscale Sparse Dictionary

Single Image Super-Resolution Using Sparse Prior

Image Fusion With Double Sparse Representation In Wavelet Domain

Image Fusion with Nonsubsampled Contourlet Transform and Sparse Representation.

An Infrared and Visible Image Fusion Method Based on Non-Subsampled Contourlet Transform and Joint Sparse Representation.

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Sparse Representation based Multi-sensor Image Fusion: A Review

Multiresolutional multisource image fusion algorithm

Adaptive Fusion Super-Resolution Based on Parallel Scoring

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

Image Super-Resolution Via Multi-View Information Fusion Networks.

Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries

Hyperspectral imagery super-resolution by image fusion and compressed sensing

A multi-source image fusion algorithm based on gradient regularized convolution sparse representation

Unification of Image Fusion and Super-Resolution Using Jointly Trained Dictionaries and Local Information Contents

Medical Image Fusion Based on Sparse Representation and Guided Filtering

Remote Sensing Image Fusion Using Best Bases Sparse Representation