Abstract:<p>Recent years have witnessed a trend that uses image representation models, including sparse representation (SR), low-rank representation (LRR) and their variants for multi-focus image fusion. Despite the thrilling preliminary results, existing methods conduct the fusion patch by patch, leading to insufficient consideration of the spatial consistency among the image patches within a local region or an object. As a result, not only the spatial artifacts are easily introduced to the fused image but also the "jagged" artifacts frequently arise on the boundaries between the focused regions and the de-focused regions, which is an inherent problem in these patch-based fusion methods.Aiming to address the above problems, we propose, in this paper,a new multi-focus image fusion method integrating super-pixel clustering and a unified LRR (ULRR) model. The entire algorithm is carried out in three steps. In the first step, the source image is segmented into a few super-pixels with irregular sizes, rather than patches with regular sizes, to diminish the "jagged" artifacts and meanwhile to preserve the boundaries of objects on the fused image. Secondly, a super-pixel clustering-based fusion strategy is employed to further reduce the spatial artifacts in the fused images. This is achieved by using a proposed ULRR model, which imposes the low-rank constraints onto each super-pixel cluster.Thisis apparently more reasonable for those images with complicated scenes. Moreover, a Laplacianregularization term is incorporated in the proposed ULRR model to ensure the spatial consistency among the super-pixels with the same cluster. Finally, a measure of focus for each super-pixel is defined to seek the focused as well as de-focused regions in thesource image via jointly using representation coefficients and sparse errors derived from the proposed ULRR model. Extensive experiments have been conducted and the results demonstrate the superiorities of the proposed fusion method in diminishing the spatial artifactsin the fused image and the "jagged" boundary artifacts between the focused and de-focused regions, compared to the state-of-the-art fusion algorithms.</p>

Unification of Image Fusion and Super-Resolution Using Jointly Trained Dictionaries and Local Information Contents

Multispectral Image Super-Resolution Via RGB Image Fusion and Radiometric Calibration

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Fusion of Hyperspectral-Multispectral images joining Spatial-Spectral Dual-Dictionary and structured sparse Low-rank representation

A Hybrid Multi-Frame Super-Resolution Algorithm Using Multi-Channel Memristive Pulse Coupled Neural Network and Sparse Coding

Multi-focus Image Fusion using dictionary learning and Low-Rank Representation

Single Image Super-Resolution Based on Nonlocal Similarity and Sparse Representation

Multi-Source Deep Residual Fusion Network for Depth Image Super-resolution

CCSR-Net: Unfolding Coupled Convolutional Sparse Representation for Multi-focus Image Fusion.

Exploring a unified low rank representation for multi-focus image fusion

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

A Universal Fusion Strategy for Image Super-Resolution Jointly from External and Internal Examples

Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries

Hyperspectral-Multispectral Image Fusion via Tensor Ring and Subspace Decompositions

Universal high spatial resolution hyperspectral imaging using hybrid-resolution image fusion

High-to-low-level Feature Matching and Complementary Information Fusion for Reference-Based Image Super-Resolution

Multi-focus image fusion based on non-negative sparse representation and patch-level consistency rectification

Hyperspectral and Multispectral Data Fusion via Joint Local-Nonlocal Modeling and Truncation Operator

Image Super-Resolution Based on Adaptive Joint Distribution Modeling