Abstract:<p>Recent years have witnessed a trend that uses image representation models, including sparse representation (SR), low-rank representation (LRR) and their variants for multi-focus image fusion. Despite the thrilling preliminary results, existing methods conduct the fusion patch by patch, leading to insufficient consideration of the spatial consistency among the image patches within a local region or an object. As a result, not only the spatial artifacts are easily introduced to the fused image but also the "jagged" artifacts frequently arise on the boundaries between the focused regions and the de-focused regions, which is an inherent problem in these patch-based fusion methods.Aiming to address the above problems, we propose, in this paper,a new multi-focus image fusion method integrating super-pixel clustering and a unified LRR (ULRR) model. The entire algorithm is carried out in three steps. In the first step, the source image is segmented into a few super-pixels with irregular sizes, rather than patches with regular sizes, to diminish the "jagged" artifacts and meanwhile to preserve the boundaries of objects on the fused image. Secondly, a super-pixel clustering-based fusion strategy is employed to further reduce the spatial artifacts in the fused images. This is achieved by using a proposed ULRR model, which imposes the low-rank constraints onto each super-pixel cluster.Thisis apparently more reasonable for those images with complicated scenes. Moreover, a Laplacianregularization term is incorporated in the proposed ULRR model to ensure the spatial consistency among the super-pixels with the same cluster. Finally, a measure of focus for each super-pixel is defined to seek the focused as well as de-focused regions in thesource image via jointly using representation coefficients and sparse errors derived from the proposed ULRR model. Extensive experiments have been conducted and the results demonstrate the superiorities of the proposed fusion method in diminishing the spatial artifactsin the fused image and the "jagged" boundary artifacts between the focused and de-focused regions, compared to the state-of-the-art fusion algorithms.</p>

Assessment Method to Fusion Effect Based on Structural Similarity Comparison in Fusion Images

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Objective Image Fusion Quality Evaluation Using Structural Similarity

Multi-exposure image fusion based on well-exposedness assessment

A pixel-level image fusion framework based on structural similarity

Video fusion performance evaluation based on structural similarity and human visual perception

The Realistic Fusion of Multi-spectral Images

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Multi-exposure X-ray image fusion quality evaluation based on CSF and gradient amplitude similarity

Rethinking the Effectiveness of Objective Evaluation Metrics in Multi-focus Image Fusion: A Statistic-based Approach

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

A New Wavelet Image Fusion Algorithm Based on Human Visual System

Superpixel-Based Quality Assessment of Multi-Exposure Image Fusion for Both Static and Dynamic Scenes

Similarity-Based Objective Measure for Performance of Image Fusion

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

Selection of image fusion quality measures: objective, subjective, and metric assessment

Comparison of quality evaluation methods for image fusion of farmland remote sensing

Pixel Level Image Fusion Methods and Fusion Performance Evaluation

A Novel Multi-Exposure Image Fusion Method Based on Adaptive Patch Structure

Exploring a unified low rank representation for multi-focus image fusion