Abstract:<p>Recent years have witnessed a trend that uses image representation models, including sparse representation (SR), low-rank representation (LRR) and their variants for multi-focus image fusion. Despite the thrilling preliminary results, existing methods conduct the fusion patch by patch, leading to insufficient consideration of the spatial consistency among the image patches within a local region or an object. As a result, not only the spatial artifacts are easily introduced to the fused image but also the "jagged" artifacts frequently arise on the boundaries between the focused regions and the de-focused regions, which is an inherent problem in these patch-based fusion methods.Aiming to address the above problems, we propose, in this paper,a new multi-focus image fusion method integrating super-pixel clustering and a unified LRR (ULRR) model. The entire algorithm is carried out in three steps. In the first step, the source image is segmented into a few super-pixels with irregular sizes, rather than patches with regular sizes, to diminish the "jagged" artifacts and meanwhile to preserve the boundaries of objects on the fused image. Secondly, a super-pixel clustering-based fusion strategy is employed to further reduce the spatial artifacts in the fused images. This is achieved by using a proposed ULRR model, which imposes the low-rank constraints onto each super-pixel cluster.Thisis apparently more reasonable for those images with complicated scenes. Moreover, a Laplacianregularization term is incorporated in the proposed ULRR model to ensure the spatial consistency among the super-pixels with the same cluster. Finally, a measure of focus for each super-pixel is defined to seek the focused as well as de-focused regions in thesource image via jointly using representation coefficients and sparse errors derived from the proposed ULRR model. Extensive experiments have been conducted and the results demonstrate the superiorities of the proposed fusion method in diminishing the spatial artifactsin the fused image and the "jagged" boundary artifacts between the focused and de-focused regions, compared to the state-of-the-art fusion algorithms.</p>

A Spatial Fusion Scheme of Multi-focus Image Combining SVM-Based Classification and PCA-Based Weight

Multi-focus Color Image Fusion in the HSI Space Using the Sum-Modified-laplacian and a Coarse Edge Map

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Multi-source Remote Sensing Image Fusion Based on Support Vector Machine

Multi-focus Image Fusion Based on Similarity Characteristics

The Realistic Fusion of Multi-spectral Images

Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

A New Method of Multi-Focus Image Fusion Using Laplacian Operator and Region Optimization

Multi-source image fusion algorithm based on fast weighted guided filter

Quadtree-based multi-focus image fusion using a weighted focus-measure

Multi-Focus Image Fusion Through Gradient-Based Decision Map Construction And Mathematical Morphology

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

Multi-Focus Image Fusion Based on Spatial Frequency(SF) and Consistency Verification(CV) in DCT Domain

Multi-focus image fusion with deep residual learning and focus property detection

Improving the Performance of Image Fusion Based on Visual Saliency Weight Map Combined with CNN.

Multi-focus image fusion with a deep convolutional neural network

Multi-focus image fusion algorithm based on region detection and ACS network

Two-scale decomposition-based multifocus image fusion framework combined with image morphology and fuzzy set theory

Exploring a unified low rank representation for multi-focus image fusion