Abstract:<p>Recent years have witnessed a trend that uses image representation models, including sparse representation (SR), low-rank representation (LRR) and their variants for multi-focus image fusion. Despite the thrilling preliminary results, existing methods conduct the fusion patch by patch, leading to insufficient consideration of the spatial consistency among the image patches within a local region or an object. As a result, not only the spatial artifacts are easily introduced to the fused image but also the "jagged" artifacts frequently arise on the boundaries between the focused regions and the de-focused regions, which is an inherent problem in these patch-based fusion methods.Aiming to address the above problems, we propose, in this paper,a new multi-focus image fusion method integrating super-pixel clustering and a unified LRR (ULRR) model. The entire algorithm is carried out in three steps. In the first step, the source image is segmented into a few super-pixels with irregular sizes, rather than patches with regular sizes, to diminish the "jagged" artifacts and meanwhile to preserve the boundaries of objects on the fused image. Secondly, a super-pixel clustering-based fusion strategy is employed to further reduce the spatial artifacts in the fused images. This is achieved by using a proposed ULRR model, which imposes the low-rank constraints onto each super-pixel cluster.Thisis apparently more reasonable for those images with complicated scenes. Moreover, a Laplacianregularization term is incorporated in the proposed ULRR model to ensure the spatial consistency among the super-pixels with the same cluster. Finally, a measure of focus for each super-pixel is defined to seek the focused as well as de-focused regions in thesource image via jointly using representation coefficients and sparse errors derived from the proposed ULRR model. Extensive experiments have been conducted and the results demonstrate the superiorities of the proposed fusion method in diminishing the spatial artifactsin the fused image and the "jagged" boundary artifacts between the focused and de-focused regions, compared to the state-of-the-art fusion algorithms.</p>

Double Low Rank Matrix Recovery for Saliency Fusion.

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Salient object detection with low-rank approximation and ℓ2,1-norm minimization

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Dual Band Image Fusion Method Based on Region Saliency

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

Visual Saliency Detection Via Rank-Sparsity Decomposition

CSA-Net: Deep Cross-Complementary Self Attention and Modality-Specific Preservation for Saliency Detection

Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE

Saliency detection based on self-adaptive multiple feature fusion for remote sensing images

A Deep Multiscale Fusion Method via Low-Rank Sparse Decomposition for Object Saliency Detection Based on Urban Data in Optical Remote Sensing Images

A joint similarity matrix learning of multi-view data for RGB-T saliency detection

Visual Saliency Detection Via Sparsity Pursuit

Salient Object Detection via Bilateral Feature Fusion and Score Sorting Attention Mechanism

Manifold Ranking-Based Matrix Factorization for Saliency Detection

Semantic-Consistency-guided Learning on Deep Features for Unsupervised Salient Object Detection

Salience Preserving Multi-Focus Image Fusion

RGB-D salient object detection via cross-modal joint feature extraction and low-bound fusion loss

Co-saliency Detection Based on Hierarchical Consistency.

A Novel Saliency-Based Decomposition Strategy for Infrared and Visible Image Fusion

Exploring a unified low rank representation for multi-focus image fusion