Abstract:Multi-focus image fusion can extract the focus regions from different source images and combine them into a fully clear image. Existing unsupervised methods typically use gradient information to measure the focus regions in images and generate a fusion weight map, but ordinary gradient operators are difficult to measure information accurately in regions with weaker textures. In addition, using only gradient information as a constraint cannot make the model fully distinguish all the focus regions in the image, which seriously restricts the clarity of the fusion image. To address these issues, a novel unsupervised multi-focus image fusion method is proposed in this paper. Specifically, a neighborhood information fusion network is designed to generate an initial fusion weight map. It can capture features within different neighborhood ranges at once, which enhances the information association between different regions. In addition, to further improve the feature extraction ability of the model in the regions with low texture information, a local difference evaluation loss function is proposed. It is combined with the gradient measure loss function to constrain the network. Finally, a fusion weight optimization module is proposed to improve the clarity of the fusion image in the repeated defocusing regions and overexposed regions of different source images, which redistributes the weights of different source images. The proposed fusion method is compared with advanced methods on three public multi-focus datasets. Experimental results indicate that the proposed method has achieved better performance in qualitative and quantitative aspects.

Evaluation of focus measures in multi-focus image fusion

A Measure for the Evaluation of Multi-Focus Image Fusion at Feature Level

A Multi-Focus Image Fusion Method Based On Image Features

Multi-Focus Image Fusion With Point Detection Filter and Superpixel-Based Consistency Verification

Multi-focus image fusion using residual removal and fractional order differentiation focus measure

Multi-focus Image Fusion Using Image-Partition-based Focus Detection.

Efficient Compressive Multi-Focus Image Fusion

Robust Multi-Focus Image Fusion Using Focus Property Detection and Deep Image Matting.

Multi-Focus Image Fusion Based on Multi-Level and Iterative Method

Two-Stage Focus Measurement Network with Joint Boundary Refinement for Multifocus Image Fusion.

Focus Relationship Perception for Unsupervised Multi-Focus Image Fusion.

Focus-pixel estimation and optimization for multi-focus image fusion

Multi-focus Image Fusion: A Benchmark

A New Focus Measure for Fusion of Multi-Focus Noisy Images

Multi-focus image fusion: A Survey of the state of the art

Multi-Focus Image Fusion via Boundary Finding and Multi-Scale Morphological Focus-Measure

A New Multi-Focus Image Fusion Method Based on Multi-Wavelet Analysis

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

An Adaptive Block-Based Fusion Method with Lue-Ssim for Multi-Focus Images

Multi-focus Image Fusion Algorithm based on Relative Activity Level

Pixel-clarity-based Multifocus Image Fusion