New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model
Jiwei Wang,Huaijing Qu,Zhisheng Zhang,Ming Xie
DOI: https://doi.org/10.1016/j.inffus.2024.102230
IF: 18.6
2024-01-05
Information Fusion
Abstract:This paper proposes a method based on multi-dictionary linear sparse representation and region fusion model for achieving high-quality multi-focus image fusion (MFIF). First, a multi-dictionary linear sparse representation model (MDLSR) is proposed for focus detection of source images, in which the focus information of the source image is characterized using linear coefficients between the dictionary and the input image, while the dictionary is a set of images including the source images. MDLSR exploits the correlation of feature information among local neighborhoods of the source image, and this feature significantly improves the accuracy of focus detection. Next, we propose an edge-weighting closed-form matting (EWCM) to define the source image focus boundary accurately. EWCM calculates the weights at each position in a content-adaptive manner, suppressing the effects of vignetting artifacts near the edges to preserve more edge details. Then, to avoid the focused/defocused boundary (FDB) region fusion problem caused by the defocus spread effect (DSE), we propose a region fusion model (RFM) for the MFIF, which uses correction and compensation to mitigate this problem. Finally, we also adopt an iterative update approach to improve the quality of the fused images. These designs achieve a win-win situation regarding fusion performance and realization ability. The experimental results on four typical datasets show that our method outperforms 37 state-of-the-art methods in terms of subjective visual effect, objective metric analysis and generalization ability. Our code is available at https://github.com/JWatawang/MDLSR_RFM.
computer science, artificial intelligence, theory & methods