Abstract:Multi-focus image fusion (MFIF) is an important technique that aims to combine the focused regions of multiple source images into a fully clear image. Decision-map methods are widely used in MFIF to maximize the preservation of information from the source images. While many decision-map methods have been proposed, they often struggle with difficulties in determining focus and non-focus boundaries, further affecting the quality of the fused images. Dynamic threshold neural P (DTNP) systems are computational models inspired by biological spiking neurons, featuring dynamic threshold and spiking mechanisms to better distinguish focused and unfocused regions for decision map generation. However, original DTNP systems require manual parameter configuration and have only one stimulus. Therefore, they are not suitable to be used directly for generating high-precision decision maps. To overcome these limitations, we propose a variant called parameter adaptive dual channel DTNP (PADCDTNP) systems. Inspired by the spiking mechanisms of PADCDTNP systems, we further develop a new MFIF method. As a new neural model, PADCDTNP systems adaptively estimate parameters according to multiple external inputs to produce decision maps with robust boundaries, resulting in high-quality fusion results. Comprehensive experiments on the Lytro/MFFW/MFI-WHU dataset show that our method achieves advanced performance and yields comparable results to the fourteen representative MFIF methods. In addition, compared to the standard DTNP systems, PADCDTNP systems improve the fusion performance and fusion efficiency on the three datasets by 5.69% and 86.03%, respectively. The codes for both the proposed method and the comparison methods are released at https://github.com/MorvanLi/MFIF-PADCDTNP.

FusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

FusionDiff: A unified image fusion network based on diffusion probabilistic models

Diff-IF: Multi-modality image fusion via diffusion model with fusion knowledge prior

DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion

Multi-focus image fusion with parameter adaptive dual channel dynamic threshold neural P systems

DCAFuse: Dual-Branch Diffusion-CNN Complementary Feature Aggregation Network for Multi-Modality Image Fusion

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model

MMDRFuse: Distilled Mini-Model with Dynamic Refresh for Multi-Modality Image Fusion

ZMFF: Zero-shot multi-focus image fusion

DifFUSER: Diffusion Model for Robust Multi-Sensor Fusion in 3D Object Detection and BEV Segmentation

Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model

Bridging the Gap between Multi-focus and Multi-modal: A Focused Integration Framework for Multi-modal Image Fusion

Dif-Fusion: Toward High Color Fidelity in Infrared and Visible Image Fusion With Diffusion Models

Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models

Exploit the Best of Both End-to-End and Map-Based Methods for Multi-Focus Image Fusion

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Fractal Dimension-Based Multi-Focus Image Fusion via Coupled Neural P Systems in NSCT Domain

EDMF: A New Benchmark for Multi-Focus Images with the Challenge of Exposure Difference

DDRF: Denoising Diffusion Model for Remote Sensing Image Fusion