Abstract:Existing multi-focus image fusion (MFIF) methods are difficult to achieve satisfactory results in both fusion performance and rate simultaneously. The spatial domain methods are hard to determine the focus/defocus boundary (FDB), and the transform domain methods are likely to damage the content information of the source images. Moreover, the deep learning-based MFIF methods are usually confronted with low rate due to complex models and enormous learnable parameters. To address these issues, we propose a multi-domain lightweight network (MLNet) for MFIF, which can achieve competitive results in both performance and rate. The proposed MLNet mainly includes three modules, namely focus extraction (FE), focus measure (FM) and image fusion (IF). In the interpretable FE module, the image features extracted by discrete cosine transform-based convolution (DCTConv) and local binary pattern-based convolution (LBPConv) are concatenated and fed into the FM module. DCTConv based on transform domain takes DCT coefficients to construct a fixed convolution kernel without parameter learning, which can effectively capture the high/low frequency content of the image. LBPConv based on spatial domain can achieve structure features and gradient information from source images. In the FM module, a 3-layer 1 × 1 convolution with a few learnable parameters is employed to generate the initial decision map, which has the properties of flexible input. The fused image is obtained by the IF module according to the final decision map. In terms of quantitative and qualitative evaluations, extensive experiments validate that the proposed method outperforms existing state-of-the-art methods on three public datasets. In addition, the proposed MLNet contains only 0.01 M parameters, which is 0.2% of the first CNN-based MFIF method [25].

Mcnn: Conditional Focus Probability Learning to Multi-Focus Images Via Mutually Coupled Neural Network

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

A multi-channel neural network model for multi-focus image fusion

Multi-focus Image Fusion Using PCNN

CCSR-Net: Unfolding Coupled Convolutional Sparse Representation for Multi-focus Image Fusion.

A General Memristor-Based Pulse Coupled Neural Network with Variable Linking Coefficient for Multi-Focus Image Fusion

Multi-focus Image Fusion Based on Fully Convolutional Networks.

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

Multi-scale Convolutional Neural Network for Multi-Focus Image Fusion.

Learning to Fuse Multi-Focus Image via Convolutional Network Modeling

Siamese conditional generative adversarial network for multi-focus image fusion

Non-Local Multi-Focus Image Fusion With Recurrent Neural Networks

Multi-Focus Image Fusion with a Natural Enhancement Via a Joint Multi-Level Deeply Supervised Convolutional Neural Network

Multifocus Image Fusion Using Convolutional Neural Network

A Convolutional Neural Network-Based Conditional Random Field Model for Structured Multi-Focus Image Fusion Robust to Noise

Multi-focus Image Fusion with Convolutional Neural Network Based on Dempster-Shafer Theory

Improving Multi-Focus Image Fusion Through Noisy Image and Feature Difference Network

A multi-focus image fusion network with local-global joint attention module

Multi-focus images fusion via residual generative adversarial network

MLNet: A Multi-Domain Lightweight Network for Multi-Focus Image Fusion

A fuzzy convolutional neural network for enhancing multi-focus image fusion