Abstract:In this study, we present new deep learning (DL) method for fusing multi-focus images. Current multi-focus image fusion (MFIF) approaches based on DL methods mainly treat MFIF as a classification task. These methods use a convolutional neural network (CNN) as a classifier to identify pixels as focused or defocused pixels. However, due to unavailability of labeled data to train networks, existing DL-based supervised models for MFIF add Gaussian blur in focused images to produce training data. DL-based unsupervised models are also too simple and only applicable to perform fusion tasks other than MFIF. To address the above issues, we proposed a new MFIF method, which aims to learn feature extraction, fusion and reconstruction components together to produce a complete unsupervised end-to-end trainable deep CNN. To enhance the feature extraction capability of CNN, we introduce a Siamese multi-scale feature extraction module to achieve a promising performance. In our proposed network we applied multiscale convolutions along with skip connections to extract more useful common features from a multi-focus image pair. Instead of using basic loss functions to train the CNN, our model utilizes structure similarity (SSIM) measure as a training loss function. Moreover, the fused images are reconstructed in a multiscale manner to guarantee more accurate restoration of images. Our proposed model can process images with variable size during testing and validation. Experimental results on various test images validate that our proposed method yields better quality fused images that are superior to the fused images generated by compared state-of-the-art image fusion methods.

Defocus Deblur Microscopy via Head-to-Tail Cross-scale Fusion

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learning

DeFusionNET: Defocus Blur Detection via Recurrently Fusing and Refining Discriminative Multi-Scale Deep Features

Defusionnet: Defocus Blur Detection Via Recurrently Fusing And Refining Multi-Scale Deep Features

Multiscale Feature Interactive Network for Multifocus Image Fusion

A Multi-Focus Image Fusion Network Combining Dilated Convolution with Learnable Spacings and Residual Dense Network

A Hybrid Supervised Fusion Deep Learning Framework for Microscope Multi-Focus Images.

Defocus Deblurring: a Designed Deep Model Based on CNN

An Α-Matte Boundary Defocus Model Based Cascaded Network for Multi-focus Image Fusion

Multi-scale Convolutional Neural Network for Multi-Focus Image Fusion.

Decoupling Image Deblurring Into Twofold: A Hierarchical Model for Defocus Deblurring

Digital Pathology Image Deblurring Via Local Focus Quality Assessment

Multi-scale Feature Fusion Network for Blind Deblurring

Defocus blur detection via adaptive cross-level feature fusion and refinement

A Deep-Learning-based Workflow to Deal with the Defocusing Problem in High-Throughput Experiments

Improved Image Fusion Method Based on Sparse Decomposition

SFFTNet: Sparse Feature Fusion Transformer Network for Image Deblurring

Super-Resolution and Large Depth of Field Model for Optical Microscope Imaging

MCRD-Net: an Unsupervised Dense Network with Multi-Scale Convolutional Block Attention for Multi-Focus Image Fusion

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network