Abstract:Multi-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images captured by cameras produce anisotropic blur and unregistration. This paper proposes a new multi-focus image fusion method based on the multi-scale decomposition of complementary information. Firstly, this method uses two groups of large-scale and small-scale decomposition schemes that are structurally complementary, to perform two-scale double-layer singular value decomposition of the image separately and obtain low-frequency and high-frequency components. Then, the low-frequency components are fused by a rule that integrates image local energy with edge energy. The high-frequency components are fused by the parameter-adaptive pulse-coupled neural network model (PA-PCNN), and according to the feature information contained in each decomposition layer of the high-frequency components, different detailed features are selected as the external stimulus input of the PA-PCNN. Finally, according to the two-scale decomposition of the source image that is structure complementary, and the fusion of high and low frequency components, two initial decision maps with complementary information are obtained. By refining the initial decision graph, the final fusion decision map is obtained to complete the image fusion. In addition, the proposed method is compared with 10 state-of-the-art approaches to verify its effectiveness. The experimental results show that the proposed method can more accurately distinguish the focused and non-focused areas in the case of image pre-registration and unregistration, and the subjective and objective evaluation indicators are slightly better than those of the existing methods.

Suspect Multifocus Image Fusion Based on Sparse Denoising Autoencoder Neural Network for Police Multimodal Big Data Analysis

Multi-focused image fusion algorithm based on multi-scale hybrid attention residual network

Focus Affinity Perception and Super-Resolution Embedding for Multifocus Image Fusion

Multiscale Feature Interactive Network for Multifocus Image Fusion

Multi-focus image fusion with a deep convolutional neural network

A multi-focus color image fusion algorithm based on low vision image reconstruction and focused feature extraction

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Fusion-UDCGAN: Multifocus Image Fusion via a U-Type Densely Connected Generation Adversarial Network

Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary

Multi-focus Image Fusion Using Fully Convolutional Two-stream Network for Visual Sensors.

Unsupervised Image Fusion Method based on Feature Mutual Mapping

Adaptive spatial and frequency experts fusion network for medical image fusion

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

Multi-scale Convolutional Neural Network for Multi-Focus Image Fusion.

FusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

A multi‐focus image fusion network deployed in smart city target detection

Advancing infrared and visible image fusion with an enhanced multiscale encoder and attention-based networks

Adaptive weights learning in CNN feature fusion for crime scene investigation image classification

A Multi-Stage Visible and Infrared Image Fusion Network Based on Attention Mechanism