Abstract:As is well known, activity level measurement and fusion rule are two crucial factors in image fusion. For most existing fusion methods, either in spatial domain or in a transform domain like wavelet, the activity level measurement is essentially implemented by designing local filters to extract high-frequency details, and the calculated clarity information of different source images are then compared using some elaborately designed rules to obtain a clarity/focus map. Consequently, the focus map contains the integrated clarity information, which is of great significance to various image fusion issues, such as multi-focus image fusion, multi-modal image fusion, etc. However, in order to achieve a satisfactory fusion performance, these two tasks are usually difficult to finish. In this study, we address this problem with a deep learning approach, aiming to learn a direct mapping between source images and focus map. To this end, a deep convolutional neural network (CNN) trained by high-quality image patches and their blurred versions is adopted to encode the mapping. The main novelty of this idea is that the activity level measurement and fusion rule can be jointly generated through learning a CNN model, which overcomes the difficulty faced by the existing fusion methods. Based on the above idea, a new multi-focus image fusion method is primarily proposed in this paper. Experimental results demonstrate that the proposed method can obtain state-of-the-art fusion performance in terms of both visual quality and objective assessment. The computational speed of the proposed method using parallel computing is fast enough for practical usage. The potential of the learned CNN model for some other-type image fusion issues is also briefly exhibited in the experiments.

An Adaptive Fusion Feature Extraction Algorithm Based on CNN.

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

A data-driven study of image feature extraction and fusion

Adaptive feature fusion for visual object tracking

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network

Adaptive weights learning in CNN feature fusion for crime scene investigation image classification

Adaptive multi-feature fusion via cross-entropy normalization for effective image retrieval

DIAFNet: A Dynamic Interactive Adaptive Fusion Network Based on Enhanced Differential Features

An Adaptive Multilayer Feature Fusion Strategy for Remote Sensing Scene Classification

Combining transformers with CNN for multi-focus image fusion

AFCANet: An adaptive feature concatenate attention network for multi-focus image fusion

The Facial Expression Recognition Method Based on Image Fusion and CNN

Multi-focus image fusion with a deep convolutional neural network

Adaptive Enhancement Algorithm of High-Resolution Satellite Image Based on Feature Fusion

AFpoint: adaptively fusing local and global features for point cloud

Selective Feature Connection Mechanism: Concatenating Multi-layer CNN Features with a Feature Selector

Adjacent-level Feature Cross-Fusion with 3D CNN for Remote Sensing Image Change Detection.

Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution

Attentive feature integration network for detecting salient objects in images

Image enhancement with art design: a visual feature approach with a CNN-transformer fusion model