Abstract:The inherent challenge of image fusion lies in capturing the correlation of multi-source images and comprehensively integrating effective information from different sources. Most existing techniques fail to perform dynamic image fusion while notably lacking theoretical guarantees, leading to potential deployment risks in this field. Is it possible to conduct dynamic image fusion with a clear theoretical justification? In this paper, we give our solution from a generalization perspective. We proceed to reveal the generalized form of image fusion and derive a new test-time dynamic image fusion paradigm. It provably reduces the upper bound of generalization error. Specifically, we decompose the fused image into multiple components corresponding to its source data. The decomposed components represent the effective information from the source data, thus the gap between them reflects the Relative Dominability (RD) of the uni-source data in constructing the fusion image. Theoretically, we prove that the key to reducing generalization error hinges on the negative correlation between the RD-based fusion weight and the uni-source reconstruction loss. Intuitively, RD dynamically highlights the dominant regions of each source and can be naturally converted to the corresponding fusion weight, achieving robust results. Extensive experiments and discussions with in-depth analysis on multiple benchmarks confirm our findings and superiority. Our code is available at <a class="link-external link-https" href="https://github.com/Yinan-Xia/TTD" rel="external noopener nofollow">this https URL</a>.

Fast quantitative correlation analysis and information deviation analysis for evaluating the performances of image fusion techniques

Similarity-Based Objective Measure for Performance of Image Fusion

Optimal Fusion of Multi-spectral Images under Correlation Coefficient Criteria

The Study of Methods of Quantitative Evaluation on Remote Sensing Image Fusion and Actualization

The Realistic Fusion of Multi-spectral Images

The Statistical methods of Pixel-Based Image Fusion Techniques

Video fusion performance evaluation based on structural similarity and human visual perception

Test-Time Dynamic Image Fusion

Pixel Level Image Fusion Methods and Fusion Performance Evaluation

Objective image fusion evaluation method for target recognition based on target quality factor

A new method of Quickbird own image fusion

An Image Fusion Algorithm Using Spatial Consistency and Bands Correlation

An Image Fusion Method based on Multi-set Canonical Correlation Analysis

FCDFusion: a Fast, Low Color Deviation Method for Fusing Visible and Infrared Image Pairs

Comparison of quality evaluation methods for image fusion of farmland remote sensing

Selection of image fusion quality measures: objective, subjective, and metric assessment

Image Fusion Algorithm at Pixel Level Based on Edge Detection

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

Method of Fusing Dual-Spectrum Low Light Level Images Based on Gray-Scale Spatial Correlation

Two-scale decomposition-based multifocus image fusion framework combined with image morphology and fuzzy set theory

Comparison of Fuzzy and Neuro Fuzzy Image Fusion Techniques and its Applications