Abstract:Existing image fusion methods primarily focus on solving single -task fusion problems, overlooking the potential information complementarity among multiple fusion tasks. Additionally, there has been no prior research in the field of image fusion that explores the mixed training of labeled and unlabeled data for different fusion tasks. To address these gaps, this paper introduces a novel multi -task semi-supervised learning approach to construct a general image fusion framework. This framework not only facilitates collaborative training for multiple fusion tasks, thereby achieving effective information complementarity among datasets from different fusion tasks, but also promotes the (unsupervised) learning of unlabeled data via the (supervised) learning of labeled data. Regarding the specific network module, we propose a so-called pseudo-siamese Laplacian pyramid transformer (PSLPT), which can effectively distinguish information at different frequencies in source images and discriminatively fuse features from distinct frequencies. More specifically, we take datasets of four typical image fusion tasks into the same PSLPT for weight updates, yielding the final general fusion model. Extensive experiments demonstrate that the obtained general fusion model exhibits promising outcomes for all four image fusion tasks, both visually and quantitatively. Moreover, comprehensive ablation and discussion experiments corroborate the effectiveness of the proposed method. The code is available at https: //github.com/wwhappylife/A-general-image-fusion-framework-using-multi-task-semi-supervised-learning.

A New Framework for Image Completion Based on Image Fusion Technology

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Fusion Algorithm of Laser-Point Clouds and Optical Images

A Multi-Modal Image Fusion Framework Based on Guided Filter and Sparse Representation

Recent Development in Image Completion Techniques

Deep Fusion Network for Image Completion

Image Fusion Method Based on Structure-Based Saliency Map and FDST-PCNN Framework.

A General Image Fusion Framework Using Multi-Task Semi-Supervised Learning

A Framework of Region-Based Dynamic Image Fusion

Conditional Controllable Image Fusion

Classification-based image-fusion framework for compressive imaging

An Adaptive Fusion Algorithm for Depth Completion

Image Fusion Based on Feature Decoupling and Proportion Preserving.

Combine Early and Late Fusion Together: A Hybrid Fusion Framework for Image-Text Matching

An image fusion algorithm based on image clustering theory

Region-Based Image-Fusion Framework for Compressive Imaging

Comprehensive Framework of Early and Late Fusion for Image-Sentence Retrieval

A Method to Improve the Image Enhancement Result Based on Image Fusion

Two-scale decomposition-based multifocus image fusion framework combined with image morphology and fuzzy set theory

CHFusion: A Cross-modality High-resolution Representation Framework for Infrared and Visible Image Fusion

DMF-Net: Image-Guided Point Cloud Completion with Dual-Channel Modality Fusion and Shape-Aware Upsampling Transformer