Abstract:Recently, infrared–visible image fusion has attracted more and more attention, and numerous excellent methods in this field have emerged. However, when the low-resolution images are being fused, most fusion results are of low resolution, limiting the practical application of the fusion results. Although some methods can simultaneously realize the fusion and super-resolution of low-resolution images, the improvement of fusion performance is limited due to the lack of guidance of high-resolution fusion results. To address this issue, we propose a heterogeneous knowledge distillation network (HKDnet) with multilayer attention embedding to jointly implement the fusion and super-resolution of infrared and visible images. Precisely, the proposed method consists of a high-resolution image fusion network (teacher network) and a low-resolution image fusion and super-resolution network (student network). The teacher network mainly fuses the high-resolution input images and guides the student network to obtain the ability of joint implementation of fusion and super-resolution. In order to make the student network pay more attention to the texture details of the visible input image, we designed a corner embedding attention mechanism. The mechanism integrates channel attention, position attention, and corner attention to highlight the visible image’s edge, texture, and structure. For the input infrared image, the dual-frequency attention (DFA) is constructed by mining the relationship of interlayer features to highlight the role of salient targets of the infrared image in the fusion result. The experimental results show that compared with the existing methods, the proposed method preserves the image information of both visible and infrared modalities, achieves sound visual effects, and displays accurate and natural texture details. The code of the proposed method can be available at https://github.com/firewaterfire/HKDnet.

MSADRCN: meta-learning based joint super-resolution fusion of infrared and visible images

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion

Semantic-Aware Fusion Network Based on Super-Resolution

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

Multi-Source Deep Residual Fusion Network for Depth Image Super-resolution

CMRFusion: A cross-domain multi-resolution fusion method for infrared and visible image fusion

A Multi-Stage Visible and Infrared Image Fusion Network Based on Attention Mechanism

An infrared and visible image fusion network based on multi‐scale feature cascades and non‐local attention

SADFusion: A multi-scale infrared and visible image fusion method based on salient-aware and domain-specific

MSCS: Multi-stage Feature Learning with Channel-Spatial Attention Mechanism for Infrared and Visible Image Fusion

Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution

Interactive residual coordinate attention and contrastive learning for infrared and visible image fusion in triple frequency bands

MSFNet: MultiStage Fusion Network for infrared and visible image fusion

Advancing infrared and visible image fusion with an enhanced multiscale encoder and attention-based networks

An end-to-end multi-scale network based on autoencoder for infrared and visible image fusion

IR-MSDNet: Infrared and Visible Image Fusion Based On Infrared Features and Multiscale Dense Network

Unsupervised end-to-end infrared and visible image fusion network using learnable fusion strategy

Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution