Abstract:Recently, infrared–visible image fusion has attracted more and more attention, and numerous excellent methods in this field have emerged. However, when the low-resolution images are being fused, most fusion results are of low resolution, limiting the practical application of the fusion results. Although some methods can simultaneously realize the fusion and super-resolution of low-resolution images, the improvement of fusion performance is limited due to the lack of guidance of high-resolution fusion results. To address this issue, we propose a heterogeneous knowledge distillation network (HKDnet) with multilayer attention embedding to jointly implement the fusion and super-resolution of infrared and visible images. Precisely, the proposed method consists of a high-resolution image fusion network (teacher network) and a low-resolution image fusion and super-resolution network (student network). The teacher network mainly fuses the high-resolution input images and guides the student network to obtain the ability of joint implementation of fusion and super-resolution. In order to make the student network pay more attention to the texture details of the visible input image, we designed a corner embedding attention mechanism. The mechanism integrates channel attention, position attention, and corner attention to highlight the visible image’s edge, texture, and structure. For the input infrared image, the dual-frequency attention (DFA) is constructed by mining the relationship of interlayer features to highlight the role of salient targets of the infrared image in the fusion result. The experimental results show that compared with the existing methods, the proposed method preserves the image information of both visible and infrared modalities, achieves sound visual effects, and displays accurate and natural texture details. The code of the proposed method can be available at https://github.com/firewaterfire/HKDnet.

SCAKD: a knowledge distillation framework based on spatial-corner attention for infrared and visible image fusion

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Lightweight Infrared and Visible Image Fusion via Adaptive DenseNet with Knowledge Distillation

Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution

Distillation-fusion-semantic unified driven network for infrared and visible image fusion

Infrared-visible Image Fusion Using Accelerated Convergent Convolutional Dictionary Learning

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

SADFusion: A multi-scale infrared and visible image fusion method based on salient-aware and domain-specific

CSAKD: Knowledge Distillation with Cross Self-Attention for Hyperspectral and Multispectral Image Fusion

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization

SFDFusion: An Efficient Spatial-Frequency Domain Fusion Network for Infrared and Visible Image Fusion

Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning

A Novel Teacher–Student Framework With Degradation Model for Infrared–Visible Image Fusion

Infrared and visible image fusion based on domain transform filtering and sparse representation

SCFusion: Infrared and Visible Fusion Based on Salient Compensation

ASFusion: Adaptive visual enhancement and structural patch decomposition for infrared and visible image fusion

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Multi-scale attention-based lightweight network with dilated convolutions for infrared and visible image fusion

Multi-scale Convolutional Neural Networks and Saliency Weight Maps for Infrared and Visible Image Fusion

An image fusion algorithm based on image clustering theory