Infrared Image Super-Resolution via Lightweight Information Split Network

Shijie Liu,Kang Yan,Feiwei Qin,Changmiao Wang,Ruiquan Ge,Kai Zhang,Jie Huang,Yong Peng,Jin Cao

2024-05-27

Abstract:Single image super-resolution (SR) is an established pixel-level vision task aimed at reconstructing a high-resolution image from its degraded low-resolution counterpart. Despite the notable advancements achieved by leveraging deep neural networks for SR, most existing deep learning architectures feature an extensive number of layers, leading to high computational complexity and substantial memory demands. These issues become particularly pronounced in the context of infrared image SR, where infrared devices often have stringent storage and computational constraints. To mitigate these challenges, we introduce a novel, efficient, and precise single infrared image SR model, termed the Lightweight Information Split Network (LISN). The LISN comprises four main components: shallow feature extraction, deep feature extraction, dense feature fusion, and high-resolution infrared image reconstruction. A key innovation within this model is the introduction of the Lightweight Information Split Block (LISB) for deep feature extraction. The LISB employs a sequential process to extract hierarchical features, which are then aggregated based on the relevance of the features under consideration. By integrating channel splitting and shift operations, the LISB successfully strikes an optimal balance between enhanced SR performance and a lightweight framework. Comprehensive experimental evaluations reveal that the proposed LISN achieves superior performance over contemporary state-of-the-art methods in terms of both SR quality and model complexity, affirming its efficacy for practical deployment in resource-constrained infrared imaging applications.

Image and Video Processing,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper focuses on infrared image super-resolution reconstruction, which restores high-resolution images from low-resolution infrared images. Although current deep learning methods have made significant progress in super-resolution tasks, they are often deep, complex, computationally expensive, and have high memory requirements. To address these issues, the paper proposes a Lightweight Information Split Network (LISN). LISN consists of four main parts: shallow feature extraction, deep feature extraction, dense feature fusion, and high-resolution infrared image reconstruction. The key innovation is the Lightweight Information Split Block (LISB), which uses sequential processes to extract hierarchical features and aggregates based on feature correlations, combining channel segmentation and shift operations to improve super-resolution performance while maintaining a lightweight framework.

LISN has been experimentally verified to demonstrate its superiority in infrared image super-resolution. Compared to the state-of-the-art methods, it has improvements in both image quality and model complexity, making it particularly suitable for resource-limited infrared imaging applications. The paper also discusses related work, including visible light image super-resolution, efficient super-resolution, Transformer-based super-resolution, and single infrared image super-resolution. Finally, the authors introduce the network architecture and key modules of LISN, such as the information split block, residual depth convolution block, and contrast-aware channel attention, and demonstrate experimental results to prove the effectiveness of LISN.