Infrared and visible light dual-camera super-resolution imaging with texture transfer network

Yubin Wu,Lianglun Cheng,Tao Wang,Heng Wu
DOI: https://doi.org/10.1016/j.image.2022.116825
2022-10-01
Abstract:As low-resolution (LR) images often miss a large amount of feature information, the super-resolution (SR) algorithm that directly maps and reconstructs a single LR infrared image faces a considerable challenge due to the lack of prior features. We propose an infrared and visible light dual-camera SR imaging scheme based on a visible light texture transfer (VTTISR) method, which fills in the missing feature information of LR infrared images by transforming visible light texture features. The proposed VTTISR method consists of a multi-scale texture progressive transfer network and a cross-scale residual aggregation reconstruction network. The multi-scale texture progressive transfer network migrates visible light texture features to infrared features to generate multi-scale texture transfer features. The cross-scale residual aggregation reconstruction network sequentially fuses texture features at corresponding scales and generates 4-magnification SR infrared image. Experimental results show that VTTISR has made significant progress in quantitative image evaluation with higher efficiency.
engineering, electrical & electronic
What problem does this paper attempt to address?