Abstract:Infrared imaging system compared with visible light imaging system, infrared imaging system can operate in all-weather conditions with high anti-interference ability and the ability to penetrate smoke and haze. The current infrared technology still has the disadvantage of low signal-to-noise ratio and lack high frequency detail information. The most direct way to improve the infrared imaging system is to improve the hardware design by increasing the size of the photoreceptor and the size of the image source, but the manufacturing process is complicated, the cost is high, and the improvement effect is limited. With the development of the field of computer vision, deep learning has become the most effective solution for super-resolution reconstruction[6]. Therefore, in this paper, a Video frame Infrared image super-resolution reconstruction method IVSR (Infrared Video super-resolution) is designed based on the deep learning method and the dual-path operation mode combining the single-frame and multi-frame super-resolution reconstruction algorithms. The innovation of IVSR net lies in that after the optical flow module extracts the inter-frame information of each frame and the current frame, the sub-pixel convolution layer of the multi-frame image fusion module can effectively utilize the sub-pixel information. IVSR can be regarded as two reconstruction processes, the first stage is the output of high-resolution information from the optical flow motion estimation module to the projection module, and the second stage integrates the high-resolution information of each projection module for fusion reconstruction. This method can effectively improve the visual effect of IVSR reconstruction, effectively solve the problem of poor reconstruction quality due to the lack of high frequency detail information. Compared with traditional reconstruction algorithms and other typical deep learning algorithms, reconstructed images of IVSR are more exquisite, with more prominent high-frequency details, no image distortion and significant advantages in objective evaluation indicators.

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanism

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

PIRN: Phase Invariant Reconstruction Network for Infrared Image Super-Resolution

Infrared Image Super-Resolution via GAN

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Infrared Image Super-Resolution Network Utilizing the Enhanced Transformer and U-Net

Research on infrared image sub-pixel super-resolution reconstruction algorithm based on deep learning

Modeling thermal infrared image degradation and real-world super-resolution under background thermal noise and streak interference

A Review of GAN-Based Super-Resolution Reconstruction for Optical Remote Sensing Images

Super-resolution reconstruction method of the optical synthetic aperture image using generative adversarial network

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

G-GANISR: Gradual generative adversarial network for image super resolution

Super-Resolution of Remote Sensing Images Based on Transferred Generative Adversarial Network

Deep learning-based super-resolution in coherent imaging systems

Super-resolution SAR Image Reconstruction Via Generative Adversarial Network

IESRGAN: Enhanced U-Net Structured Generative Adversarial Network for Remote Sensing Image Super-Resolution Reconstruction

Deep learning enhancement of infrared face images using generative adversarial networks

Superresolution reconstruction of optical remote sensing images based on a multiscale attention adversarial network

DSRGAN: Detail Prior-Assisted Perceptual Single Image Super-Resolution via Generative Adversarial Networks