Abstract:Image super-resolution (SR) algorithms based on deep learning yield good visual performances on visible images. Due to the blurred edges and low contrast of infrared (IR) images, methods transferred directly from visible images to IR images have a poor performance and ignore the demands of downstream detection tasks. Therefore, an Inception Dilated Super-Resolution (IDSR) network with multiple branches is proposed. A dilated convolutional branch captures high-frequency information to reconstruct edge details, while a non-local operation branch captures long-range dependencies between any two positions to maintain the global structure. Furthermore, deformable convolution is utilized to fuse features extracted from different branches, enabling adaptation to targets of various shapes. To enhance the detection performance of low-resolution (LR) images, we crop the images into patches based on target labels before feeding them to the network. This allows the network to focus on learning the reconstruction of the target areas only, reducing the interference of background areas in the target areas' reconstruction. Additionally, a feature-driven module is cascaded at the end of the IDSR network to guide the high-resolution (HR) image reconstruction with feature prior information from a detection backbone. This method has been tested on the FLIR Thermal Dataset and the M3FD Dataset and compared with five mainstream SR algorithms. The final results demonstrate that our method effectively maintains image texture details. More importantly, our method achieves 80.55% mAP, outperforming other methods on FLIR Dataset detection accuracy, and with 74.7% mAP outperforms other methods on M3FD Dataset detection accuracy.

High-efficiency Infrared Image Super-Resolution Algorithm Based on a Cascaded Deep Network

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Fast and Accurate Single Image Super-Resolution Via an Energy-Aware Improved Deep Residual Network.

Single-image Super-Resolution Via Selective Multi-Scale Network

A Single Super-Resolution Method Via Deep Cascade Network

An Infrared Image Super-Resolution Imaging Algorithm Based on Auxiliary Convolution Neural Network

Super-resolution Reconstruction of Infrared Images Based on a Convolutional Neural Network with Skip Connections

Large Factor Image Super-Resolution with Cascaded Convolutional Neural Networks.

Image Super-Resolution Via a Novel Cascaded Convolutional Neural Network Framework.

Efficient local cascading residual network for real-time single image super-resolution

Iterative Network for Image Super-Resolution

Cascading and Residual Connected Network for Single Image Superresolution

Deep Convolutional Neural Network with Feature Fusion for Image Super-Resolution

Infrared Image Super-Resolution via Lightweight Information Split Network

Image Super-Resolution Via Deep Aggregation Network

Image Super-Resolution via Deep Feature Recalibration Network.

Lightweight Image Super-Resolution with Information Multi-distillation Network

A Feature-Driven Inception Dilated Network for Infrared Image Super-Resolution Reconstruction

Single Image Super Resolution Via a Refined Densely Connected Inception Network.

Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network