Abstract:When traditional super-resolution reconstruction methods are applied to infrared thermal images, they often ignore the problem of poor image quality caused by the imaging mechanism, which makes it difficult to obtain high-quality reconstruction results even with the training of simulated degraded inverse processes. To address these issues, we proposed a thermal infrared image super-resolution reconstruction method based on multimodal sensor fusion, aiming to enhance the resolution of thermal infrared images and rely on multimodal sensor information to reconstruct high-frequency details in the images, thereby overcoming the limitations of imaging mechanisms. First, we designed a novel super-resolution reconstruction network, which consisted of primary feature encoding, super-resolution reconstruction, and high-frequency detail fusion subnetwork, to enhance the resolution of thermal infrared images and rely on multimodal sensor information to reconstruct high-frequency details in the images, thereby overcoming limitations of imaging mechanisms. We designed hierarchical dilated distillation modules and a cross-attention transformation module to extract and transmit image features, enhancing the network's ability to express complex patterns. Then, we proposed a hybrid loss function to guide the network in extracting salient features from thermal infrared images and reference images while maintaining accurate thermal information. Finally, we proposed a learning strategy to ensure the high-quality super-resolution reconstruction performance of the network, even in the absence of reference images. Extensive experimental results show that the proposed method exhibits superior reconstruction image quality compared to other contrastive methods, demonstrating its effectiveness.

Heat Transfer-Inspired Network for Image Super-Resolution Reconstruction

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

SR-USRN: Learning Image Super-Resolution with Unified Structure and Reverse Network.

PIRN: Phase Invariant Reconstruction Network for Infrared Image Super-Resolution

Photothermal-SR-Net: A Customized Deep Unfolding Neural Network for Photothermal Super Resolution Imaging

Thermal image super-resolution via multi-path residual attention network

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

A Terahertz Image Super-Resolution Reconstruction Algorithm Based on the Deep Convolutional Neural Network

Fluid Micelle Network for Image Super-Resolution Reconstruction

A Feature-Driven Inception Dilated Network for Infrared Image Super-Resolution Reconstruction

Improved Thermal Infrared Image Super-Resolution Reconstruction Method Base on Multimodal Sensor Fusion

Infrared Image Super-Resolution Network Utilizing the Enhanced Transformer and U-Net

Super-resolution reconstruction of thermal imaging of power equipment based on Generative Adversarial Network with Channel Filtering

SPH-Net: Hyperspectral Image Super-Resolution via Smoothed Particle Hydrodynamics Modeling

Iterative Network for Image Super-Resolution

A Lightweight Image Super-Resolution Reconstruction Algorithm Based on the Residual Feature Distillation Mechanism

Research on Image Super-Resolution Reconstruction Mechanism based on Convolutional Neural Network

Hyperspectral Image Superresolution via Deep Structure and Texture Interfusion

Hyperspectral Image Super-Resolution via Intrafusion Network

Image super-resolution via dynamic network

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks