Abstract:Long-wave infrared (LWIR) spectral imaging plays a critical role in various applications such as gas monitoring, mineral exploration, and fire detection. Recent advancements in computational spectral imaging, powered by advanced algorithms, have enabled the acquisition of high-quality spectral images in real time, such as with the Uncooled Snapshot Infrared Spectrometer (USIRS). However, the USIRS system faces challenges, particularly a low spectral resolution and large amount of data noise, which can degrade the image quality. Deep learning has emerged as a promising solution to these challenges, as it is particularly effective at handling noisy data and has demonstrated significant success in hyperspectral imaging tasks. Nevertheless, the application of deep learning in LWIR imaging is hindered by the severe scarcity of long-wave hyperspectral image data, which limits the training of robust models. Moreover, existing networks that rely on convolutional layers or attention mechanisms struggle to effectively capture both local and global spectral correlations. To address these limitations, we propose the pixel-based Hierarchical Spectral Transformer (HST), a novel deep learning architecture that learns from publicly available single-pixel long-wave infrared spectral databases. The HST is designed to achieve a high spectral resolution for LWIR spectral image reconstruction, enhancing both the local and global contextual understanding of the spectral data. We evaluated the performance of the proposed method on both simulated and real-world LWIR data, demonstrating the robustness and effectiveness of the HST in improving the spectral resolution and mitigating noise, even with limited data.

Multi-scale Terahertz Image Reconstruction

Terahertz Image Restoration Benchmarking Dataset

A Terahertz Image Super-Resolution Reconstruction Algorithm Based on the Deep Convolutional Neural Network

Fast non-iterative blind restoration of hyperspectral images with PSFs

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Making the Invisible Visible: Toward High-Quality Terahertz Tomographic Imaging via Physics-Guided Restoration

Hybrid Multi-Head Physics-informed Neural Network for Depth Estimation in Terahertz Imaging

Spatial Domain Terahertz Image Reconstruction Based on Dual Sparsity Constraints

Terahertz Image Super-Resolution based on a Complex Network with Wavelet and Attention Mechanisms

Terahertz Spatio-Temporal Deep Learning Computed Tomography

Unsupervised Terahertz Image Restoration Based on CycleGan

High-Quality Image Compressed Sensing and Reconstruction with Multi-scale Dilated Convolutional Neural Network

Super-resolution Reconstruction for Terahertz Imaging Based on Sub-Pixel Gradient Field Transform.

THz time-domain spectral imaging enhancement based on an MLP-SRCNN composite network

Amplitude/Phase Retrieval for Terahertz Holography With Supervised and Unsupervised Physics-Informed Deep Learning

Terahertz image enhancement based on a multiscale feature extraction network

Super-resolution infrared imaging via multi-receptive field information distillation network

Terahertz 2-D Imaging Framework for Detection Based on Dual Clustering Methods.

Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer

Multi-scale dilated dense reconstruction network for limited-angle computed tomography

TSDSR: Temporal–Spatial Domain Denoise Super-Resolution Photon-Efficient 3D Reconstruction by Deep Learning