Abstract:Although the convolution neural network (CNN) and transformer methods have greatly promoted the development of image super-resolution, these two methods have their disadvantages. Making a trade-off between the two methods and effectively integrating their advantages can restore high-frequency information of images with fewer parameters and higher quality. Hence, in this study, a novel dual parallel fusion structure of distilled feature pyramid and serial CNN and transformer (PFDFCT) model is proposed. In one branch, a lightweight serial structure of CNN and transformer is implemented to guarantee the richness of the global features extracted by transformer. In the other branch, an efficient distillation feature pyramid hybrid attention module is designed to efficiently purify the local features extracted by CNN and maintain integrity through cross-fusion. Such a multi-path parallel fusion strategy can ensure the richness and accuracy of features while avoiding the use of complex and long-range structures. The results show that the PFDFCT can reduce the mis-generated stripes and make the reconstructed image clearer for both easy-to-reconstruct and difficult-to-reconstruct targets compared to other advanced methods. Additionally, PFDFCT achieves a remarkable advance in model size and computational cost. Compared to the state-of-the-art (SOTA) model (i.e., efficient long-range attention network) in 2022, PFDFCT reduces parameters and floating point of operations (FLOPs) by more than 20% and 26% under all three scales, while maintaining a similar advanced reconstruction ability. The FLOPs of PFDFCT are as low as 31.8G, 55.3G, and 122.5G under scales of 2, 3 and 4, which are much lower than most current SOTA methods.

Enhancing single-pixel imaging reconstruction using hybrid transformer network with adaptive feature refinement

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Dual-Scale Transformer for Large-Scale Single-Pixel Imaging

Local-enhanced transformer for single-pixel imaging

High fidelity single-pixel imaging

Adaptive Super-Resolution Networks for Single-Pixel Imaging at Ultra-Low Sampling Rates

Scalable High-Resolution Single-Pixel Imaging via Pattern Reshaping

Enhancing structural illumination microscopy with hybrid CNN-transformer and dynamic frequency loss

Feature Single-Pixel Imaging: What You See is What You Want

Single pixel imaging via unsupervised deep compressive sensing with collaborative sparsity in discretized feature space

Cross-Spatial Pixel Integration and Cross-Stage Feature Fusion Based Transformer Network for Remote Sensing Image Super-Resolution

A pyramid transformer with cross-shaped windows for low-light image enhancement

Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition

Enhancing Compressive Single-Pixel Imaging With Zig-Zag-Ordered Walsh-Hadamard Light Modulation

PSCAT: a lightweight transformer for simultaneous denoising and super-resolution of OCT images

Low Light RAW Image Enhancement Using Paired Fast Fourier Convolution and Transformer

Deep-learning-based Single-Photon-counting Compressive Imaging Via Jointly Trained Subpixel Convolution Sampling.

PROMISE : Parallel Reconstruction with Optimized acquisition for Multi-contrast Imaging in the context of compressed Sensing

Single-pixel imaging based on deep learning

An efficient parallel fusion structure of distilled and transformer-enhanced modules for lightweight image super-resolution

Pixel super-resolved lensless on-chip sensor with scattering multiplexing