Abstract:Although the convolution neural network (CNN) and transformer methods have greatly promoted the development of image super-resolution, these two methods have their disadvantages. Making a trade-off between the two methods and effectively integrating their advantages can restore high-frequency information of images with fewer parameters and higher quality. Hence, in this study, a novel dual parallel fusion structure of distilled feature pyramid and serial CNN and transformer (PFDFCT) model is proposed. In one branch, a lightweight serial structure of CNN and transformer is implemented to guarantee the richness of the global features extracted by transformer. In the other branch, an efficient distillation feature pyramid hybrid attention module is designed to efficiently purify the local features extracted by CNN and maintain integrity through cross-fusion. Such a multi-path parallel fusion strategy can ensure the richness and accuracy of features while avoiding the use of complex and long-range structures. The results show that the PFDFCT can reduce the mis-generated stripes and make the reconstructed image clearer for both easy-to-reconstruct and difficult-to-reconstruct targets compared to other advanced methods. Additionally, PFDFCT achieves a remarkable advance in model size and computational cost. Compared to the state-of-the-art (SOTA) model (i.e., efficient long-range attention network) in 2022, PFDFCT reduces parameters and floating point of operations (FLOPs) by more than 20% and 26% under all three scales, while maintaining a similar advanced reconstruction ability. The FLOPs of PFDFCT are as low as 31.8G, 55.3G, and 122.5G under scales of 2, 3 and 4, which are much lower than most current SOTA methods.

Attention-guided hybrid transformer-convolutional neural network for underwater image super-resolution

Learning hybrid dynamic transformers for underwater image super-resolution

Underwater Image Enhancement via Adaptive Group Attention-Based Multiscale Cascade Transformer

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

Unformer: A Transformer-Based Approach for Adaptive Multi-Scale Feature Aggregation in Underwater Image Enhancement

Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

An effective transformer based on dual attention fusion for underwater image enhancement

Hybrid CNN-Transformer Network for Two-Stage Underwater Image Enhancement with Contrastive Learning

Enhancement of Underwater Images through Parallel Fusion of Transformer and CNN

HCT: Hybrid CNN-Transformer Networks for Super-Resolution

A Lightweight Distillation CNN-transformer Architecture for Remote Sensing Image Super-Resolution

RT-CBAM: Refined Transformer Combined with Convolutional Block Attention Module for Underwater Image Restoration

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

An efficient parallel fusion structure of distilled and transformer-enhanced modules for lightweight image super-resolution

Multi-scale dense spatially-adaptive residual distillation network for lightweight underwater image super-resolution

WaterFormer: A Global–Local Transformer for Underwater Image Enhancement With Environment Adaptor

Underwater-image super-resolution via range-dependency learning of multiscale features

Channel and Spatial Transformer for Underwater Image Enhancement

Underwater Image Enhancement Via Cross-Wise Transformer Network Focusing on Pre-Post Differences

Super-Resolution Algorithm Based on Transformer+CNN

Underwater Image High Definition Display Using the Multilayer Perceptron and Color Feature-Based SRCNN