Abstract:Recently, deep learning technique has been widely employed to deal with face super-resolution (FSR) problem. It aims to predict the nonlinear relationship between the low-resolution (LR) face images and corresponding high-resolution (HR) ones, which could recover the high-frequency details from the LR degraded textures. However, either CNN-based or Transformer-based approaches mostly enhance the details by exploiting the relationship of local pixels or patches on LR features, the nonlocal features are not fully taken into account for producing high-frequency textures. To improve the above problem, we design a novel dual-branch module which consists of Transformer and CNN respectively. The Transformer branch extracts multiple scale feature embeddings and explores local and nonlocal self-attention simultaneously. Thus, the parallel self-attention mechanism has superior capabilities to capture the local and nonlocal dependencies on face image in the face reconstruction. Furthermore, the traditional CNNs usually extract features by combining pixels in a local convolutional kernel, it may be not effective to recover lost high-frequency details since the variations of local pixels are not well measured, which is important in recovering vivid edges and contours. To this end, we propose the local variation based attention block on the CNN branch, which could enhance the capabilities by directly extracting features from the variation of neighboring pixels. Finally, the Transformer-branch and CNN-branch are combined together by the modulation block to fuse both nonlocal and local advantages from two branches. Experimental results demonstrate the effectiveness of the proposed method when compared with state-of-the-art approaches. The source code is available https://github.com/jingang-cv/DBTC.

Super-Resolution Algorithm Based on Transformer+CNN

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

A Novel Convolutional Neural Network Architecture for Image Super-Resolution Based on Channels Combination

Image Super-Resolution Using Hybrid Attention Mechanism

Single Image Super-Resolution Using a Polymorphic Parallel CNN

Attention-guided hybrid transformer-convolutional neural network for underwater image super-resolution

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary

Transforming Image Super-Resolution: A ConvFormer-based Efficient Approach

Exploiting Multi-scale Parallel Self-attention and Local Variation via Dual-branch Transformer-CNN Structure for Face Super-resolution

Channel-Wise and Spatial Feature Modulation Network for Single Image Super-Resolution

PCCFormer: Parallel coupled convolutional transformer for image super-resolution

Efficient Transformer for Single Image Super-Resolution.

HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution

Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution

DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image

Transformer-based image super-resolution and its lightweight

Image Super-Resolution Using Deep Convolutional Networks

Partial Large Kernel CNNs for Efficient Super-Resolution