Abstract:The use of deep convolutional neural networks has significantly improved the performance of super-resolution. Employing deeper networks to enhance the non-linear mapping capability from low-resolution (LR) to high-resolution (HR) images has inadvertently weakened the information flow and disrupted long-term memory. Moreover, overly deep networks are challenging to train, thus failing to exhibit the expressive capability commensurate with their depth. High-frequency and low-frequency features in images play different roles in image super-resolution. Networks based on CNNs, which should focus more on high-frequency features, treat these two types of features equally. This results in redundant computations when processing low-frequency features and causes complex and detailed parts of the reconstructed images to appear as smooth as the background. To maintain long-term memory and focus more on the restoration of image details in networks with strong representational capabilities, we propose the Frequency-Separated Attention Network (FSANet), where dense connections ensure the full utilization of multi-level features. In the Feature Extraction Module (FEM), the use of the Res ASPP Module expands the network’s receptive field without increasing its depth. To differentiate between high-frequency and low-frequency features within the network, we introduce the Feature-Separated Attention Block (FSAB). Furthermore, to enhance the quality of the restored images using heuristic features, we incorporate attention mechanisms into the Low-Frequency Attention Block (LFAB) and the High-Frequency Attention Block (HFAB) for processing low-frequency and high-frequency features, respectively. The proposed network outperforms the current state-of-the-art methods in tests on benchmark datasets.

A Face Structure Attention Network for Face Super-Resolution

Face Super-Resolution Via Progressive-Scale Boosting Network

Residual Attribute Attention Network for Face Image Super-Resolution.

Multi-Scale Feature Fusion and Structure-Preserving Network for Face Super-Resolution

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

SAAN: Semantic Attention Adaptation Network for Face Super-Resolution

Facial mask attention network for identity-aware face super-resolution

Frequency-Separated Attention Network for Image Super-Resolution

Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors

The face image super-resolution algorithm based on combined representation learning

SANet: Face Super-Resolution Based on Self-Similarity Prior and Attention Integration

SCTANet: A Spatial Attention-Guided CNN-Transformer Aggregation Network for Deep Face Image Super-Resolution

W-Net: A Facial Feature-Guided Face Super-Resolution Network

Learning Face Image Super-Resolution Through Facial Semantic Attribute Transformation and Self-Attentive Structure Enhancement

Multi-level landmark-guided deep network for face super-resolution

Face Super-Resolution Via Triple-Attention Feature Fusion Network

Attention-Driven Graph Neural Network for Deep Face Super-Resolution

An efficient and lightweight image super-resolution with feature network

Structure Prior-Aware Dynamic Network for Face Super-Resolution

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

A Composite Network Model for Face Super-Resolution with Multi-Order Head Attention Facial Priors