Abstract:The single-image super-resolution (SISR) network based on deep learning is dedicated to learning the mapping between low-resolution (LR) images and high-resolution (HR) images. The optimal parameters of these networks often require extensive training on large-scale external image databases. For medical magnetic resonance (MR) images, there is a lack of large data sets containing high-quality images. Some deep networks that perform well on natural images cannot be fully trained on MR images, which limits the super-resolution (SR) performance. In traditional methods, the non-local self-similarity has been verified as useful statistical prior information for image restoration. The inherent feature correlation not only exists between pixels, but some patches also tend to be repeated at different positions within and across scales of MR images. Therefore, in this paper, we propose a mixed self-similarity attention network (MSAN) to explore the long-range dependencies of different regions fully. In the feature map of the entire input MR image, the prior information of self-similarity is divided into two scales: point-similarity and patch-similarity. We use points and patches that are highly similar to the current area to restore a more detailed structural texture. The internal correlation items can be used as an essential supplement to the limited external training dataset. Besides, the large number of less informative background in MR images will interfere with practical self-similarity information. A dual attention mechanism combining first-order attention and second-order attention gives more weight to salient features and suppresses the activation of useless features. Comprehensive experiments demonstrate that the proposed achieves significantly superior results on MR images SR while outperforming state-of-the-art methods by a large margin quantitatively and visually.

Single-image Super-Resolution with Multilevel Residual Attention Network

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Deep Residual-Dense Attention Network for Image Super-Resolution.

Wide Weighted Attention Multi-Scale Network for Accurate MR Image Super-Resolution

Image Super-Resolution Using Very Deep Residual Channel Attention Networks

Image Super-Resolution Via Residual Block Attention Networks.

Single MR Image Super-Resolution Via Mixed Self-Similarity Attention Network

Image super-resolution based on residually dense distilled attention network q

Multilevel Feature Exploration Network for Image Superresolution

Enhanced Context Attention Network for Image Super Resolution

Multi-scale attention network for image super-resolution

MLWAN: Multi-Scale Learning Wavelet Attention Module Network for Image Super Resolution

MR Image Super-Resolution via Wide Residual Networks With Fixed Skip Connection

Lightweight multi-scale residual networks with attention for image super-resolution

MRDN: A lightweight Multi-stage residual distillation network for image Super-Resolution

A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm

Multiscale Residual Dense Network for the Super-Resolution of Remote Sensing Images

Single image super-resolution based on trainable feature matching attention network

Super-resolution Reconstruction of MR Image with a Novel Residual Learning Network Algorithm

Hybrid Residual Attention Network for Single Image Super Resolution