Abstract:The essence of the Single Image Super Resolution (SISR) task revolves around learning and memorizing the mapping relationship between low-resolution and high-resolution images. Presently, prevailing SISR methods predominantly depend on simplistic long-range connections and intricate dense connections to establish long-term memory within the network. However, a notable limitation is the absence of a transitioning mechanism from short-term to long-term memory, impeding the smooth transfer of information. The intermediate-term memory mechanism assumes a critical role in the human memory system, acting as a vital bridge between short-term and long-term memory. Its ability to integrate fragmented neuronal information through specific intermediate-term connectivity patterns facilitates the formation of long-term memory. Inspired by this mechanism, we propose a deep feature extraction and fusion method based on intermediate-term connectivity, addressing the challenges associated with smooth information transfer between short-term and long-term memory. In this study, we introduce IMSR (Intermediate-term Memory Super Resolution), a lightweight model that efficiently aggregates features from different temporal and spatial levels within the network. By doing so, IMSR enhances the representation of both global and local information, contributing to improved performance. Additionally, we incorporate the Reconstructive Attention Mechanism (RAM) at the end of IMSR, allowing for precise tuning and fine-grained control of features to facilitate the integration of complementary information. Through extensive experimental evaluations, we demonstrate that IMSR surpasses other state-of-the-art lightweight models across four benchmark datasets, while maintaining a low parameter count and computational complexity.

Image Super-Resolution Using Memory Mechanism

Intermediate-term memory mechanism inspired lightweight single image super resolution

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

An Image Super-Resolution Method For Better Cognition Of Images In Cognition Computing System

MemSR: Training Memory-efficient Lightweight Model for Image Super-Resolution.

Discovering Distinctive "Semantics" in Super-Resolution Networks

Image Super-Resolution Network Based on a Multi-Branch Attention Mechanism

High Quality Remote Sensing Image Super-Resolution Using Deep Memory Connected Network

Persistent Memory Residual Network for Single Image Super Resolution

Stereoscopic Image Super-Resolution with Interactive Memory Learning

Learning Face Image Super-Resolution Through Facial Semantic Attribute Transformation and Self-Attentive Structure Enhancement

Image Super-Resolution Using Hybrid Attention Mechanism

Efficient Image Super-Resolution Integration

Deep Learning for Image Super-Resolution: A Survey

A review of single image super-resolution reconstruction based on deep learning

Fluid Micelle Network for Image Super-Resolution Reconstruction

Studies Advanced in Image Super-resolution Reconstruction based on Deep Learning

Structure-Preserving Image Super-resolution Via Contextualized Multi-task Learning.

Image Super-Resolution Reconstruction Using Generative Adversarial Networks Based on Wide-Channel Activation

Multi-scale Single Image Super-Resolution with Remote-Sensing Application Using Transferred Wide Residual Network

Unsupervised domain adaptation semantic segmentation of high-resolution remote sensing imagery with invariant domain-level prototype memory