Abstract:Single image super-resolution (SISR) aims to reconstruct a high-resolution image from a single low-resolution (LR) image. Although convolutional neural network (CNN)-based SISR methods greatly enhance image restoration, they face critical challenges. First, SISR models using CNNs process image patches uniformly regardless of importance, causing spatial inefficiency in computation and representation. However, due to resource constraints, edge devices in the Internet of Things (IoT) cannot bear heavy computations or large memory storage. Second, most of the existing SISR methods are designed only for the widely adopted bicubic degradation and cannot handle LR images with arbitrary blur kernels, resulting in poor recovery performance. To address these issues, in this paper we propose a two-stage semantic and spatial deep super-resolution (SSDSR) model suitable for the IoT environment. The proposed SSDSR model is capable of handling a variety of blur kernels (e.g., isotropic Gaussian, motion and disk blur) by effectively using their prior information. Moreover, the Semantic Feature Extraction (SFE) module enables the proposed model to focus on key areas of LR images rather than treating all pixels equally, which significantly reduces the computational load. The semantic information from the SFE module and the spatial information from the Spatial Attention module are fused adaptively, allowing the proposed model to extract key information in LR images, thereby increasing the representation capacity of the CNN and improving image recovery. Compared with state-of-the-art SISR methods on benchmark datasets, the proposed SSDSR model demonstrates superior performance. When run in real time on an IoT edge device, our model exhibits high computational efficiency and excellent image quality.

Revisiting Single Image Super-Resolution Under Internet Environment: Blur Kernels and Reconstruction Algorithms

Epistemic-Uncertainty-Based Divide-and-Conquer Network for Single-Image Super-Resolution

Self-Similarity Superresolution for Resource-Constrained Image Sensor Node in Wireless Sensor Networks

Blind Super-Resolution on Remote Sensing Images with Blur Kernel Prediction.

ESKN: Enhanced Selective Kernel Network for Single Image Super-Resolution

Blind Super-Resolution With Iterative Kernel Correction

The Improved Deep Plug-and-play Super-Resolution with Residual-in-residual Dense Block for Arbitrary Blur Kernels

Non-local degradation modeling for spatially adaptive single image super-resolution

Two-Stage Deep Single Image Super-Resolution with Multiple Blur Kernels for the Internet of Things

Fast and Accurate Single Image Super-Resolution Via an Energy-Aware Improved Deep Residual Network.

A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

A blind image super-resolution network guided by kernel estimation and structural prior knowledge

Single-Image Super-Resolution Via an Iterative Reproducing Kernel Hilbert Space Method.

Single-Image Super-Resolution via an Iterative Reproducing Kernel Hilbert Space Method

Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels

Dynamic Selection of Proper Kernels for Image Deblurring: a Multistrategy Design.

Iterative Network for Image Super-Resolution

A Closed-Loop Network for Single Infrared Remote Sensing Image Super-Resolution in Real World

Better "CMOS" Produces Clearer Images: Learning Space-Variant Blur Estimation for Blind Image Super-Resolution

Spatial and Channel Aggregation Network for Lightweight Image Super-Resolution

An Attention-Based Approach for Single Image Super Resolution.