Abstract:Single-image super-resolution (SISR) is an essential topic in computer vision applications. However, most CNN-based SISR approaches directly learn the relationship between low- and high-resolution images while ignoring the contextual texture and detail fidelity to explore super-resolution; thus, they hinder the representational power of CNNs and lead to the unrealistic, distorted reconstruction of edges and textures in the images. In this study, we propose a novel recurrent structure preservation mechanism with the integration and innovative use of multi-scale wavelet transform, Recurrent Multiscale Approximation-guided Network (RMANet), to recursively process the low-frequency and high-frequency sub-networks at each level separately. Unlike traditional wavelet transform, we propose a novel Approximation Level Preservation (ALP) architecture to import and learn the low-frequency sub-networks at each level. Through proposed Approximation level fusion (ALF) and inverse wavelet transform, rich image structures of low frequency at each level can be recursively restored and greatly preserved with the combination of ALP at each level. In addition, a novel low-frequency to high-frequency detail enhancement (DE) mechanism is also proposed to solve the problem of detail distortion in high-frequency networks by transmitting low-frequency information to the high-frequency network. Finally, a joint loss function is used to balance low-frequency and high-frequency information with different degrees of fusion. In addition to correct restoration, image details are further enhanced by tuning different hyperparameters during training. Compared with the state-of-the-art approaches, the experimental results on synthetic and real datasets demonstrate that the proposed RMANet achieves better performance in visual presentation, especially in image edges and texture details.

A Synthesis-by-Analysis Network with Applications in Image Super-Resolution

Research on Image Super-Resolution Reconstruction Mechanism based on Convolutional Neural Network

A New Convolutional Neural Network for Super-Resolution by Global and Local Residual

Adaptive Loss Function for Super Resolution Neural Networks Using Convex Optimization Techniques

Iterative Network for Image Super-Resolution

Densely Residual Laplacian Super-Resolution

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

Image Super-Resolution Via Deterministic-Stochastic Synthesis and Local Statistical Rectification

Image Super-Resolution Using Deep Convolutional Networks

A Single Super-Resolution Method Via Deep Cascade Network

Adaptive Convolutional Neural Network for Image Super-resolution

Image super-resolution via dynamic network

Bidirectional Convolutional LSTM Neural Network for Remote Sensing Image Super-Resolution

Super-resolution Reconstruction Using Multiconnection Deep Residual Network Combined an Improved Loss Function for Single-frame Image

Hyperspectral Image Super-Resolution With ConvLSTM Skip-Connections

LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyond

Single image super resolution via wavelet transform fusion and SRFeat network

End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks

Recurrent Multi-scale Approximation-Guided Network for Single Image Super-Resolution

A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network

Spatial and Channel Aggregation Network for Lightweight Image Super-Resolution