Hierarchical Dense Recursive Network for Image Super-Resolution.

Kui Jiang,Zhongyuan Wang,Peng Yi,Junjun Jiang

DOI: https://doi.org/10.1016/j.patcog.2020.107475

IF: 8

2020-01-01

Pattern Recognition

Abstract:•Hierarchical dense connection provides rich linking ways for feature representation.•Reasonable design and parameter sharing contribute for light-weight SR model.•Global feature fusion promotes fine residual learning.

What problem does this paper attempt to address?

Hierarchical Recursive Network for Single Image Super Resolution.

Minglan Su,Shenqi Lai,Zhenhua Chai,Xiaoming Wei,Yong Liu

DOI: https://doi.org/10.1109/icmew.2019.00108

2019-01-01

Abstract:Super Resolution (SR) technique aims to reconstruct the high resolution (HR) image from the observed low resolution (LR) one, which is a significant application in our daily life. In this paper, we propose a novel structure named hierarchical recursive network (HRN), which consists of several sub networks and will reconstruct the HR progressively. In each sub network, the LR feature map will be used as input, the contextual information will be explored and the predicted residuals together with the transposed convolutional outputs will be fused to the finer one. Besides, our network can generate multi-scale HR images with a single model and thus is potentially useful in practical applications. Extensive experimental results show that our proposed method can achieve the state-of-the-art performance.
Non-Global Shared Recursive Network for Image Super-Resolution

Bing Zheng,Lihong Ma

DOI: https://doi.org/10.1088/1742-6596/1518/1/012054

2020-01-01

Abstract:In Super-Resolution(SR) reconstruction, some recursive networks use shared parameters to keep lightweight. But these methods lack flexibility while use shared parameters to process different feature maps. We propose a non-global shared recursive network that consists of recursive units and channel attention modules. Firstly, we propose multi-scale channel attention module to learn the inter-channel interdependence and spatial information within the channel. The multi-scale channel attention module is composed of a multi-scale pooling layer, fully connected layers and activation functions. In order to flexibly process different feature maps in different layers, the attention module parameters are not shared, but only a small number of parameters are used. Secondly, residual dense recursive unit is used to accelerate convergence and feature reuse. In order to further reduce parameters, bottleneck layer is added to the dense connection. Based on the above mechanism, we propose a lightweight and efficient network structure. Experiments show that the proposed method has better performance than other lightweight networks in the standard dataset.
Image super-resolution via a densely connected recursive network.

Zhan-Xiang Feng,Jianhuang Lai,Xiaohua Xie,Jun-Yong Zhu

DOI: https://doi.org/10.1016/j.neucom.2018.07.076

IF: 6

2018-01-01

Neurocomputing

Abstract:The single-image super-resolution techniques (SISR) have been significantly promoted by deep networks. However, the storage and computation complexities of deep models increase dramatically alongside with the reconstruction performance. This paper proposes a densely connected recursive network (DCRN) to trade off the performance and complexity. We introduce an enhanced dense unit by removing the batch normalization (BN) layers and employing the squeeze-and-excitation (SE) structure. A recursive architecture is also adopted to control the parameters of deep networks. Moreover, a de-convolution based residual learning method is proposed to accelerate the residual feature extraction process. The experimental results validate the efficiency of the proposed approach.
Image Super-Resolution Via Deep Recursive Residual Network

Ying Tai,Jian Yang,Xiaoming Liu

DOI: https://doi.org/10.1109/cvpr.2017.298

2017-01-01

Abstract:Recently, Convolutional Neural Network (CNN) based models have achieved great success in Single Image SuperResolution (SISR). Owing to the strength of deep networks, these CNN models learn an effective nonlinear mapping from the low-resolution input image to the high-resolution target image, at the cost of requiring enormous parameters. This paper proposes a very deep CNN model (up to 52 convolutional layers) named Deep Recursive Residual Network (DRRN) that strives for deep yet concise networks. Specifically, residual learning is adopted, both in global and local manners, to mitigate the difficulty of training very deep networks; recursive learning is used to control the model parameters while increasing the depth. Extensive benchmark evaluation shows that DRRN significantly outperforms state of the art in SISR, while utilizing far fewer parameters. Code is available at https://github.com/tyshiwo/DRRNCVPR17.
Lightweight Image Super-Resolution Reconstruction with Hierarchical Feature-Driven Network.

Wen Li,Sumei Li,Anqi Liu

DOI: https://doi.org/10.1109/icip40778.2020.9191110

2020-01-01

Abstract:Deep convolutional neural networks (CNNs) have emerged as powerful tool for single image super-resolution (SISR). However, enormous parameters hinder their real-world applications. To address this issue, we propose a lightweight hierarchical feature-driven network (HFDN) that can fully explore local and global hierarchical feature information. Specifically, we devise a hierarchical fuse module (HFM), which contains an adaptive dense unit (ADU) and an enhancement unit (EU), to effectively utilize local hierarchical information and encourage layer-wise feature reuse. Further, we introduce the channel and spatial attention mechanisms to emphasize informative details. In addition, we propose the multi-supervised reconstruction (MSR) strategy, which amplifies feature maps at different levels of network to exploit global hierarchical information and recover high-quality image. Experimental results on the benchmark datasets prove that the proposed network performs superior to the state-of-the-art methods both quantitatively and qualitatively.
Image Superresolution Via Dense Discriminative Network.

Jiayi Ma,Xinya Wang,Junjun Jiang

DOI: https://doi.org/10.1109/tie.2019.2934071

IF: 7.7

2020-01-01

IEEE Transactions on Industrial Electronics

Abstract:Deep convolutional neural networks have recently made a considerable achievement in the single-image superresolution (SISR) problem. Most CNN architectures for SISR incorporate long or short connections to integrate features, and treat them equally. However, they neglect the discrimination of features, and consequently, achieving relatively poor performance. To address this problem, in this article, we propose a dense discriminative network that is composed of several aggregation modules (AM). Specifically, the AM merges extraction and integration nodes in a tree structure, which can aggregate features progressively in an efficient way. In particular, we compress and rescale the densely connected information in the aggregation node by modeling the interaction between channels, which shares the same insight with the attention mechanism for improving the discriminative ability of network. Extensive experiments conducted on several publicly available datasets have demonstrated the superiority of our model over state-of-the-art in objective metrics and visual impressions.
Hierarchical Regression for Single Image Super Resolution via Clustering and Sparse Representation.

Kang Qiu,Benshun Yi,Weizhong Li,Taiqi Huang

DOI: https://doi.org/10.3837/tiis.2017.05.013

2017-01-01

KSII Transactions on Internet and Information Systems

Abstract:Regression-based image super resolution (SR) methods have shown great advantage in time consumption while maintaining similar or improved quality performance compared to other learning-based methods. In this paper, we propose a novel single image SR method based on hierarchical regression to further improve the quality performance. As an improvement to other regression-based methods, we introduce a hierarchical scheme into the process of learning multiple regressors. First, training samples are grouped into different clusters according to their geometry similarity, which generates the structure layer. Then in each cluster, a compact dictionary can be learned by Sparse Coding (SC) method and the training samples can be further grouped by dictionary atoms to form the detail layer. Last, a series of projection matrixes, which anchored to dictionary atoms, can be learned by linear regression. Experiment results show that hierarchical scheme can lead to regression that is more precise. Our method achieves superior high quality results compared with several state-of-the-art methods.
Dual-Path Recurrent Network For Image Super-Resolution

Xinyao Li,Dongyang Zhang,Jie Shao

DOI: https://doi.org/10.1007/978-3-030-36802-9_12

2019-01-01

Abstract:Recently, significant progress has been made for the task of image super-resolution (SR). However, existing methods show that stacking convolution layers blindly leads to overwhelming parameters and high computational complexities. Besides, the conventional feed-forward architectures can hardly fully exploit the mutual dependencies between low- and high-resolution images. Motivated by these observations, we first propose a novel architecture by taking advantage of recursive learning. Based on dual-path block (DPB), we enhance the network performance simply by increasing the number of DPB recursions and avoiding additional parameters. Moreover, in contrast to most convolutional neural network (CNN) methods with one state, our network is endowed with two states (low-resolution state and high-resolution state) transformed mutually. We exploit the relationship between the two states by introducing a back-projection operation which calculates the differences between the two states for a better result. Extensive experiments show that our method outperforms the state-of-the-art methods.
Pyramidal Dense Attention Networks for Single Image Super‐resolution

Huapeng Wu,Jie Gui,Jun Zhang,James T. Kwok,Zhihui Wei

DOI: https://doi.org/10.1049/ipr2.12557

IF: 2.3

2022-01-01

IET Image Processing

Abstract:Recently, residual and dense networks have effectively promoted the development of image super-resolution (SR). However, most dense networks based SR methods do not make full use of dense feature information. To solve this problem, a pyramidal dense attention network for single image super-resolution is proposed in this paper. In this method, the proposed pyramidal dense learning can gradually increase the width of the densely connected layer inside a pyramidal dense block to extract deep features efficiently. Meanwhile, the adaptive group convolution that the number of groups grows linearly with dense convolutional layers is introduced to relieve the parameter explosion. Besides, a novel joint attention to capture cross-dimension interaction between the spatial dimensions and channel dimension in an efficient way for providing rich discriminative feature representations is also proposed. Extensive experimental results show that the method achieves comparable performance in comparison with the state-of-the-art SR methods.
Deeply Recursive Low- and High-Frequency Fusing Networks for Single Image Super-Resolution

Cheng Yang,Guanming Lu

DOI: https://doi.org/10.3390/s20247268

IF: 3.9

2020-12-18

Sensors

Abstract:With the development of researches on single image super-resolution (SISR) based on convolutional neural networks (CNN), the quality of recovered images has been remarkably promoted. Since then, many deep learning-based models have been proposed, which have outperformed the traditional SISR algorithms. According to the results of extensive experiments, the feature representations of the model can be enhanced by increasing the depth and width of the network, which can ultimately improve the image reconstruction quality. However, a larger network generally consumes more computational and memory resources, making it difficult to train the network and increasing the prediction time. In view of the above problems, a novel deeply-recursive low- and high-frequency fusing network (DRFFN) for SISR tasks is proposed in this paper, which adopts the structure of parallel branches to extract the low- and high-frequency information of the image, respectively. The different complexities of the branches can reflect the frequency characteristic of the diverse image information. Moreover, an effective channel-wise attention mechanism based on variance (VCA) is designed to make the information distribution of each feature map more reasonably with different variances. Owing to model structure (i.e., cascading recursive learning of recursive units), DRFFN and DRFFN-L are very compact, where the weights are shared by all convolutional recursions. Comprehensive benchmark evaluations in standard benchmark datasets well demonstrate that DRFFN outperforms the most existing models and has achieved competitive, quantitative, and visual results.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Sequential Hierarchical Learning with Distribution Transformation for Image Super-Resolution

Yuqing Liu,Xinfeng Zhang,Shanshe Wang,Siwei Ma,Wen Gao

DOI: https://doi.org/10.1145/3532864

IF: 4.094

2023-01-01

ACM Transactions on Multimedia Computing Communications and Applications

Abstract:Multi-scale design has been considered in recent image super-resolution (SR) works to explore the hierarchical feature information. Existing multi-scale networks aim at building elaborate blocks or progressive architecture for restoration. In general, larger scale features concentrate more on structural and high-level information, while smaller scale features contain plentiful details and textured information. In this point of view, information from larger scale features can be derived from smaller ones. Based on the observation, in this article, we build a sequential hierarchical learning super-resolution network (SHSR) for effective image SR. Specially, we consider the inter-scale correlations of features, and devise a sequential multi-scale block (SMB) to progressively explore the hierarchical information. SMB is designed in a recursive way based on the linearity of convolution with restricted parameters. Besides the sequential hierarchical learning, we also investigate the correlations among the feature maps and devise a distribution transformation block (DTB). Different from attention-based methods, DTB regards the transformation in a normalization manner, and jointly considers the spatial and channel-wise correlations with scaling and bias factors. Experiment results show SHSR achieves superior quantitative performance and visual quality to state-of-the-art methods with near 34% parameters and 50% MACs off when scaling factor is × 4. To boost the performance without further training, the extension model SHSR + with self-ensemble achieves competitive performance than larger networks with near 92% parameters and 42% MACs off with scaling factor ×4.
Scale Adaptive and Lightweight Super-Resolution with a Selective Hierarchical Residual Network

Jiawang Dan,Zhaowei Qu,Xiaoru Wang,Fu Li,Jiahang Gu,Bing Ma

DOI: https://doi.org/10.1145/3461353.3461376

2021-01-01

Abstract:Deep convolutional neural networks have made remarkable achievements in single-image super-resolution tasks in recent years. However, current methods do not consider the characteristics of super-resolution that the adjacent areas carry similar information. In this paper, we propose a scale adaptive and lightweight super-resolution with a selective hierarchical residual network (SHRN), which utilizes the repeated texture features. Specifically, SHRN is stacked by several selective hierarchical residual blocks (SHRB). The SHRB mainly contains a hierarchical feature fusion structure (HFFS) and a selective feature fusion structure (SFFS). The HFFS uses multiple branches to obtain multiscale features due to the varying texture size of objects. The SFFS fuses features of adjacent branches to select effective information. Plenty of experiments demonstrate that our lightweight model achieves better performance against other methods by extracting scale adaptive features and utilizing the repeated texture structure.
A deep recursive multi-scale feature fusion network for image super-resolution?

Feiqiang Liu,Xiaomin Yang,Bernard De Baets

DOI: https://doi.org/10.1016/j.jvcir.2022.103730

IF: 2.887

2023-01-01

Journal of Visual Communication and Image Representation

Abstract:Recently, Convolutional Neural Networks (CNNs) have achieved great success in Single Image Super-Resolution (SISR). In particular, the recursive networks are now widely used. However, existing recursion-based SISR networks can only make use of multi-scale features in a layer-wise manner. In this paper, a Deep Recursive Multi-Scale Feature Fusion Network (DRMSFFN) is proposed to address this issue. Specifically, we propose a Recursive Multi-Scale Feature Fusion Block (RMSFFB) to make full use of multi-scale features. Besides, a Progressive Feature Fusion (PFF) technique is proposed to take advantage of the hierarchical features from the RMSFFB in a global manner. At the reconstruction stage, we use a deconvolutional layer to upscale the feature maps to the desired size. Extensive experimental results on benchmark datasets demonstrate the superiority of the proposed DRMSFFN in comparison with the state-of-the-art methods in both quantitative and qualitative evaluations.
Hierarchical Accumulation Network with Grid Attention for Image Super-Resolution.

Yue Yang,Yong Qi

DOI: https://doi.org/10.1016/j.knosys.2021.107520

IF: 8.139

2021-01-01

Knowledge-Based Systems

Abstract:Deep convolutional neural networks (CNNs) have recently shown promising results in single image super-resolution (SISR) due to their powerful representation ability. However, existing CNN-based SR methods mainly focus on deeper architecture design to obtain high-level semantic information, neglecting the features of intermediate layers containing fine-grained texture information and thus limiting the capacity for producing precise high-resolution images. To tackle this issue, we propose a hierarchical accumulation network (HAN) with grid attention in this paper. Specifically, a hierarchical feature accumulation (HFA) structure is proposed to accumulate outputs of intermediate layers in a grouping manner for exploiting the features of different semantic levels. Moreover, we introduce a multi-scale grid attention module (MGAM) to refine features of the same level. The MGAM employs a pyramid sampling with self-attention mechanism to efficiently model the non-local dependencies between pixel features and produces refined representations. By this means, the universal features in connection with spatial similarity and semantic levels are produced for image SR. Experimental results on five benchmark datasets with different degradation models demonstrate the superiority of our HAN in terms of quantitative metrics and visual quality.
Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks.

Xiaoyu Dong,Xu Sun,Xiuping Jia,Zhihong Xi,Lianru Gao,Bing Zhang

DOI: https://doi.org/10.1109/tgrs.2020.2994253

IF: 8.2

2021-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Super-resolution (SR) techniques play a crucial role in increasing the spatial resolution of remote sensing data and overcoming the physical limitations of the spaceborne imaging systems. Though the convolutional neural network (CNN)-based methods have obtained good performance, they show limited capacity when coping with large-scale super-resolving tasks. The more complicated spatial distribution of remote sensing data further increases the difficulty in reconstruction. This article develops a dense-sampling super-resolution network (DSSR) to explore the large-scale SR reconstruction of the remote sensing imageries. Specifically, a dense-sampling mechanism, which reuses an upscaler to upsample multiple low-dimension features, is presented to make the network jointly consider multilevel priors when performing reconstruction. A wide feature attention block (WAB), which incorporates the wide activation and attention mechanism, is introduced to enhance the representation ability of the network. In addition, a chain training strategy is proposed to optimize further the performance of the large-scale models by borrowing knowledge from the pretrained small-scale models. Extensive experiments demonstrate the effectiveness of the proposed methods and show that the DSSR outperforms the state-of-the-art models in both quantitative evaluation and visual quality.
Recursive Inception Network For Super-Resolution

Tao Jiang,Xiaojun Wu,Zhang Yu,Wuyang Shui,Gang Lu,Shiqi Guo,Hao Fei,Qieshi Zhang

DOI: https://doi.org/10.1109/ICPR.2018.8546059

2018-01-01

Abstract:In this paper, we propose a novel network for super-resolution and achieve the state-of-the-art performance with limited parameters. Inspired by the previous methods, we use ResNet to learn the residual part of the input patches. In addition, we introduce an inception-like structure that helps to extract features and a weight sharing mechanism is utilized among these inception blocks. By cascading multi-scale filters with separate paths in a deep network, the proposed method can fully exploit the contextual information over large image regions. Besides, the residual learning module makes the training phase easy to converge. Extensive experiments demonstrate that the proposed method can achieve the same performance with fewer parameters compared with the previous state-of-the-art methods.
Image Superresolution Using Densely Connected Residual Networks

Ran Wen,Kun Fu,Hao Sun,Xian Sun,Lei Wang

DOI: https://doi.org/10.1109/lsp.2018.2861989

2018-01-01

IEEE Signal Processing Letters

Abstract:Recently, convolutional neural networks (CNN) have achieved impressive breakthroughs in single image superresolution. In particular, an efficient nonlinear mapping by increasing the depth and width of the network can be learned between the low-resolution input image and the high-resolution target image. However, this will lead to a substantial increase in network parameters, requiring the massive amount of training data to prevent overfitting. Besides, mast CNN-based methods ignore the full use of different levels of features and, therefore, achieve relatively low performance. In this letter, we propose a deep convolutional network named densely connected residual networks (DRNet). Our proposed DRNet can reach very deep and wide while requiring fewer parameters. The significant performance improvement of our model is mainly due to the integration of dense skip connection and residual learning. In this way, DRNet mitigates the problems of overfitting, vanishing gradient, and training instability during training very deep and wide networks. Moreover, it can improve the propagation and reuse of features by creating direct connections from the previous layers to the subsequent layers. We evaluate the proposed method using images from four benchmark datasets and set a new state of the art.
Pyramid Attention Dense Network for Image Super-Resolution

Si-Bao Chen,Chao Hu,Bin Luo,Chris H. Q. Ding,Shi-Lei Huang

DOI: https://doi.org/10.1109/ijcnn.2019.8852338

2019-01-01

Abstract:Recent deep convolution neural networks has made remarkable progress in single images super-resolution area. They achieved very high Peak Signal to Noise Ratio (PSNR) and structural similarity (SSIM), by improved learning of high-frequency details to enhance visual perception. However, current models usually ignore relations between adjacent pixels. In this work, we propose a network that incorporate gradients of adjacent pixels in addition to per-pixel loss and perceptual loss. In addition, we utilize multi-stage network learning to progressively generate high resolution images, by incorporate a new inter-stage feedback in the Laplacian pyramid network structure. Furthermore, we adopted recently proposed attention mechanism and dense block structure. The proposed Pyramid Attention Dense model for image super-resolution achieved state-of-the-art performance in experiments on four benchmark datasets.
Single Image Super Resolution Via a Refined Densely Connected Inception Network.

Tao Jiang,Yu Zhang,Xiaojun Wu,Gang Lu,Fei Hao,Yumei Zhang

DOI: https://doi.org/10.1109/icip.2018.8451441

2018-01-01

Abstract:Single image super resolution has achieved a significant breakthrough with the development of deep learning technology. Among these approaches based on deep learning, the mainstream method is to build a cascading network and attempt to add more learning layers. However, as the depth of the model increases, features far away from the reconstruction layer are less considered in the reconstruction process. In this paper, we propose a novel model based on a refined densely connected network for super-resolution reconstruction tasks. By utilizing densely connected paths in the model, we can significantly shorten the distance between the feature maps from different levels and the reconstruction layer. Besides, an inception-like structure is employed to replace the ordinary convolutional layer to take full advantage of the contextual information. Moreover, quantities of 1 ×1 filters are used to ensure an acceptable model size. Extensive experiments are conducted for demonstrating that the proposed method can achieve the state-of-the-art performance with smaller model size.
Densely Convolutional Attention Network for Image Super-Resolution

Furui Bai,Wen Lu,Yuanfei Huang,Lin Zha,Jiachen Yang

DOI: https://doi.org/10.1016/j.neucom.2019.08.070

IF: 6

2019-01-01

Neurocomputing

Abstract:Recently, deep convolutional neural networks (CNNs) with skip-connections in single image super-resolution (SISR) have received great success. However, the difficulty of reconstructing high-resolution images is particularly pronounced for the limited information extracted from input low-resolution images, for which the performance bottleneck of these SR networks still exists. In this paper, we present a novel Densely Convolutional Attention Network (DCAN) for SISR to improve the quality of reconstructed images. Specifically, we propose a convolutional attention mechanism which adds an weighted skip-connection joint the original convolution. Our network can adaptively recalibrate convolutional-wise features by considering interdependencies among convolutional layers. Besides, the proposed network leverage several dense block to enhance the relationship between different convolutional layers, more information could be used sufficiently by this dense block learning method, in order that reconstructed images can obtain richer details and clearer edges. Extensive experiments show that the proposed DCAN could obtain more outstanding performance quantitatively and qualitatively against the state-of-the-art methods while cost less execution time.

Hierarchical Dense Recursive Network for Image Super-Resolution.

Hierarchical Recursive Network for Single Image Super Resolution.

Non-Global Shared Recursive Network for Image Super-Resolution

Image super-resolution via a densely connected recursive network.

Image Super-Resolution Via Deep Recursive Residual Network

Lightweight Image Super-Resolution Reconstruction with Hierarchical Feature-Driven Network.

Image Superresolution Via Dense Discriminative Network.

Hierarchical Regression for Single Image Super Resolution via Clustering and Sparse Representation.

Dual-Path Recurrent Network For Image Super-Resolution

Pyramidal Dense Attention Networks for Single Image Super‐resolution

Deeply Recursive Low- and High-Frequency Fusing Networks for Single Image Super-Resolution

Sequential Hierarchical Learning with Distribution Transformation for Image Super-Resolution

Scale Adaptive and Lightweight Super-Resolution with a Selective Hierarchical Residual Network

A deep recursive multi-scale feature fusion network for image super-resolution?

Hierarchical Accumulation Network with Grid Attention for Image Super-Resolution.

Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks.

Recursive Inception Network For Super-Resolution

Image Superresolution Using Densely Connected Residual Networks

Pyramid Attention Dense Network for Image Super-Resolution

Single Image Super Resolution Via a Refined Densely Connected Inception Network.

Densely Convolutional Attention Network for Image Super-Resolution