Single-Image Super-Resolution via an Iterative Reproducing Kernel Hilbert Space Method

DengLiang-Jian,GuoWeihong,HuangTing-Zhu

IF: 5.859

2016-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Image super-resolution (SR), a process to enhance image resolution, has important applications in satellite imaging, high-definition television, medical imaging, and so on. Many existing approaches...

What problem does this paper attempt to address?

Single-Image Super-Resolution Via an Iterative Reproducing Kernel Hilbert Space Method.

Liang-Jian Deng,Weihong Guo,Ting-Zhu Huang

DOI: https://doi.org/10.1109/tcsvt.2015.2475895

IF: 5.859

2016-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Image super-resolution (SR), a process to enhance image resolution, has important applications in satellite imaging, high-definition television, medical imaging, and so on. Many existing approaches use multiple low-resolution (LR) images to recover one high-resolution (HR) image. In this paper, we present an iterative scheme to solve single-image SR problems. It recovers a high-quality HR image from solely one LR image without using a training data set. We solve the problem from image intensity function estimation perspective and assume that the image contains smooth and edge components. We model the smooth components of an image using a thin-plate reproducing kernel Hilbert space and the edges using approximated Heaviside functions. The proposed method is applied to image patches, aiming to reduce computation and storage. Visual and quantitative comparisons with some competitive approaches show the effectiveness of the proposed method.
A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

Yunfeng Zhang,Ping Wang,Fangxun Bao,Xunxiang Yao,Caiming Zhang,Hongwei Lin

DOI: https://doi.org/10.1109/tmm.2019.2943750

IF: 7.3

2020-01-01

IEEE Transactions on Multimedia

Abstract:In this paper, a novel single image super-resolution (SR) method based on progressive-iterative approximation is proposed. To preserve textures and clear edges, the image SR reconstruction is treated as an image progressive-iterative fitting procedure and achieved by iterative interpolation. Due to different features in different regions, we first employ the nonsubsampled contourlet transform (NSCT) to divide the image into smooth regions, texture regions, and edges. Then, a hybrid interpolation scheme based on curves and surfaces is proposed, which differs from the traditional surface interpolation methods. Specifically, smooth regions are interpolated by the non-uniform rational basis spline (NURBS) surface geometric iteration. To retain textures, control points are increased, and the progressive-iterative approximation of the NURBS surface is employed to interpolate the texture regions. By considering edges in an image as curve segments that are connected by pixels with dramatic changes, we use NURBS curve progressive-iterative approximation to interpolate the edges, which sharpens the edges and can maintain the image edge structure without jaggy and block artifacts. The experimental results demonstrate that the proposed method significantly outperforms the state-of-the-art methods in terms of both subjective and objective measures.
Reproducing kernel hilbert space based single infrared image super resolution

Liangliang Chen,Liangjian Deng,Wei Shen,Ning Xi,Zhanxin Zhou,Bo Song,Yongliang Yang,Yu Cheng,Lixin Dong

DOI: https://doi.org/10.1016/j.infrared.2016.05.015

IF: 2.997

2016-01-01

Infrared Physics & Technology

Abstract:•Infrared image are analyzed by reflective, cooled emissive and uncooled emissive.•Model by spline based reproducing kernel hilbert space and heaviside function.•The robust model is applicable to all infrared images.•The small root mean-square-error of reconstructed high resolution images.
Single Image Super-Resolution Using Combined Total Variation Regularization by Split Bregman Iteration

Lin Li,Yuan Xie,Wenrui Hu,Wensheng Zhang

DOI: https://doi.org/10.1016/j.neucom.2014.02.045

IF: 6

2014-01-01

Neurocomputing

Abstract:This paper addresses the problem of generating a high-resolution (HR) image from a single degraded low-resolution (LR) input image without any external training set. Due to the ill-posed nature of this problem, it is necessary to find an effective prior knowledge to make it well-posed. For this purpose, we propose a novel super-resolution (SR) method based on combined total variation regularization. In the first place, we propose a new regularization term called steering kernel regression total variation (SKRTV), which exploits the local structural regularity properties in natural images. In the second place, another regularization term called non-local total variation (NLTV) is employed as a complementary term in our method, which makes the most of the redundancy of similar patches in natural images. By combining the two complementary regularization terms, we propose a maximum a posteriori probability framework of SR reconstruction. Furthermore, split Bregman iteration is applied to implement the proposed model. Extensive experiments demonstrate the effectiveness of the proposed method.
Single-Image Super-Resolution by Subdictionary Coding and Kernel Regression

Wenming Yang,Tingrong Yuan,Wei Wang,Fei Zhou,Qingmin Liao

DOI: https://doi.org/10.1109/tsmc.2016.2523947

2016-01-01

IEEE Transactions on Systems Man and Cybernetics Systems

Abstract:In this paper, we present a new learning-based single-image super-resolution (SR) approach, inspired by existing sparse representation-based methods. As a promising image modeling theory, sparse representation has been effectively applied to solve the image SR problem, usually with the use of pretrained coupled or semi-coupled dictionaries. In our proposed method, we train independent dictionaries for high-resolution (HR) and low-resolution (LR) image patches to endow them more flexibility of expression. We use local subdictionaries to adaptively code image patches, which can characterize image local structures better and ensure the sparsity property of the image. Furthermore, we use kernel regression to relate HR and LR coding coefficients to capture and map the intrinsic nonlinear relationship between them. Such mapping is of central importance in the image SR problem, because high-order statistics play a significant role in the reconstruction of the detail structure of an HR image. The proposed model is generic for image SR in terms of two categories of blurring kernel. Experimental results show that our method can effectively reconstruct image details and outperform state-of-the-art algorithms in both quantitative and visual comparisons.
Single Image Super-Resolution Using Sparse Prior

Junjie Bian,Yuelong Li,Jufu Feng

DOI: https://doi.org/10.1117/12.901646

2011-01-01

Abstract:Obtaining high-resolution images from low-resolution ones has been an important topic in computer vision field. This is a very hard problem since low-resolution images will always lose some information when down sampled from high-resolution ones. In this article, we proposed a novel image super-resolution method based on the sparse assumption. Compared to many existing example-based image super-resolution methods, our method is based on single original low-resolution image, i.e. our method does not need any training examples. Compared to other interpolation based approach, like nearest neighbor, bilinear or bicubic, our method takes advantage of the inner properties of high-resolution images, thus obtains a better result. The main approach for our method is based on the recently developed theory called sparse representation and compress sensing. Many experiments show our method can lead to competitive or even superior results in quality to images produced by other super-resolution methods, while our method need much fewer additional information.
Single Image Super-Resolution via Iterative Collaborative Representation.

Zhang Y,Zhang J,Wang H,Dai Q.

DOI: https://doi.org/10.1007/978-3-319-24078-7_7

2015-01-01

Abstract:We propose a new model called iterative collaborative representation (ICR) for image super-resolution (SR). Most of popular SR approaches extract low-resolution (LR) features from the given LR image directly to recover its corresponding high-resolution (HR) features. However, they neglect to utilize the reconstructed HR image for further image SR enhancement. Based on this observation, we extract features from the reconstructed HR image to progressively upscale LR image in an iterative way. In the learning phase, we use the reconstructed and the original HR images as inputs to train the mapping models. These mapping models are then used to upscale the original LR images. In the reconstruction phase, mapping models and LR features extracted from the LR and reconstructed image are then used to conduct image SR in each iteration. Experimental results on standard images demonstrate that our ICR obtains state-of-the-art SR performance quantitatively and visually, surpassing recently published leading SR methods. © Springer International Publishing Switzerland 2015.
Single-Image Super-Resolution Via Adaptive Joint Kernel Regression.

Chen Huang,Xiaoqing Ding,Chi Fang

DOI: https://doi.org/10.5244/c.27.101

2013-01-01

Abstract:Single image super-resolution (SR) methods can be broadly categorized into three classes: interpolation-based methods, reconstruction-based methods [7], and example-based methods [2, 3, 6]. The reconstruction-based methods often incorporate prior knowledge to regularize the ill-posed problem. For example, Zhang et al. [7] assembled the Steering Kernel Regression [5] (SKR)-based local prior and Nonlocal Means [1] (NLM)based nonlocal prior. The example-based methods strongly rely on the chosen dictionary for satisfactory results. This paper focuses on learning good image priors and robust dictionaries for SR reconstruction. Among the extensively studied natural image priors, we choose to exploit the local structural regularity prior and nonlocal self-similarity prior in a coherent framework. We propose in this paper an Adaptive Joint Kernel Regression (AJKR)based prior to simultaneously exploit both image statistics. Our approach differs from others in several ways: 1) we combine a set of NLM-generalized local kernel regressors, which are more consistent with our nonlocal collaborative framework; 2) the proposed regional redundancy measure introduces higher-order statistics at the region level for each regression group, making the overall framework more adaptive (see Fig. 1(a)); and 3) an adaptive PCA-based dictionary learning scheme is adopted to bridge the gap of dictionaries learned online and offline by mixing them, and more importantly such a scheme together with its induced sparsity prior can adapt to the AJKR process in response to the regional redundancy measure (see the block diagram in Fig. 1(b)). The imaging model for SR (assume Y ∈ Rm is low resolution (LR) image, X ∈ Rn is high resolution (HR) image) is usually expressed as
A Single-Image Super-Resolution Method Via Low-Rank Matrix Recovery And Nonlinear Mappings

Xiaoxuan Chen,Chun Qi

DOI: https://doi.org/10.1109/ICIP.2013.6738131

2013-01-01

Abstract:This paper presents a novel method for single-image super-resolution (SR) reconstruction using the low-rank matrix recovery and nonlinear mappings. First, the low-rank matrix recovery is utilized to learn the underlying structures of subspaces spanned by the grouped patch features. Second, the low-rank components of low-resolution (LR) and high-resolution (HR) patch features are mapped onto high-dimensional spaces by nonlinear mappings respectively. Then the mapped high-dimensional vectors are projected onto a unified space, where the two manifolds constructed by LR and HR patches respectively have similar local geometry and the SR reconstruction is performed via neighboring embedding. The experimental results validate the effectiveness of our method and suggest that the proposed method outperforms other SR algorithms qualitatively and quantitatively.
Blind Super-Resolution With Iterative Kernel Correction

Jinjin Gu,Hannan Lu,Wangmeng Zuo,Chao Dong

DOI: https://doi.org/10.48550/arXiv.1904.03377

2019-05-29

Abstract:Deep learning based methods have dominated super-resolution (SR) field due to their remarkable performance in terms of effectiveness and efficiency. Most of these methods assume that the blur kernel during downsampling is predefined/known (e.g., bicubic). However, the blur kernels involved in real applications are complicated and unknown, resulting in severe performance drop for the advanced SR methods. In this paper, we propose an Iterative Kernel Correction (IKC) method for blur kernel estimation in blind SR problem, where the blur kernels are unknown. We draw the observation that kernel mismatch could bring regular artifacts (either over-sharpening or over-smoothing), which can be applied to correct inaccurate blur kernels. Thus we introduce an iterative correction scheme -- IKC that achieves better results than direct kernel estimation. We further propose an effective SR network architecture using spatial feature transform (SFT) layers to handle multiple blur kernels, named SFTMD. Extensive experiments on synthetic and real-world images show that the proposed IKC method with SFTMD can provide visually favorable SR results and the state-of-the-art performance in blind SR problem.

Computer Vision and Pattern Recognition
Single image super-resolution by approximated Heaviside functions

Liang-Jian Deng,Weihong Guo,Ting-Zhu Huang

DOI: https://doi.org/10.48550/arXiv.1503.03630

2015-03-12

Abstract:Image super-resolution is a process to enhance image resolution. It is widely used in medical imaging, satellite imaging, target recognition, etc. In this paper, we conduct continuous modeling and assume that the unknown image intensity function is defined on a continuous domain and belongs to a space with a redundant basis. We propose a new iterative model for single image super-resolution based on an observation: an image is consisted of smooth components and non-smooth components, and we use two classes of approximated Heaviside functions (AHFs) to represent them respectively. Due to sparsity of the non-smooth components, a $L_{1}$ model is employed. In addition, we apply the proposed iterative model to image patches to reduce computation and storage. Comparisons with some existing competitive methods show the effectiveness of the proposed method.

Computer Vision and Pattern Recognition,Information Theory,Optimization and Control
Single Image Super-Resolution Methods: A Survey

Bahattin Can Maral

DOI: https://doi.org/10.48550/arXiv.2202.11763

2022-02-17

Abstract:Super-resolution (SR), the process of obtaining high-resolution images from one or more low-resolution observations of the same scene, has been a very popular topic of research in the last few decades in both signal processing and image processing areas. Due to the recent developments in Convolutional Neural Networks, the popularity of SR algorithms has skyrocketed as the barrier of entry has been lowered significantly. Recently, this popularity has spread into video processing areas to the lengths of developing SR models that work in real-time. In this paper, we compare different SR models that specialize in single image processing and will take a glance at how they evolved to take on many different objectives and shapes over the years.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Single image super-resolution via sparse KPCA and regression

Tingrong Yuan,Wenming Yang,Fei Zhou,Qingmin Liao

DOI: https://doi.org/10.1109/ICIP.2014.7025427

2014-01-01

Abstract:In this paper, we present a new approach to single image super-resolution (SR). The basic idea is to learn a dictionary which can capture the high-order statistics of high-resolution (HR) images. This is of central importance in image SR application, since the high-order statistics play a significant role in the reconstruction of HR image structure. Kernel principal component analysis (KPCA) is used to learn such a dictionary. To reduce the time complexity of learning and testing for KPCA, a sparse solution is adopted. Meanwhile, kernel ridge regression is employed to relate the input low-resolution (LR) image patches and the HR coding coefficients. Experimental results show that the proposed method can effectively reconstruct image details and outperform state-of-the-art algorithms in both quantitative and visual comparisons.
Single Image Super-Resolution Based on Nonlocal Sparse and Low-Rank Regularization.

Chunhong Liu,Faming Fang,Yingying Xu,Chaomin Shen

DOI: https://doi.org/10.1007/978-3-319-42911-3_21

2016-01-01

Abstract:Image super resolution (SR) is an active research topic to obtain an high resolution (HR) image from the low resolution (LR) observation. Many results of existing methods may be corrupted by some artifacts. In this paper, we propose an SR reconstruction method for single image based on nonlocal sparse and low-rank regularization. We form a matrix for each patch with its vectorized similar patches to utilize the redundancy of similar patches in natural images. This matrix can be decomposed as the low rank component and sparse part, where the low rank component depictures the similarity and the sparse part depictures the fine differences and outliers. The SR result is achieved by the iterative method and corroborated by experimental results, showing that our method outperforms other prevalent methods.
Revisiting Single Image Super-Resolution Under Internet Environment: Blur Kernels and Reconstruction Algorithms

Kai Zhang,Xiaoyu Zhou,Hongzhi Zhang,Wangmeng Zuo

DOI: https://doi.org/10.1007/978-3-319-24075-6_65

2015-01-01

Abstract:Due to limited network bandwidth, the blurred and downsampled high-resolution images in the spatial domain are inevitably used for transmission over the internet, and so single image super-resolution (SISR) algorithms would play a vital role in reconstructing the lost spatial information of the low-resolution images. Recently, it has been recognized that the blur kernel is crucial to the SISR performances. As most of the existing SISR methods typically assume the blur kernel is known, and in fact the blur kernel is either fixed with the scaling factor or unknown, it thus would be of high value to investigate the relationship between blur kernels and reconstruction algorithms. In this paper, we first propose a fast and effective SISR method based on mixture of experts and then give an empirical study on the sensitivity of different SISR algorithms to the blur kernels. Specially, we find that different algorithms have different sensitivity to the blur kernels and the most suitable blur kernels for different algorithms are different. Our findings highlight the importance of the blur models for SISR algorithms and may benefit current spatial information coding methods in multimedia processing.
Single-Image Super-Resolution Based on Compact KPCA Coding and Kernel Regression

Fei Zhou,Tingrong Yuan,Wenming Yang,Qingmin Liao

DOI: https://doi.org/10.1109/lsp.2014.2360038

2015-01-01

IEEE Signal Processing Letters

Abstract:In this letter, we propose a novel approach for single-image super-resolution (SR). Our method is based on the idea of learning a dictionary which can capture the high-order statistics of high-resolution (HR) images. It is of central importance in image SR application, since the high-order statistics play a significant role in the reconstruction of HR image structure. Kernel principal component analysis (KPCA) is adopted to learn such a dictionary. A compact solution is adopted to reduce the time complexity of learning and testing for KPCA. Meanwhile, kernel ridge regression is employed to connect the input low-resolution (LR) image patches with the HR coding coefficients. Experimental results show that the proposed method is effective and efficient in comparison with state-of-art algorithms.
A Multi-Frame Image Super-Resolution Method.

Xuelong Li,Yanting Hu,Xinbo Gao,Dacheng Tao,Beijia Ning

DOI: https://doi.org/10.1016/j.sigpro.2009.05.028

IF: 4.729

2010-01-01

Signal Processing

Abstract:Multi-frame image super-resolution (SR) aims to utilize information from a set of low-resolution (LR) images to compose a high-resolution (HR) one. As it is desirable or essential in many real applications, recent years have witnessed the growing interest in the problem of multi-frame SR reconstruction. This set of algorithms commonly utilizes a linear observation model to construct the relationship between the recorded LR images to the unknown reconstructed HR image estimates. Recently, regularization-based schemes have been demonstrated to be effective because SR reconstruction is actually an ill-posed problem. Working within this promising framework, this paper first proposes two new regularization items, termed as locally adaptive bilateral total variation and consistency of gradients, to keep edges and flat regions, which are implicitly described in LR images, sharp and smooth, respectively. Thereafter, the combination of the proposed regularization items is superior to existing regularization items because it considers both edges and flat regions while existing ones consider only edges. Thorough experimental results show the effectiveness of the new algorithm for SR reconstruction.
Single Image Super-Resolution with Non-Local Means and Steering Kernel Regression

Kaibing Zhang,Xinbo Gao,Dacheng Tao,Xuelong Li

DOI: https://doi.org/10.1109/tip.2012.2208977

IF: 10.6

2012-01-01

IEEE Transactions on Image Processing

Abstract:Image super-resolution (SR) reconstruction is essentially an ill-posed problem, so it is important to design an effective prior. For this purpose, we propose a novel image SR method by learning both non-local and local regularization priors from a given low-resolution image. The non-local prior takes advantage of the redundancy of similar patches in natural images, while the local prior assumes that a target pixel can be estimated by a weighted average of its neighbors. Based on the above considerations, we utilize the non-local means filter to learn a non-local prior and the steering kernel regression to learn a local prior. By assembling the two complementary regularization terms, we propose a maximum a posteriori probability framework for SR recovery. Thorough experimental results suggest that the proposed SR method can reconstruct higher quality results both quantitatively and perceptually.
Iterative Network for Image Super-Resolution

Yuqing Liu,Shiqi Wang,Jian Zhang,Shanshe Wang,Siwei Ma,Wen Gao

DOI: https://doi.org/10.1109/tmm.2021.3078615

IF: 7.3

2021-01-01

IEEE Transactions on Multimedia

Abstract:Single image super-resolution (SISR), as a traditional ill-conditioned inverse problem, has been greatly revitalized by the recent development of convolutional neural networks (CNN). These CNN-based methods generally map a low-resolution image to its corresponding high-resolution version with sophisticated network structures and loss functions, showing impressive performances. This paper provides a new insight on conventional SISR algorithm, and proposes a substantially different approach relying on the iterative optimization. A novel iterative super-resolution network (ISRN) is proposed on top of the iterative optimization. We first analyze the observation model of image SR problem, inspiring a feasible solution by mimicking and fusing each iteration in a more general and efficient manner. Considering the drawbacks of batch normalization, we propose a feature normalization (F-Norm, FN) method to regulate the features in network. Furthermore, a novel block with FN is developed to improve the network representation, termed as FNB. Residual-in-residual structure is proposed to form a very deep network, which groups FNBs with a long skip connection for better information delivery and stabling the training phase. Extensive experimental results on testing benchmarks with bicubic (BI) degradation show our ISRN can not only recover more structural information, but also achieve competitive or better PSNR/SSIM results with much fewer parameters compared to other works. Besides BI, we simulate the real-world degradation with blur-downscale (BD) and downscale-noise (DN). ISRN and its extension ISRN+ both achieve better performance than others with BD and DN degradation models.

computer science, information systems,telecommunications, software engineering
Kernel based low-rank sparse model for single image super-resolution

Jiahe Shi,Chun Qi

DOI: https://doi.org/10.48550/arXiv.1809.10582

2018-09-27

Computer Vision and Pattern Recognition

Abstract:Self-similarity learning has been recognized as a promising method for single image super-resolution (SR) to produce high-resolution (HR) image in recent years. The performance of learning based SR reconstruction, however, highly depends on learned representation coeffcients. Due to the degradation of input image, conventional sparse coding is prone to produce unfaithful representation coeffcients. To this end, we propose a novel kernel based low-rank sparse model with self-similarity learning for single image SR which incorporates nonlocalsimilarity prior to enforce similar patches having similar representation weights. We perform a gradual magnification scheme, using self-examples extracted from the degraded input image and up-scaled versions. To exploit nonlocal-similarity, we concatenate the vectorized input patch and its nonlocal neighbors at different locations into a data matrix which consists of similar components. Then we map the nonlocal data matrix into a high-dimensional feature space by kernel method to capture their nonlinear structures. Under the assumption that the sparse coeffcients for the nonlocal data in the kernel space should be low-rank, we impose low-rank constraint on sparse coding to share similarities among representation coeffcients and remove outliers in order that stable weights for SR reconstruction can be obtained. Experimental results demonstrate the advantage of our proposed method in both visual quality and reconstruction error.

Single-Image Super-Resolution via an Iterative Reproducing Kernel Hilbert Space Method

Single-Image Super-Resolution Via an Iterative Reproducing Kernel Hilbert Space Method.

A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

Reproducing kernel hilbert space based single infrared image super resolution

Single Image Super-Resolution Using Combined Total Variation Regularization by Split Bregman Iteration

Single-Image Super-Resolution by Subdictionary Coding and Kernel Regression

Single Image Super-Resolution Using Sparse Prior

Single Image Super-Resolution via Iterative Collaborative Representation.

Single-Image Super-Resolution Via Adaptive Joint Kernel Regression.

A Single-Image Super-Resolution Method Via Low-Rank Matrix Recovery And Nonlinear Mappings

Blind Super-Resolution With Iterative Kernel Correction

Single image super-resolution by approximated Heaviside functions

Single Image Super-Resolution Methods: A Survey

Single image super-resolution via sparse KPCA and regression

Single Image Super-Resolution Based on Nonlocal Sparse and Low-Rank Regularization.

Revisiting Single Image Super-Resolution Under Internet Environment: Blur Kernels and Reconstruction Algorithms

Single-Image Super-Resolution Based on Compact KPCA Coding and Kernel Regression

A Multi-Frame Image Super-Resolution Method.

Single Image Super-Resolution with Non-Local Means and Steering Kernel Regression

Iterative Network for Image Super-Resolution

Kernel based low-rank sparse model for single image super-resolution