Abstract:The autoregressive (AR) model is widely used in image interpolations. Traditional AR models consider utilizing the dependence between pixels to model the image signal. However, they ignore the valuable patch-level information for image modeling. In this paper, we propose to integrate both the pixel-level and patch-level information to depict the relationship between high-resolution and low-resolution pixels and obtain better image interpolation results. In particular, we propose an isophote-constrained AR (ICAR) model to perform AR-flavored interpolation within an identified joint stable region and further develop an AR interpolation with an adaptive window extension. Considering the smoothness along the isophote curve, the ICAR model searches only several successive similar patches along the isophote curve over a large region to construct an adaptive window. These overlapped patches, representing the patch-level structure similarity, are used to construct a joint AR model. To better characterize the piecewise stationarity and determine whether a pixel is suitable for AR estimation, we further propose pixel-level and patch-level similarity metrics and embed them into the ICAR model, introducing a weighted ICAR model. Comprehensive experiments demonstrate that our method can effectively reconstruct the edge structures and suppress jaggy or ringing artifacts. In the objective quality evaluation, our method achieves the best results in terms of both peak signal-to-noise ratio and structural similarity for both simple size doubling (two times) and for arbitrary scale enlargements.

Adaptive General Scale Interpolation Based on Weighted Autoregressive Models

Adaptive General Scale Interpolation Based on Similar Pixels Weighting

De-interlacing with weighted edge adaptive intra-field interpolation

Isophote-Constrained Autoregressive Model with Adaptive Window Extension for Image Interpolation.

High-quality Image Interpolation Via Local Autoregressive and Nonlocal 3-D Sparse Regularization

Autoregressive Image Interpolation Via Context Modeling and Multiplanar Constraint

Motion adaptive de-interlace with enhanced edge oriented interpolation

Novel Autoregressive Model Based On Adaptive Window-Extension And Patch-Geodesic Distance For Image Interpolation

A Generalized Spatial Autoregressive Neural Network Method for Three-Dimensional Spatial Interpolation

Adaptive Autoregressive Model With Window Extension Via Explicit Geometry For Image Interpolation

A Hvs-Guided Approach For Real-Time Image Interpolation

Arbitrary factor image interpolation by convolution kernel constrained 2-D autoregressive modeling

General scale interpolation based on fine-grained isophote model with consistency constraint

Improved autoregressive image model estimation for directional image interpolation

Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling

Image Interpolation Using Autoregressive Model and Gauss-Seidel Optimization.

Image Interpolation Algorithm Based on Implicit Piecewise Autoregressive Model

Weighted Encoding Based Image Interpolation With Nonlocal Linear Regression Model

Adaptive Image Scaling with Third-order Lagrange Interpolation

A Spatiotemporal Autoregressive Neural Network Interpolation Method for Discrete Environmental Factors

Coarse to Fine Adaptive Interpolation Filter for High Resolution Video Coding