Abstract:In recent years, image priors based on nonlocal self-similarity and low-rank approximation have been proven as powerful tools for image restoration. Many restoration methods group similar patches as a matrix and recover the underlying low-rank structure from the corrupted matrix via rank minimization. However, both the nonlocally redundant and low-rank properties are highly content dependent, and whether they can faithfully characterize a wide range of natural images still remains unclear. In this paper, we analyze these two properties and provide quantifications of them in a data-driven and parametric way, respectively, obtaining the new measures of regional redundancy and nonlocal patch rank. Leveraging these prior leads to an adaptive image restoration method with content-awareness. In particular, our method iteratively removes outliers and recovers latent fine details. To handle outliers, we propose an adaptive low-rank and sparse matrix approximation algorithm to encourage the estimated nonlocal rank in the patch matrix. The guidance of regional redundancy further gives rise to the “denoise” quality. In the detail recovery step, we propose an adaptive joint kernel regression algorithm using the redundancy measure to determine the confidence of each regression group. It also bridges the gap between our online and offline dictionary learning schemes. Experiments on synthetic and real-world images show the efficacy of our method in image deblurring and super-resolution tasks, especially when subject to practical outliers such as rain drops.

Robust Image/video Super-Resolution Display.

Robust Dual Images Super-Resolution.

Video Super-Resolution Based on Multiple Networks Merging

A Robust Video Super-Resolution Algorithm.

Highly Robust Real-Time Image Enhancement

Robust Super Resolution of Compressed Video

Robust Video Super-Resolution With Registration Efficiency Adaptation

Practical super-resolution from dynamic video sequences

Robust web image/video super-resolution

Noise-robust Video Super-Resolution Using an Adaptive Spatial-Temporal Filter

Robust Superresolution of Multiangle-Multispectral Remote Sensing Images Based on Rank Minimization.

Real-Time Video Super-Resolution with Spatio-Temporal Modeling and Redundancy-Aware Inference

Super Resolution with Edge-Constrained Motion Estimation

Video Super-Resolution Via Pre-Frame Constrained and Deep-Feature Enhanced Sparse Reconstruction

Robust image restoration via adaptive low-rank approximation and joint kernel regression.

Image/Video Restoration Via Multi Planar Autoregressive Model And Low-Rank Optimization

Towards efficient motion-blurred public security video super-resolution based on back-projection networks

Iterative Back Projection Network Based on Deformable 3D Convolution

An Efficient Algorithm for Video Super-Resolution Based On a Sequential Model

Video super-resolution using low rank matrix completion

Super Resolution Method for Network Video