Abstract:Some recent methods for lossy signal and image compression store only a few selected pixels and fill in the missing structures by inpainting with a partial differential equation (PDE). Suitable operators include the Laplacian, the biharmonic operator, and edge-enhancing anisotropic diffusion (EED). The quality of such approaches depends substantially on the selection of the data that is kept. Optimising this data in the domain and codomain gives rise to challenging mathematical problems that shall be addressed in our work. In the 1D case, we prove results that provide insights into the difficulty of this problem, and we give evidence that a splitting into spatial and tonal (i.e. function value) optimisation does hardly deteriorate the results. In the 2D setting, we present generic algorithms that achieve a high reconstruction quality even if the specified data is very sparse. To optimise the spatial data, we use a probabilistic sparsification, followed by a nonlocal pixel exchange that avoids getting trapped in bad local optima. After this spatial optimisation we perform a tonal optimisation that modifies the function values in order to reduce the global reconstruction error. For homogeneous diffusion inpainting, this comes down to a least squares problem for which we prove that it has a unique solution. We demonstrate that it can be found efficiently with a gradient descent approach that is accelerated with fast explicit diffusion (FED) cycles. Our framework allows to specify the desired density of the inpainting mask a priori. Moreover, is more generic than other data optimisation approaches for the sparse inpainting problem, since it can also be extended to nonlinear inpainting operators such as EED. This is exploited to achieve reconstructions with state-of-the-art quality. We also give an extensive literature survey on PDE-based image compression methods.

A linear fourth-order PDE-based gray-scale image inpainting model

An Advanced Total Variation Model in H-1space for Image Inpainting

Image inpainting algorithm based on double curvature-driven diffusion model with P-Laplace operator

A universal variational framework for sparsity-based image inpainting

An image inpainting model based on the mixture of Perona–Malik equation and Cahn–Hilliard equation

A Ginzburg-Landau- H^-1 Model and Its SAV Algorithm for Image Inpainting

A Variational Approach to Medical Image Inpainting Based on Mumford-Shah Model

Mathematical Models for Local Nontexture Inpaintings

Asymptotic Analysis of Inpainting via Universal Shearlet Systems

Image Inpainting Using Reproducing Kernel Hilbert Space and Heaviside Functions.

Free-Form Image Inpainting with Separable Gate Encoder-Decoder Network

The Navier-Stokes-Voight Model for Image Inpainting

Sobolev gradients and image interpolation

A bi-level view of inpainting - based image compression

Fast image inpainting and colorization by Chambolle's dual method.

Automatic inpainting of linearly related video frames

Wavelet Inpainting Based on p-Laplace Operator

Highly Efficient Local Non-Texture Image Inpainting Based on Partial Differential Equation

Nonlocal Adaptive Biharmonic Regularizer for Image Restoration.

Curvature-Dependent Elastic Bending Total Variation Model for Image Inpainting with the SAV Algorithm

Optimising Spatial and Tonal Data for PDE-based Inpainting