Abstract:Partial differential equations (PDEs) have emerged as a useful tool for recovering structures when solving image inpainting problems. In the research presented in this paper, we extend structure tensor (ST)-based PDE to fine-grained texture inpainting by improving the ST with three modifications to enhance its suitability to more accurately process fine-grained textures of which the small-scale patterns repeat non-locally. These modifications are then inserted into an anisotropic PDE to recover damaged textures. The result is a subtly-conducted anisotropic diffusion inpainting algorithm free of detail-blurring artifacts produced by the classic tensor diffusion model and dislocation deficiencies affecting patch -based completion approaches. This is made possible by the following strategies: (1) construct a fractional ST (FST1) composed of the inner product of the fractional derivative vector and its transposition to more effectively address complex fractal-like texture details because of the characteristics of the fractional differential; (2) because FST is composed of the inner product of two vectors, it is necessary to represent the tensor at a higher resolution than for the original image to avoid spectrum aliasing, which is automatically implemented by the calculation of the twofold oversampling fractional derivative (i.e., double-sampling EST, DFST2); (3) apply a non-local regularizing method to all four channels of the resulting DFST based on the repeatability of textures, which integrates non-local geometric characteristics to effectively infer how damaged textures extend. Finally, we insert the modified non-locally regularized DFST (NDFST3) into an anisotropic PDE to effectively guide the diffusion process and design its numerical implementation scheme. The experimental results show that, for fine-grained texture images, the proposed NDFST is equipped to accurately detect subtle and complex texture features, and the resulting NDFST-based PDE is particularly effective not only for recovering non-homogeneous structures, but also for the restitution of fine-grained textures.

Two Anisotropic Fourth-Order Partial Differential Equations for Image Inpainting

Image inpainting algorithm based on anisotropic information diffusion

Partial Differential Equation Inpainting Method Based on Image Characteristics.

Orthogonal-directional Forward Diffusion Image Inpainting and Denoising Model

Image inpainting based on nonlinear anisotropic diffusions

A Robust Fourth Order Partial Differential Equation for Image Restoration

Simultaneous Inpainting for Image Structure and Texture Using Anisotropic Heat Transfer Model

Highly Efficient Local Non-Texture Image Inpainting Based on Partial Differential Equation

Exemplar-based Inpainting Model Constrained by Partial Differential Equation

Helmholtz Vorticity Equation and Third Order PDE Coupled Image Inpainting Model

Adaptive image inpainting using anisotropic heat transfer model

A Novel Coupled Bi-Directional Diffused Image Inpainting Model with Morphological Invariant Property

Two new nonlinear PDE image inpainting models

Two-Phase Image Inpainting: Combine Edge-Fitting with PDE Inpainting

Image Inpaiting Based on TV Model of Direction Gradient

A fourth-order partial differential equations method of noise removal

Improved Structure Tensor for Fine-Grained Texture Inpainting

A New Anisotropic Fourth-Order Diffusion Equation Model Based on Image Features for Image Denoising

Image Denoise by Fourth-Order PDE Based on the Changes of Laplacian

A linear fourth-order PDE-based gray-scale image inpainting model

A Local Nontexture Image Inpainting and Denoising Based on Anisotropic Diffusion Equation