Probabilistic Semantic Inpainting with Pixel Constrained CNNs

Emilien Dupont,Suhas Suresha
DOI: https://doi.org/10.48550/arXiv.1810.03728
2019-02-24
Abstract:Semantic inpainting is the task of inferring missing pixels in an image given surrounding pixels and high level image semantics. Most semantic inpainting algorithms are deterministic: given an image with missing regions, a single inpainted image is generated. However, there are often several plausible inpaintings for a given missing region. In this paper, we propose a method to perform probabilistic semantic inpainting by building a model, based on PixelCNNs, that learns a distribution of images conditioned on a subset of visible pixels. Experiments on the MNIST and CelebA datasets show that our method produces diverse and realistic inpaintings.
Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?