Abstract:Existing deep-network based texture synthesis approaches all focus on fine-grained control of texture generation by synthesizing images from exemplars. Since the networks employed by most of these methods are always tied to individual exemplar textures, a large number of individual networks have to be trained when modeling various textures. In this paper, we propose to generate textures directly from coarse-grained control or high-level guidance, such as texture categories, perceptual attributes and semantic descriptions. We fulfill the task by parsing the generation process of a texture into the three-level Bayesian hierarchical model. A coarse-grained signal first determines a distribution over Markov random fields. Then a Markov random field is used to model the distribution of the final output textures. Finally, an output texture is generated from the sampled Markov random field distribution. At the bottom level of the Bayesian hierarchy, the isotropic and ergodic characteristics of the textures favor a construction that consists of a fully convolutional network. The proposed method integrates texture creation and texture synthesis into one pipeline for real-time texture generation, and enables users to readily obtain diverse textures with arbitrary scales from high-level guidance only. Extensive experiments demonstrate that the proposed method is capable of generating plausible textures that are faithful to user-defined control, and achieving impressive texture metamorphosis by interpolation in the learned texture manifold.

STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar?

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

Non-stationary texture synthesis by adversarial expansion

GramGAN: Deep 3D Texture Synthesis From 2D Exemplars

Skeletal Texture Synthesis

Solid Texture Synthesis from 2D Exemplars

Texture Synthesis with Spatial Generative Adversarial Networks

Texture Representation via Analysis and Synthesis with Generative Adversarial Networks

Sketch Guided Solid Texturing

ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositing

Pseudo Surface-Texture Synthesis.

Dual Stage Augmented Colorful Texture Synthesis from Hand Sketch

Arbitrary-Scale Texture Generation From Coarse-Grained Control

GAGCN: Generative Adversarial Graph Convolutional Network for Non-Homogeneous Texture Extension Synthesis

Learning Texture Manifolds with the Periodic Spatial GAN

CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes

DTSGAN: Learning Dynamic Textures via Spatiotemporal Generative Adversarial Network

Three-Dimensional Multiscale Texture Synthesis

High Quality Solid Texture Synthesis Using Position and Index Histogram Matching

Stationary Dynamic Texture Synthesis Using Convolutional Neural Networks

GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generation