Abstract:This paper proposes a fully-automatic, text-guided generative method for producing perfectly-repeating, periodic, tile-able 2D imagery, such as the one seen on floors, mosaics, ceramics, and the work of M.C. Escher. In contrast to square texture images that are seamless when tiled, our method generates non-square tilings which comprise solely of repeating copies of the same object. It achieves this by optimizing both geometry and texture of a 2D mesh, yielding a non-square tile in the shape and appearance of the desired object, with close to no additional background details, that can tile the plane without gaps nor overlaps. We enable optimization of the tile's shape by an unconstrained, differentiable parameterization of the space of all valid tileable meshes for given boundary conditions stemming from a symmetry group. Namely, we construct a differentiable family of linear systems derived from a 2D mesh-mapping technique - Orbifold Tutte Embedding - by considering the mesh's Laplacian matrix as differentiable parameters. We prove that the solution space of these linear systems is exactly all possible valid tiling configurations, thereby providing an end-to-end differentiable representation for the entire space of valid tiles. We render the textured mesh via a differentiable renderer, and leverage a pre-trained image diffusion model to induce a loss on the resulting image, updating the mesh's parameters so as to make its appearance match the text prompt. We show our method is able to produce plausible, appealing results, with non-trivial tiles, for a variety of different periodic tiling patterns.

Self-coherent tile set for texture generation

A Constrained Multi-sample Texture Synthesis Algorithm Based on Random Expanding of Circular Patches

Using Texture Synthesis in Fractal Pattern Design

Real-Time Texture Synthesis Using S-Tile Set

Fast Texture Synthesis Using Multiple Seeds As Constraints

Skeletal Texture Synthesis

SeamlessGAN: Self-Supervised Synthesis of Tileable Texture Maps

Periodic Pattern of Texture Analysis and Synthesis Based on Texels Distribution

Order-Independent Texture Synthesis

Generating Textures of Irregular Objects from Models and Photo Sequences

Texture synthesis based on minimum energy cut and its applications

Texture Evolution: 3D Texture Synthesis from Single 2D Growable Texture Pattern

Fast Texture Synthesis Based on Coherence of Neighboring Sub-Patches

Co-occurrence based texture synthesis

Generative Escher Meshes

Appearance and geometry completion with constrained texture synthesis

Texture Synthesis with User-Guided Variance

Cutting and Pasting Irregularly Shaped Patches for Texture Synthesis

Texture Synthesis And Texture Mixing Using Random Lines

Inverse Texture Synthesis

Content-aware Tile Generation using Exterior Boundary Inpainting