Abstract:This paper proposes a fully-automatic, text-guided generative method for producing perfectly-repeating, periodic, tile-able 2D imagery, such as the one seen on floors, mosaics, ceramics, and the work of M.C. Escher. In contrast to square texture images that are seamless when tiled, our method generates non-square tilings which comprise solely of repeating copies of the same object. It achieves this by optimizing both geometry and texture of a 2D mesh, yielding a non-square tile in the shape and appearance of the desired object, with close to no additional background details, that can tile the plane without gaps nor overlaps. We enable optimization of the tile's shape by an unconstrained, differentiable parameterization of the space of all valid tileable meshes for given boundary conditions stemming from a symmetry group. Namely, we construct a differentiable family of linear systems derived from a 2D mesh-mapping technique - Orbifold Tutte Embedding - by considering the mesh's Laplacian matrix as differentiable parameters. We prove that the solution space of these linear systems is exactly all possible valid tiling configurations, thereby providing an end-to-end differentiable representation for the entire space of valid tiles. We render the textured mesh via a differentiable renderer, and leverage a pre-trained image diffusion model to induce a loss on the resulting image, updating the mesh's parameters so as to make its appearance match the text prompt. We show our method is able to produce plausible, appealing results, with non-trivial tiles, for a variety of different periodic tiling patterns.

Nested Wave Function Collapse Enables Large-Scale Content Generation

Extend Wave Function Collapse to Large-Scale Content Generation

Puzzle-Level Generation with Simple-tiled and Graph-based Wave Function Collapse Algorithms

Fabricable Multi‐Scale Wang Tiles

Efficient Calculation of Large Finite Periodic Structures Based on Surface Wave Analysis

Triangular Mesh Generation on Free-Form Surfaces Based on Bubble Dynamics Simulation

Extreme-Scale High-Order WENO Simulations of 3-D Detonation Wave with 10 Million Cores

Utilizing WaveFunctionCollapse Algorithm for Procedural Generation of Terrains using Remotely Sensed Elevation Data

Hierarchically Composing Level Generators for the Creation of Complex Structures

An Efficient Texture Synthesis Algorithm Based on WT

Tree-Based Reconstructive Partitioning: A Novel Low-Data Level Generation Approach

Content-aware Tile Generation using Exterior Boundary Inpainting

Quantum Wave Function Collapse for Procedural Content Generation

Generative Escher Meshes

Hierarchical Collaborated Fireworks Algorithm

Example-based Large-Scale Marine Scene Authoring Using Wang Cubes

You-Only-Randomize-Once: Shaping Statistical Properties in Constraint-based PCG

DeepWarp: DNN-based Nonlinear Deformation.

A New Algorithm for Water Wave Animation

Scaling Mesh Generation via Compressive Tokenization

On bounded Wang tilings