Abstract:In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D model from different viewpoints. Yet, while depth-to-image models can create plausible textures from a single viewpoint, the stochastic nature of the generation process can cause many inconsistencies when texturing an entire 3D object. To tackle these problems, we dynamically define a trimap partitioning of the rendered image into three progression states, and present a novel elaborated diffusion sampling process that uses this trimap representation to generate seamless textures from different views. We then show that one can transfer the generated texture maps to new 3D geometries without requiring explicit surface-to-surface mapping, as well as extract semantic textures from a set of images without requiring any explicit reconstruction. Finally, we show that TEXTure can be used to not only generate new textures but also edit and refine existing textures using either a text prompt or user-provided scribbles. We demonstrate that our TEXTuring method excels at generating, transferring, and editing textures through extensive evaluation, and further close the gap between 2D image generation and 3D texturing.

Semiregular solid texturing from 2D image exemplars.

Solid Texture Synthesis from 2D Exemplars

Skeletal Texture Synthesis

A Constrained Multi-sample Texture Synthesis Algorithm Based on Random Expanding of Circular Patches

Generating Textures of Irregular Objects from Models and Photo Sequences

Sketch Guided Solid Texturing

Texture Evolution: 3D Texture Synthesis from Single 2D Growable Texture Pattern

Simulating vivid 3D solid textures from 2D growable patterns

Cutting and Pasting Irregularly Shaped Patches for Texture Synthesis

TEXTure: Text-Guided Texturing of 3D Shapes

Texture Synthesis with User-Guided Variance

Periodic Pattern of Texture Analysis and Synthesis Based on Texels Distribution

Vector Solid Textures

Pseudo Surface-Texture Synthesis.

Efficient Solid Texture Synthesis Using Gradient Solids

Optimization Technique of 2D Texture Synthesis

Salient Structural Elements Based Texture Synthesis

GPU-based Interactive Near-Regular Texture Synthesis for Digital Human Models.

By Example Synthesis of Three-Dimensional Porous Materials

High Quality Solid Texture Synthesis Using Position and Index Histogram Matching

Synthesis of Near-regular Natural Textures