Abstract:In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D model from different viewpoints. Yet, while depth-to-image models can create plausible textures from a single viewpoint, the stochastic nature of the generation process can cause many inconsistencies when texturing an entire 3D object. To tackle these problems, we dynamically define a trimap partitioning of the rendered image into three progression states, and present a novel elaborated diffusion sampling process that uses this trimap representation to generate seamless textures from different views. We then show that one can transfer the generated texture maps to new 3D geometries without requiring explicit surface-to-surface mapping, as well as extract semantic textures from a set of images without requiring any explicit reconstruction. Finally, we show that TEXTure can be used to not only generate new textures but also edit and refine existing textures using either a text prompt or user-provided scribbles. We demonstrate that our TEXTuring method excels at generating, transferring, and editing textures through extensive evaluation, and further close the gap between 2D image generation and 3D texturing.

Cylindrical Relief Textures Mapping.

Cylindrical Relief Texture Mapping

Generating Textures of Irregular Objects from Models and Photo Sequences

Relief Generation on Surfaces

An Image-Based Texture Mapping Technique for Apparel Products Exhibition and Interior Design

Interactive High Resolution Texture Mapping for the 3D Models of Cultural Heritages

Apparel Products Simulation Using Texture Mapping with Color Fidelity.

Texture Mapping on Real World Models from Multiple Photographic Images

Content-aware Texture Mapping

Unwrapping low-rank textures on generalized cylindrical surfaces

A new constrained texture mapping method

Relief Generation from 3D Scenes Guided by Geometric Texture Richness

A Multi-Channel Salience Based Detail Exaggeration Technique for 3D Relief Surfaces.

A Novel Constrained Texture Mapping Method Based on Harmonic Map

Animating texture-based images in visualizing curvilinear irregular vector fields

Interactive Texture Mapping for Polygonal Models

Planar Texture Rectification and Mapping Based on Reconstruction from Two Views

Realization of Textile Simulation System in 2D Virtual Environment

3D Texture Mapping in Multi-view Reconstruction

TEXTure: Text-Guided Texturing of 3D Shapes

Seamless Texture Mapping Algorithm for Image-Based Three-Dimensional Reconstruction