Abstract:We present TextureDreamer, a novel image-guided texture synthesis method to transfer relightable textures from a small number of input images (3 to 5) to target 3D shapes across arbitrary categories. Texture creation is a pivotal challenge in vision and graphics. Industrial companies hire experienced artists to manually craft textures for 3D assets. Classical methods require densely sampled views and accurately aligned geometry, while learning-based methods are confined to category-specific shapes within the dataset. In contrast, TextureDreamer can transfer highly detailed, intricate textures from real-world environments to arbitrary objects with only a few casually captured images, potentially significantly democratizing texture creation. Our core idea, personalized geometry-aware score distillation (PGSD), draws inspiration from recent advancements in diffuse models, including personalized modeling for texture information extraction, variational score distillation for detailed appearance synthesis, and explicit geometry guidance with ControlNet. Our integration and several essential modifications substantially improve the texture quality. Experiments on real images spanning different categories show that TextureDreamer can successfully transfer highly realistic, semantic meaningful texture to arbitrary objects, surpassing the visual quality of previous state-of-the-art.

Simulating vivid 3D solid textures from 2D growable patterns

Texture Evolution: 3D Texture Synthesis from Single 2D Growable Texture Pattern

Generating Textures of Irregular Objects from Models and Photo Sequences

Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models

Fast Texture Synthesis Using Multiple Seeds As Constraints

Skeletal Texture Synthesis

Pseudo Surface-Texture Synthesis.

Solid Texture Synthesis from 2D Exemplars

Modeling and rendering of realistic waterfall scenes with dynamic texture sprites: Research Articles

Modeling And Rendering Of Realistic Waterfall Scenes With Dynamic Texture Sprites

Texture Synthesis with User-Guided Variance

TEXTure: Text-Guided Texturing of 3D Shapes

Synthesis of Progressively-Variant Textures on Arbitrary Surfaces

Make-A-Texture: Fast Shape-Aware Texture Generation in 3 Seconds

Three-Dimensional Multiscale Texture Synthesis

Synthesizing 2D Directional Moving Texture

An algorithm of 3D texture synthesis based on point cloud model

TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion

Semiregular solid texturing from 2D image exemplars.

Texture synthesis based on patch matching along spiral path

Algorithm of 3D Texture Synthesis Based on Point Set Model