Abstract:Text-to-3D, known for its efficient generation methods and expansive creative potential, has garnered significant attention in the AIGC domain. However, the amalgamation of Nerf and 2D diffusion models frequently yields oversaturated images, posing severe limitations on downstream industrial applications due to the constraints of pixelwise rendering method. Gaussian splatting has recently superseded the traditional pointwise sampling technique prevalent in NeRF-based methodologies, revolutionizing various aspects of 3D reconstruction. This paper introduces a novel text to 3D content generation framework based on Gaussian splatting, enabling fine control over image saturation through individual Gaussian sphere transparencies, thereby producing more realistic images. The challenge of achieving multi-view consistency in 3D generation significantly impedes modeling complexity and accuracy. Taking inspiration from SJC, we explore employing multi-view noise distributions to perturb images generated by 3D Gaussian splatting, aiming to rectify inconsistencies in multi-view geometry. We ingeniously devise an efficient method to generate noise that produces Gaussian noise from diverse viewpoints, all originating from a shared noise source. Furthermore, vanilla 3D Gaussian-based generation tends to trap models in local minima, causing artifacts like floaters, burrs, or proliferative elements. To mitigate these issues, we propose the variational Gaussian splatting technique to enhance the quality and stability of 3D appearance. To our knowledge, our approach represents the first comprehensive utilization of Gaussian splatting across the entire spectrum of 3D content generation processes.

TexOct: Generating Textures of 3D Models with Octree-based Diffusion

Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models

Texture Generation on 3D Meshes with Point-UV Diffusion

Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models

TexPainter: Generative Mesh Texturing with Multi-view Consistency

TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models

UV-free Texture Generation with Denoising and Geodesic Heat Diffusions

Text2Tex: Text-driven Texture Synthesis via Diffusion Models

TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling

OctFusion: Octree-based Diffusion Models for 3D Shape Generation

Text-Guided Texturing by Synchronized Multi-View Diffusion

GenesisTex: Adapting Image Denoising Diffusion to Texture Space

TexRO: Generating Delicate Textures of 3D Models by Recursive Optimization

TEXGen: a Generative Diffusion Model for Mesh Textures

Consistent Mesh Diffusion

GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generation

GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise

Text-guided High-definition Consistency Texture Model

TEXTure: Text-Guided Texturing of 3D Shapes

EucliDreamer: Fast and High-Quality Texturing for 3D Models with Depth-Conditioned Stable Diffusion