Abstract:We introduce TADA, a simple-yet-effective approach that takes textual descriptions and produces expressive 3D avatars with high-quality geometry and lifelike textures, that can be animated and rendered with traditional graphics pipelines. Existing text-based character generation methods are limited in terms of geometry and texture quality, and cannot be realistically animated due to inconsistent alignment between the geometry and the texture, particularly in the face region. To overcome these limitations, TADA leverages the synergy of a 2D diffusion model and an animatable parametric body model. Specifically, we derive an optimizable high-resolution body model from SMPL-X with 3D displacements and a texture map, and use hierarchical rendering with score distillation sampling (SDS) to create high-quality, detailed, holistic 3D avatars from text. To ensure alignment between the geometry and texture, we render normals and RGB images of the generated character and exploit their latent embeddings in the SDS training process. We further introduce various expression parameters to deform the generated character during training, ensuring that the semantics of our generated character remain consistent with the original SMPL-X model, resulting in an animatable character. Comprehensive evaluations demonstrate that TADA significantly surpasses existing approaches on both qualitative and quantitative measures. TADA enables creation of large-scale digital character assets that are ready for animation and rendering, while also being easily editable through natural language. The code will be public for research purposes.

X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generation

AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text

SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearance

AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation

GETAvatar: Generative Textured Meshes for Animatable Human Avatars

DivAvatar: Diverse 3D Avatar Generation with a Single Prompt

HeadSculpt: Crafting 3D Head Avatars with Text

DreamWaltz: Make a Scene with Complex 3D Animatable Avatars

Disentangled Clothed Avatar Generation from Text Descriptions

HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting

Guide3D: Create 3D Avatars from Text and Image Guidance

AgileAvatar: Stylized 3D Avatar Creation via Cascaded Domain Bridging

TADA! Text to Animatable Digital Avatars

X-Avatar: Expressive Human Avatars

UltrAvatar: A Realistic Animatable 3D Avatar Diffusion Model with Authenticity Guided Textures

DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion

InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation

HQ-Avatar: Towards High-Quality 3D Avatar Generation Via Point-based Representation

AvatarCLIP: zero-shot text-driven generation and animation of 3D avatars

Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute