Abstract:This paper presents a Surface-Aligned Gaussian representation for creating animatable human avatars from monocular videos,aiming at improving the novel view and pose synthesis performance while ensuring fast training and real-time rendering. Recently,3DGS has emerged as a more efficient and expressive alternative to NeRF, and has been used for creating dynamic human avatars. However,when applied to the severely ill-posed task of monocular dynamic reconstruction, the Gaussians tend to overfit the constantly changing regions such as clothes wrinkles or shadows since these regions cannot provide consistent supervision, resulting in noisy geometry and abrupt deformation that typically fail to generalize under novel views and <a class="link-external link-http" href="http://poses.To" rel="external noopener nofollow">this http URL</a> address these limitations, we present SAGA,i.e.,Surface-Aligned Gaussian Avatar,which aligns the Gaussians with a mesh to enforce well-defined geometry and consistent deformation, thereby improving generalization under novel views and poses. Unlike existing strict alignment methods that suffer from limited expressive power and low realism,SAGA employs a two-stage alignment strategy where the Gaussians are first adhered on while then detached from the mesh, thus facilitating both good geometry and high expressivity. In the Adhered Stage, we improve the flexibility of Adhered-on-Mesh Gaussians by allowing them to flow on the mesh, in contrast to existing methods that rigidly bind Gaussians to fixed location. In the second Detached Stage, we introduce a Gaussian-Mesh Alignment regularization, which allows us to unleash the expressivity by detaching the Gaussians but maintain the geometric alignment by minimizing their location and orientation offsets from the bound triangles. Finally, since the Gaussians may drift outside the bound triangles during optimization, an efficient Walking-on-Mesh strategy is proposed to dynamically update the bound triangles.

GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning

GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning

GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians

GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

Generalizable and Animatable Gaussian Head Avatar

E^3Gen: Efficient, Expressive and Editable Avatars Generation

GASP: Gaussian Avatars with Synthetic Priors

Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars

Animatable and Relightable Gaussians for High-fidelity Human Avatar Modeling

$E^{3}$Gen: Efficient, Expressive and Editable Avatars Generation

Deformable 3D Gaussian Splatting for Animatable Human Avatars

Interactive Rendering of Relightable and Animatable Gaussian Avatars

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling

SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splatting

GGAvatar: Geometric Adjustment of Gaussian Head Avatar

NPGA: Neural Parametric Gaussian Avatars

SAGA: Surface-Aligned Gaussian Avatar

Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilities

MixedGaussianAvatar: Realistically and Geometrically Accurate Head Avatar via Mixed 2D-3D Gaussian Splatting

Expressive Whole-Body 3D Gaussian Avatar