Abstract:This paper presents a Surface-Aligned Gaussian representation for creating animatable human avatars from monocular videos,aiming at improving the novel view and pose synthesis performance while ensuring fast training and real-time rendering. Recently,3DGS has emerged as a more efficient and expressive alternative to NeRF, and has been used for creating dynamic human avatars. However,when applied to the severely ill-posed task of monocular dynamic reconstruction, the Gaussians tend to overfit the constantly changing regions such as clothes wrinkles or shadows since these regions cannot provide consistent supervision, resulting in noisy geometry and abrupt deformation that typically fail to generalize under novel views and <a class="link-external link-http" href="http://poses.To" rel="external noopener nofollow">this http URL</a> address these limitations, we present SAGA,i.e.,Surface-Aligned Gaussian Avatar,which aligns the Gaussians with a mesh to enforce well-defined geometry and consistent deformation, thereby improving generalization under novel views and poses. Unlike existing strict alignment methods that suffer from limited expressive power and low realism,SAGA employs a two-stage alignment strategy where the Gaussians are first adhered on while then detached from the mesh, thus facilitating both good geometry and high expressivity. In the Adhered Stage, we improve the flexibility of Adhered-on-Mesh Gaussians by allowing them to flow on the mesh, in contrast to existing methods that rigidly bind Gaussians to fixed location. In the second Detached Stage, we introduce a Gaussian-Mesh Alignment regularization, which allows us to unleash the expressivity by detaching the Gaussians but maintain the geometric alignment by minimizing their location and orientation offsets from the bound triangles. Finally, since the Gaussians may drift outside the bound triangles during optimization, an efficient Walking-on-Mesh strategy is proposed to dynamically update the bound triangles.

Animatable and Relightable Gaussians for High-fidelity Human Avatar Modeling

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling

GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians

Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars

Interactive Rendering of Relightable and Animatable Gaussian Avatars

GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning

UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modeling

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians

AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction

Generalizable and Animatable Gaussian Head Avatar

Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping

Deformable 3D Gaussian Splatting for Animatable Human Avatars

MixedGaussianAvatar: Realistically and Geometrically Accurate Head Avatar via Mixed 2D-3D Gaussian Splatting

Expressive Gaussian Human Avatars from Monocular RGB Video

Animatable 3D Gaussians for High-fidelity Synthesis of Human Motions.

Human Gaussian Splatting: Real-time Rendering of Animatable Avatars

SAGA: Surface-Aligned Gaussian Avatar

GAST: Sequential Gaussian Avatars with Hierarchical Spatio-temporal Context

Relightable and Animatable Neural Avatars from Videos