Abstract:Learning natural and diverse behaviors from human motion datasets remains challenging in physics-based character control. Existing conditional adversarial models often suffer from tight and biased embedding distributions where embeddings from the same motion are closely grouped in a small area and shorter motions occupy even less space. Our empirical observations indicate this limits the representational capacity and diversity under each skill. An ideal latent space should be maximally packed by all motion's embedding clusters. In this paper, we propose a skill-conditioned controller that learns diverse skills with expressive variations. Our approach leverages the Neural Collapse phenomenon, a natural outcome of the classification-based encoder, to uniformly distributed cluster centers. We additionally propose a novel Embedding Expansion technique to form stylistic embedding clusters for diverse skills that are uniformly distributed on a hypersphere, maximizing the representational area occupied by each skill and minimizing unmapped regions. This maximally packed and uniformly distributed embedding space ensures that embeddings within the same cluster generate behaviors conforming to the characteristics of the corresponding motion clips, yet exhibiting noticeable variations within each cluster. Compared to existing methods, our controller not only generates high-quality, diverse motions covering the entire dataset but also achieves superior controllability, motion coverage, and diversity under each skill. Both qualitative and quantitative results confirm these traits, enabling our controller to be applied to a wide range of downstream tasks and serving as a cornerstone for diverse applications.

Supervised Learning of Motion Style for Real-time Synthesis of 3D Character Animations

Key-styling: learning motion style for real-time synthesis of 3D animation

Key-styling: learning motion style for real-time synthesis of 3D animation: Research Articles

Learning Style-Directed Dynamics Of Human Motion For Automatic Motion Synthesis

Real-Time Synthesis of 3d Animations by Learning Parametric Gaussians Using Self-Organizing Mixture Networks

3D Human Motion Synthesis Based on Nonlinear Manifold Learning

Style Synthesis and Editing of Motion Data in Non-Linear Subspace

Motion Synthesis Using Style-Editable Inverse Kinematics

The SOMN-HMM Model and Its Application to Automatic Synthesis of 3D Character Animations

Autoregressive Stylized Motion Synthesis with Generative Flow

Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phases

Towards 3D Dance Motion Synthesis and Control

Style Subspaces for Character Animation

Generative Human Motion Stylization in Latent Space

Example-Based Automatic Music-Driven Conventional Dance Motion Synthesis

Learning Uniformly Distributed Embedding Clusters of Stylistic Skills for Physically Simulated Characters

Learning A Highly Structured Motion Model for 3D Human Tracking (Draft)

Algorithm for Real-time Style Transfer for Human Motion

Editing and Synthesis of 3D Facial Animation by Motion Propagation and Isomap Analysis

A Stylistic Human Motion Editing System Based on A Subspace Motion Model

A Hierarchical Geostatistical Model Of Walking Style Variety