Abstract:Learning natural and diverse behaviors from human motion datasets remains challenging in physics-based character control. Existing conditional adversarial models often suffer from tight and biased embedding distributions where embeddings from the same motion are closely grouped in a small area and shorter motions occupy even less space. Our empirical observations indicate this limits the representational capacity and diversity under each skill. An ideal latent space should be maximally packed by all motion's embedding clusters. In this paper, we propose a skill-conditioned controller that learns diverse skills with expressive variations. Our approach leverages the Neural Collapse phenomenon, a natural outcome of the classification-based encoder, to uniformly distributed cluster centers. We additionally propose a novel Embedding Expansion technique to form stylistic embedding clusters for diverse skills that are uniformly distributed on a hypersphere, maximizing the representational area occupied by each skill and minimizing unmapped regions. This maximally packed and uniformly distributed embedding space ensures that embeddings within the same cluster generate behaviors conforming to the characteristics of the corresponding motion clips, yet exhibiting noticeable variations within each cluster. Compared to existing methods, our controller not only generates high-quality, diverse motions covering the entire dataset but also achieves superior controllability, motion coverage, and diversity under each skill. Both qualitative and quantitative results confirm these traits, enabling our controller to be applied to a wide range of downstream tasks and serving as a cornerstone for diverse applications.

Guided Learning of Control Graphs for Physics-Based Characters

Learning Reduced-Order Feedback Policies for Motion Skills

Learning to Schedule Control Fragments for Physics-Based Characters Using Deep Q-Learning

Strategy and Skill Learning for Physics-based Table Tennis Animation

Learning basketball dribbling skills using trajectory optimization and deep reinforcement learning

Terrain runner: control, parameterization, composition, and planning for highly dynamic motions

DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills

PFPN: Continuous Control of Physically Simulated Characters using Particle Filtering Policy Network

Learning Uniformly Distributed Embedding Clusters of Stylistic Skills for Physically Simulated Characters

SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation

Learning Models For Constraint-Based Motion Parameterization From Interactive Physics-Based Simulation

Learning to schedule control fragments for physics-based character simulation and robots using deep q-learning

Complex Locomotion Skill Learning via Differentiable Physics

Fragment-Based Responsive Character Motion for Interactive Games

Learning Responsive Humanoid Motion Skills from Graph-Powered Motion Matching

Learning Control Policies for Imitating Human Gaits

Perpetual Humanoid Control for Real-time Simulated Avatars

ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characters

InsActor: Instruction-driven Physics-based Characters

Terrain Runner

SFV: Reinforcement Learning of Physical Skills from Videos