C$\cdot$ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characters

Zhiyang Dou,Xuelin Chen,Qingnan Fan,Taku Komura,Wenping Wang

DOI: https://doi.org/10.1145/3610548.3618205

2023-09-20

Abstract:We present C$\cdot$ASE, an efficient and effective framework that learns conditional Adversarial Skill Embeddings for physics-based characters. Our physically simulated character can learn a diverse repertoire of skills while providing controllability in the form of direct manipulation of the skills to be performed. C$\cdot$ASE divides the heterogeneous skill motions into distinct subsets containing homogeneous samples for training a low-level conditional model to learn conditional behavior distribution. The skill-conditioned imitation learning naturally offers explicit control over the character's skills after training. The training course incorporates the focal skill sampling, skeletal residual forces, and element-wise feature masking to balance diverse skills of varying complexities, mitigate dynamics mismatch to master agile motions and capture more general behavior characteristics, respectively. Once trained, the conditional model can produce highly diverse and realistic skills, outperforming state-of-the-art models, and can be repurposed in various downstream tasks. In particular, the explicit skill control handle allows a high-level policy or user to direct the character with desired skill specifications, which we demonstrate is advantageous for interactive character animation.

Graphics,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper aims to address the challenges faced by physics-based characters (such as game characters or animated characters) when learning multiple skills. Specifically:

1. **Learning Diverse Skills**: Existing methods tend to suffer from mode collapse when dealing with diverse skills, meaning the model fails to capture the full diversity of all skills. The paper proposes a new training paradigm to solve this issue.

2. **Controllability**: Current models often lack the ability to directly control skills, meaning users cannot specify the exact skill they want to execute. The framework proposed in this paper addresses this problem through Conditional Adversarial Skill Embeddings (C·ASE).

3. **Efficient Learning**: To effectively and efficiently learn a large number of diverse skills, the paper introduces techniques such as Focal Skill Sampling (FSS), Skeletal Residual Forces (SRF), and Element-wise Feature Masking (EFM).

The proposed C·ASE framework is capable of maintaining skill diversity while providing explicit control over skills. It demonstrates superior performance in multiple experiments, particularly in the application of interactive character animation. Additionally, the framework can generate high-quality, diverse motions and supports interactive control by allowing users to specify skill labels.