Abstract:Recent generative methods have revolutionized the way of human motion synthesis, such as Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and Denoising Diffusion Probabilistic Models (DMs). These methods have gained significant attention in human motion fields. However, there are still challenges in unconditionally generating highly diverse human motions from a given distribution. To enhance the diversity of synthesized human motions, previous methods usually employ deep neural networks (DNNs) to train a transport map that transforms Gaussian noise distribution into real human motion distribution. According to Figalli's regularity theory, the optimal transport map computed by DNNs frequently exhibits discontinuities. This is due to the inherent limitation of DNNs in representing only continuous maps. Consequently, the generated human motions tend to heavily concentrate on densely populated regions of the data distribution, resulting in mode collapse or mode mixture. To address the issues, we propose an efficient method called MOOT for unconditional human motion synthesis. First, we utilize a reconstruction network based on GRU and transformer to map human motions to latent space. Next, we employ convex optimization to match the noise distribution with the latent space distribution of human motions through the Optimal Transport (OT) map. Then, we combine the extended OT map with the generator of reconstruction network to generate new human motions. Thereby overcoming the issues of mode collapse and mode mixture. MOOT generates a latent code distribution that is well-behaved and highly structured, providing a strong motion prior for various applications in the field of human motion. Through qualitative and quantitative experiments, MOOT achieves state-of-the-art results surpassing the latest methods, validating its superiority in unconditional human motion generation.

Synthesis and Editing of Human Motion with Generative Human Motion Model

Multi-Resolution Generative Modeling of Human Motion from Limited Data

Example-based Motion Synthesis Via Generative Motion Matching

Searching Motion Graphs for Human Motion Synthesis.

Towards Efficient and Diverse Generative Model for Unconditional Human Motion Synthesis

GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion Generation

Generative Human Motion Stylization in Latent Space

Physics-based Human Motion Estimation and Synthesis from Videos

Motion Flow Matching for Human Motion Synthesis and Editing

Human Motion Generation with Multifactor Models

GUESS: GradUally Enriching SyntheSis for Text-Driven Human Motion Generation

MotionGPT: Human Motion Synthesis with Improved Diversity and Realism via GPT-3 Prompting

3D Human Motion Synthesis Based on Nonlinear Manifold Learning

Human Motion Generation: A Survey

Neural Motion Graph.

Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes

GenMotion: Data-driven Motion Generators for Real-time Animation Synthesis

Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance

Learning Hierarchical Non-Parametric Hidden Markov Model of Human Motion

Learning Generalizable Human Motion Generator with Reinforcement Learning