Abstract:Recent generative methods have revolutionized the way of human motion synthesis, such as Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and Denoising Diffusion Probabilistic Models (DMs). These methods have gained significant attention in human motion fields. However, there are still challenges in unconditionally generating highly diverse human motions from a given distribution. To enhance the diversity of synthesized human motions, previous methods usually employ deep neural networks (DNNs) to train a transport map that transforms Gaussian noise distribution into real human motion distribution. According to Figalli's regularity theory, the optimal transport map computed by DNNs frequently exhibits discontinuities. This is due to the inherent limitation of DNNs in representing only continuous maps. Consequently, the generated human motions tend to heavily concentrate on densely populated regions of the data distribution, resulting in mode collapse or mode mixture. To address the issues, we propose an efficient method called MOOT for unconditional human motion synthesis. First, we utilize a reconstruction network based on GRU and transformer to map human motions to latent space. Next, we employ convex optimization to match the noise distribution with the latent space distribution of human motions through the Optimal Transport (OT) map. Then, we combine the extended OT map with the generator of reconstruction network to generate new human motions. Thereby overcoming the issues of mode collapse and mode mixture. MOOT generates a latent code distribution that is well-behaved and highly structured, providing a strong motion prior for various applications in the field of human motion. Through qualitative and quantitative experiments, MOOT achieves state-of-the-art results surpassing the latest methods, validating its superiority in unconditional human motion generation.

Motion Generation Review: Exploring Deep Learning for Lifelike Animation with Manifold

Human Motion Generation: A Survey

3D Human Motion Synthesis Based on Nonlinear Manifold Learning

MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds

Human Motion Prediction Using Manifold-Aware Wasserstein GAN

GenMotion: Data-driven Motion Generators for Real-time Animation Synthesis

A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights

3D Skeleton-based Human Motion Prediction with Manifold-Aware GAN

Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance

Generating different realistic humanoid motion

Human Motion Modeling with Deep Learning: A Survey

Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modeling

Motion-Agent: A Conversational Framework for Human Motion Generation with LLMs

A Survey on Machine Learning in the Synthesis of Human Motions

Towards Efficient and Diverse Generative Model for Unconditional Human Motion Synthesis

Human Motion Transfer With 3D Constraints and Detail Enhancement

AMG: Avatar Motion Guided Video Generation

FG-MDM: Towards Zero-Shot Human Motion Generation via ChatGPT-Refined Descriptions

MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding

Machine Learning Approaches for 3D Motion Synthesis and Musculoskeletal Dynamics Estimation: A Survey