Abstract:Deep learning techniques have been employed to design a controllable human motion synthesizer. Despite their potential, however, designing a neural network-based motion synthesis that enables flexible user interaction, fine-grained controllability, and the support of new types of motions at reduced time and space consumption costs remains a challenge. In this paper, we propose a novel approach, a neural motion graph, that addresses the challenge by enabling scalability to new motions while using compact neural networks. Our approach represents each type of motion with a separate neural node to reduce the cost of adding new motion types. In addition, designing a separate neural node for each motion type enables task-specific control strategies and has greater potential to achieve a high-quality synthesis of complex motions, such as the Mongolian dance. Furthermore, a single transition network, which acts as neural edges, is used to model the transition between two motion nodes. The transition network is designed with a lightweight control module to achieve a fine-grained response to user control signals. Overall, the design choice makes the neural motion graph highly controllable and scalable. In addition to being fully flexible to user interaction through high-level and fine-grained user-control signals, our experimental and subjective evaluation results demonstrate that our proposed approach, neural motion graph, outperforms state-of-the-art human motion synthesis methods in terms of the quality of controlled motion generation.

A Neural Temporal Model for Human Motion Prediction

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Temporal Constrained Feasible Subspace Learning for Human Pose Forecasting

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Long-Term Human Motion Prediction with Scene Context

DMS-GCN: Dynamic Mutiscale Spatiotemporal Graph Convolutional Networks for Human Motion Prediction

Adversarial Refinement Network for Human Motion Prediction.

A Neuro-Symbolic Approach for Enhanced Human Motion Prediction

Neural Motion Graph.

A Data-Efficient Approach for Long-Term Human Motion Prediction Using Maps of Dynamics

Dynamic Future Net: Diversified Human Motion Generation

An Attractor-Guided Neural Networks for Skeleton-Based Human Motion Prediction

AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction

Probabilistic Human Motion Prediction Via A Bayesian Neural Network

Neural Ordinary Differential Equation for Irregular Human Motion Prediction

A Mixture of Experts Approach to 3D Human Motion Prediction

3D Human motion anticipation and classification

Multi-Transmotion: Pre-trained Model for Human Motion Prediction

Human motion trajectory prediction using the Social Force Model for real-time and low computational cost applications

Prediction of Human Motion with Motion Optimization and Neural Networks

Multi-level Motion Attention for Human Motion Prediction