Abstract:Manually authoring transition animations for a complete locomotion system can be a tedious and time-consuming task, especially for large games that allow complex and constrained locomotion movements, where the number of transitions grows exponentially with the number of states. In this paper, we present a novel approach, based on deep recurrent neural networks, to automatically generate such transitions given a past context of a few frames and a target character state to reach. We present the Recurrent Transition Network (RTN), based on a modified version of the Long-Short-Term-Memory (LSTM) network, designed specifically for transition generation and trained without any gait, phase, contact or action labels. We further propose a simple yet principled way to initialize the hidden states of the LSTM layer for a given sequence which improves the performance and generalization to new motions. We both quantitatively and qualitatively evaluate our system and show that making the network terrain-aware by adding a local terrain representation to the input yields better performance for rough-terrain navigation on long transitions. Our system produces realistic and fluid transitions that rival the quality of Motion Capture-based ground-truth motions, even before applying any inverse-kinematics postprocess. Direct benefits of our approach could be to accelerate the creation of transition variations for large coverage, or even to entirely replace transition nodes in an animation graph. We further explore applications of this model in a animation super-resolution setting where we temporally decompress animations saved at 1 frame per second and show that the network is able to reconstruct motions that are hard to distinguish from un-compressed locomotion sequences.

A Fast Training Algorithm of Multiple-Timescale Recurrent Neural Network for Agent Motion Generation

Multiple Timescale Recurrent Neural Network with Slow Feature Analysis for Efficient Motion Recognition.

Supervised Multiple Timescale Recurrent Neuron Network Model for Human Action Classification.

Real-time human action classification using a dynamic neural model.

Continuous Motion Recognition Using Multiple Time Constant Recurrent Neural Network With A Deep Network Model

Parallel multi-stage rectification networks for 3D skeleton-based motion prediction

Robot-To-Human Handover with Obstacle Avoidance Via Continuous Time Recurrent Neural Network

Auto-Conditioned Recurrent Networks for Extended Complex Human Motion Synthesis

Efficient Human Motion Prediction Using Temporal Convolutional Generative Adversarial Network

Multitask Non-Autoregressive Model For Human Motion Prediction

A Multifunctional and Robust Learning Approach for Human Motion Modelling

DMS-GCN: Dynamic Mutiscale Spatiotemporal Graph Convolutional Networks for Human Motion Prediction

On human motion prediction using recurrent neural networks

Motion Learning and Rapid Generalization for Musculoskeletal Systems Based on Recurrent Neural Network Modulated by Initial States

Predictive Coding for Dynamic Vision : Development of Functional Hierarchy in a Multiple Spatio-Temporal Scales RNN Model

Human motion prediction with gated recurrent unit model of multi-dimensional input

A Distributed Varying-Parameter Recurrent Neural Network for Solving the Motion Generation Problem of a Multimanipulator Collaborative System

Motion Mamba: Efficient and Long Sequence Motion Generation

Multi-person/Group Interactive Video Generation

Recurrent Transition Networks for Character Locomotion

Recurrent Neural Network for Motion Trajectory Prediction in Human-Robot Collaborative Assembly