Abstract:Humans exhibit complex motions that vary depending on the task that they are performing, the interactions they engage in, as well as subject-specific preferences. Therefore, forecasting future poses based on the history of the previous motions is a challenging task. This paper presents an innovative auxiliary-memory-powered deep neural network framework for the improved modelling of historical knowledge. Specifically, we disentangle subject-specific, task-specific, and other auxiliary information from the observed pose sequences and utilise these factorised features to query the memory. A novel Multi-Head knowledge retrieval scheme leverages these factorised feature embeddings to perform multiple querying operations over the historical observations captured within the auxiliary memory. Moreover, our proposed dynamic masking strategy makes this feature disentanglement process dynamic. Two novel loss functions are introduced to encourage diversity within the auxiliary memory while ensuring the stability of the memory contents, such that it can locate and store salient information that can aid the long-term prediction of future motion, irrespective of data imbalances or the diversity of the input data distribution. With extensive experiments conducted on two public benchmarks, Human3.6M and CMU-Mocap, we demonstrate that these design choices collectively allow the proposed approach to outperform the current state-of-the-art methods by significant margins: $>$ 17\% on the Human3.6M dataset and $>$ 9\% on the CMU-Mocap dataset.

Data-driven Generation Ofdecision TreebasedonEnsemble Multiple-instanc E Learning Formotionretrieval

Data-Driven Generation Of Decision Tree Based On Ensemble Multiple-Instance Learning For Motion Retrieval

Data-Driven Automatic Generation of Decision Tree for Motion Retrieval with Temporal-Spatial Features

Human Motion Retrieval with Time-squence Features Based on Data-driven Decision Tree Analysis

Performance-Driven Motion Retrieval and its Usability Evaluation

Ensemble Learning HMM for Motion Recognition and Retrieval by Isomap Dimension Reduction

Motion Retrieval Based On Movement Notation Language

3D Motion Retrieval with Motion Index Tree

Motion retrieval based on movement notation language: Motion Capture and Retrieval

Fine-Grained Retrieval of Sports Plays using Tree-Based Alignment of Trajectories

Sketch-based Human Motion Retrieval Via Selected 2D Geometric Posture Descriptor

A Perceptual User Interface For Motion Retrieval

3D Motion Retrieval Based on Example

Human motion retrieval based on freehand sketch

A Semantic Feature for Human Motion Retrieval

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Human Motion Capture Data Retrieval and Segmentation Technology for Professional Sports Training

Extracting Representative Motion Flows for Effective Video Retrieval

RMD: A Simple Baseline for More General Human Motion Generation via Training-free Retrieval-Augmented Motion Diffuse

Remembering What Is Important: A Factorised Multi-Head Retrieval and Auxiliary Memory Stabilisation Scheme for Human Motion Prediction

A Human Motion Feature Based on Semi-Supervised Learning of GMM