Abstract:Human motion prediction is challenging due to the complex spatiotemporal feature modeling. Among all methods, graph convolution networks (GCNs) are extensively utilized because of their superiority in explicit connection modeling. Within a GCN, the graph correlation adjacency matrix drives feature aggregation, and thus, is the key to extracting predictive motion features. State-of-the-art methods decompose the spatiotemporal correlation into spatial correlations for each frame and temporal correlations for each joint. Directly parameterizing these correlations introduces redundant parameters to represent common relations shared by all frames and all joints. Besides, the spatiotemporal graph adjacency matrix is the same for different motion samples, and thus, cannot reflect samplewise correspondence variances. To overcome these two bottlenecks, we propose dynamic spatiotemporal decompose GC (DSTD-GC), which only takes 28.6% parameters of the state-of-the-art GC. The key of DSTD-GC is constrained dynamic correlation modeling, which explicitly parameterizes the common static constraints as a spatial/temporal vanilla adjacency matrix shared by all frames/joints and dynamically extracts correspondence variances for each frame/joint with an adjustment modeling function. For each sample, the common constrained adjacency matrices are fixed to represent generic motion patterns, while the extracted variances complete the matrices with specific pattern adjustments. Meanwhile, we mathematically reformulate GCs on spatiotemporal graphs into a unified form and find that DSTD-GC relaxes certain constraints of other GC, which contributes to a better representation capability. Moreover, by combining DSTD-GC with prior knowledge like body connection and temporal context, we propose a powerful spatiotemporal GCN called DSTD-GCN. On the Human3.6M, Carnegie Mellon University (CMU) Mocap, and 3D Poses in the Wild (3DPW) datasets, DSTD-GCN outperforms state-of-the-art methods by 3.9%-8.7% in prediction accuracy with 55.0%-96.9% fewer parameters. Codes are available at https://github.com/Jaakk0F/DSTD-GCN.

April-GCN: Adjacency Position-velocity Relationship Interaction Learning GCN for Human motion prediction

GCN with Pattern Affected Matrix in Human Motion Prediction

Spatio-Temporal Gating-Adjacency GCN for Human Motion Prediction

Spatio-Temporal Multi-Subgraph GCN for 3D Human Motion Prediction

AMHGCN: Adaptive multi-level hypergraph convolution network for human motion prediction

Dynamic Dense Graph Convolutional Network for Skeleton-based Human Motion Prediction

DMS-GCN: Dynamic Mutiscale Spatiotemporal Graph Convolutional Networks for Human Motion Prediction

MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Prediction

Geometric algebra-based multiview interaction networks for 3D human motion prediction

Learning Multiscale Correlations for Human Motion Prediction

Multimodal Vehicle Trajectory Prediction Based on Graph Convolutional Networks

Learning Constrained Dynamic Correlations in Spatiotemporal Graphs for Motion Prediction

Enhanced Spatial–temporal Dynamics in Pose Forecasting Through Multi-Graph Convolution Networks

3D Skeleton-Based Human Motion Prediction Using Spatial–temporal Graph Convolutional Network

Adaptive Spatial-Temporal Graph-Mixer for Human Motion Prediction

Multi-Scale Spatio-Temporal Aggregation Network for Human Motion Prediction.

Directed Acyclic Graph Neural Network for Human Motion Prediction

Multiscale Spatial and Temporal Learning for Human Motion Prediction

GGTr: An Innovative Framework for Accurate and Realistic Human Motion Prediction

Towards Accurate 3D Human Motion Prediction from Incomplete Observations