Abstract:Human motion prediction is challenging due to the complex spatiotemporal feature modeling. Among all methods, graph convolution networks (GCNs) are extensively utilized because of their superiority in explicit connection modeling. Within a GCN, the graph correlation adjacency matrix drives feature aggregation and is the key to extracting predictive motion features. State-of-the-art methods decompose the spatiotemporal correlation into spatial correlations for each frame and temporal correlations for each joint. Directly parameterizing these correlations introduces redundant parameters to represent common relations shared by all frames and all joints. Besides, the spatiotemporal graph adjacency matrix is the same for different motion samples and cannot reflect sample-wise correspondence variances. To overcome these two bottlenecks, we propose dynamic spatiotemporal decompose GC (DSTD-GC), which only takes 28.6% parameters of the state-of-the-art GC. The key of DSTD-GC is constrained dynamic correlation modeling, which explicitly parameterizes the common static constraints as a spatial/temporal vanilla adjacency matrix shared by all frames/joints and dynamically extracts correspondence variances for each frame/joint with an adjustment modeling function. For each sample, the common constrained adjacency matrices are fixed to represent generic motion patterns, while the extracted variances complete the matrices with specific pattern adjustments. Meanwhile, we mathematically reformulate GCs on spatiotemporal graphs into a unified form and find that DSTD-GC relaxes certain constraints of other GC, which contributes to a better representation capability. By combining DSTD-GC with prior knowledge, we propose a powerful spatiotemporal GCN called DSTD-GCN, which outperforms SOTA methods by $3.9\% \sim 8.7\%$ in prediction accuracy with $55.0\% \sim 96.9\%$ fewer parameters.

Graph Learning for Spatiotemporal Dynamic Signal

Towards Dynamic Spatial-Temporal Graph Learning: A Decoupled Perspective

Graph-Free Learning in Graph-Structured Data: A More Efficient and Accurate Spatiotemporal Learning Perspective

Graph signal reconstruction based on spatio-temporal features learning

Time-varying graph learning from smooth and stationary graph signals with hidden nodes

A Differential Smoothness-based Compact-Dynamic Graph Convolutional Network for Spatiotemporal Signal Recovery

Learning Constrained Dynamic Correlations in Spatiotemporal Graphs for Motion Prediction

Effect of atorvastatin on intracellular calcium uptake in coronary smooth muscle cells from diabetic pigs fed an atherogenic diet.

Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection

Learning Spatiotemporal Graphical Models From Incomplete Observations

Sparse Graph Learning from Spatiotemporal Time Series

Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding

Spatio-Temporal Signal Recovery Based on Low Rank and Differential Smoothness

Dynamic Spatio-Temporal Feature Learning via Graph Convolution in 3D Convolutional Networks

Spatial-temporal Graph Convolutional Networks with Diversified Transformation for Dynamic Graph Representation Learning

Learning Decomposed Spatial Relations for Multi-Variate Time-Series Modeling.

Graph-based Reconstruction of Time-Varying Spatial Signals

Causal Adjacency Learning for Spatiotemporal Prediction Over Graphs

Dirichlet Graph Convolution Coupled Neural Differential Equation for Spatio-temporal Time Series Prediction

When Dynamic Causality Comes to Graph-Temporal Neural Network