Abstract:Human motion prediction is a challenging task in human-centric computer vision, involving forecasting future poses based on historical sequences. Despite recent progress in modeling spatial-temporal relationships of motion sequences using complex structured graphs, few approaches have provided an adaptive and lightweight representation for varying graph structures of human motion. Taking inspiration from the advantages of MLP-Mixer, a lightweight architecture designed for learning complex interactions in multi-dimensional data, we explore its potential as a backbone for motion prediction. To this end, we propose a novel MLP-Mixer-based adaptive spatial-temporal pattern learning framework (M AST). Our framework includes an adaptive spatial mixer to model the spatial relationships between joints, an adaptive temporal mixer to learn temporal smoothness, and a local dynamic mixer to capture fine-grained cross-dependencies between joints of adjacent poses. The final method achieves a compact representation of human motion dynamics by adaptively considering spatial-temporal dependencies from coarse to fine. Unlike the trivial spatial-temporal MLP-Mixer, our proposed approach can more effectively capture both local and global spatial-temporal relationships simultaneously. We extensively evaluated our proposed framework on three commonly used benchmarks (Human3.6M, AMASS, 3DPW MoCap), demonstrating comparable or better performance than existing state-of-the-art methods in both short and long-term predictions, despite having significantly fewer parameters. Overall, our proposed framework provides a novel and efficient solution for human motion prediction with adaptive graph learning.

MLP-Pose: Human Pose Estimation by MLP-Mixer

Graph-Guided MLP-Mixer for Skeleton-Based Human Motion Prediction

Human Pose Estimation Based on Feature Enhancement and Multi-Scale Feature Fusion

MLP-JCG: Multi-Layer Perceptron with Joint-Coordinate Gating for Efficient 3D Human Pose Estimation

LMFormer: Lightweight and Multi-Feature Perspective Via Transformer for Human Pose Estimation

Complementary Feature Pyramid Network for Human Pose Estimation

Human Pose Estimation Based on Step Deep Convolution Neural Network.

GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation

MSPENet: Multi-Scale Adaptive Fusion and Position Enhancement Network for Human Pose Estimation

A Multi-Level Network for Human Pose Estimation

Human Pose Estimation Based on Lightweight Multi-Scale Coordinate Attention

M2AST:MLP-mixer-based adaptive spatial-temporal graph learning for human motion prediction

Three-dimensional Human Pose Estimation Based on Spatio-Temporal Multi-Feature Fusion Network

Human Pose Estimation Method Based On Flexible Model And Deep Learning

Multi-Scale Contrastive Learning for Human Pose Estimation

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Multi-Scale MLP-Mixer for image classification

Improved Modular Convolution Neural Network for Human Pose Estimation

A Multi-stage Feature Fusion Network for Human Pose Estimation

Multi-Scale Adaptive Structure Network For Human Pose Estimation From Color Images

Multi Hybrid Extractor Network for 3D Human Pose Estimation