Abstract:Extrapolating future human motion based on the historical human pose sequence is the foundation of various intelligent applications. Numerous deep learning-based algorithms have been designed to address this task, achieving state-of-the-art performance on different human motion benchmark datasets. However, most existing methods employ three-dimensional coordinates of joints to demonstrate dynamic motion contexts implicitly. Unfortunately, it remains challenging in capturing motion information from the pose sequence. In this paper, we advocate explicitly describing dynamic contexts via the momentum of human motion mechanic space, as the momentum of a joint is explicit, temporal consistent, and can provide abundant information to the model. In addition, the single-stream methods play a dominant role in the field of human motion prediction. They usually capture motion information via the strategy of continuous or sparse sampling, which might obviate global or detailed local information. Therefore, we present a simple yet effective dual-stream method that can consider both the detailed and global temporal information through a combination of continuous and sparse sampling. The proposed dual-stream paradigm enables the improvement of computational efficiency and the short-term prediction accuracy concurrently. Furthermore, we present a novel temporal attention-based graph convolutional network (TA-GCN) to derive a spatiotemporally consistent motion representation, which can adequately consider the rationality of human body topology. Extensive experiments on two large motion prediction benchmark datasets (i.e., Human 3.6M and CMU Mocap) show that our algorithm achieves state-of-the-art performance both qualitatively and quantitatively.

Multi-Mutual Consistency Induced Transfer Subspace Learning for Human Motion Segmentation

Temporal Constrained Feasible Subspace Learning for Human Pose Forecasting

Multi-motion Segmentation Via Co-attention-induced Heterogeneous Model Fitting

Segmentation and Completion of Human Motion Sequence via Temporal Learning of Subspace Variety Model

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Spatiotemporal Consistency Learning from Momentum Cues for Human Motion Prediction

Multi-Task Low-Rank and Sparse Matrix Recovery for Human Motion Segmentation

Multi-task learning for subspace segmentation

Leveraging Motion Priors in Videos for Improving Human Segmentation

Robust Multi-Body Motion Segmentation Based on Fuzzy K-Subspace Clustering

Learning Clustering for Motion Segmentation

Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment

One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing

Multi-Transmotion: Pre-trained Model for Human Motion Prediction

Multi-Domain and Multi-Task Learning for Human Action Recognition

Online Multi-Task Clustering For Human Motion Segmentation

Multiscale Residual Learning of Graph Convolutional Sequence Chunks for Human Motion Prediction

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

Human MotionFormer: Transferring Human Motions with Vision Transformers

Contour-Based Multi-Source Information Fusion for Motion Segmentation

Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories