Abstract:The overall pipeline of our proposed method. The skeleton data is first input into RGCN to obtain basic feature expressions. RGCN can learn more spatial motion information of actions. Features with different temporal resolutions are then modulated in the temporal and spatial dimensions and aggregated into features with rich discriminative temporal information for final classification. Skeleton‐based human action recognition is gaining significant attention and finding widespread application in various fields, such as virtual reality and human‐computer interaction systems. Recent studies have highlighted the effectiveness of graph convolutional network (GCN) based methods in this task, leading to a remarkable improvement in prediction accuracy. However, most GCN‐based methods overlook the varying contributions of self, centripetal and centrifugal subsets. Besides, only a single‐scale temporal feature is adopted, and the multi‐temporal scale information is ignored. To this end, firstly, in order to differentiate the importance of different skeleton subsets, we develop a refinement graph convolution, which can adaptively learn a weight for each subset feature. Secondly, a multi‐temporal scale aggregation module is proposed to extract more discriminative temporal dynamic information. Furthermore, a multi‐temporal scale aggregation refinement graph convolutional network (MTSA‐RGCN) is proposed, and four‐stream structure is also adopted in this paper, which can comprehensively model complementary features and eventually achieves a significant performance boost. In the empirical experiments, the performance of our approach has been greatly improved on both NTU‐RGB+D 60 and NTU‐RGB+D 120 datasets, compared to other state‐of‐the‐art methods.

SlowFast-GCN: A Novel Skeleton-Based Action Recognition Framework

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Spatial‐temporal Slowfast Graph Convolutional Network for Skeleton‐based Action Recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Selective Hypergraph Convolutional Networks for Skeleton-based Action Recognition

Skeleton-Based Action Recognition With Low-Level Features of Adaptive Graph Convolutional Networks

Temporal Refinement Graph Convolutional Network for Skeleton-based Action Recognition

Temporal Enhanced Multi-Stream Graph Convolutional Nerual Networks For Skeleton-Based Action Recognition

Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition

Forward-reverse adaptive graph convolutional networks for skeleton-based action recognition

Multi-scale Gated Graph Convolutional Network for Skeleton-based Action Recognition

Richly Activated Graph Convolutional Network for Robust Skeleton-Based Action Recognition

A Multi-Stream Graph Convolutional Networks-Hidden Conditional Random Field Model for Skeleton-Based Action Recognition

Rethinking the ST-GCNs for 3D skeleton-based human action recognition

Enhanced Spatial and Extended Temporal Graph Convolutional Network for Skeleton-Based Action Recognition

Multi‐temporal scale aggregation refinement graph convolutional network for skeleton‐based action recognition

DD-GCN: Directed Diffusion Graph Convolutional Network for Skeleton-based Human Action Recognition

Part-Wise Adaptive Topology Graph Convolutional Network for Skeleton-Based Action Recognition

Skeleton action recognition via graph convolutional network with self-attention module

Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition.