Abstract:The overall pipeline of our proposed method. The skeleton data is first input into RGCN to obtain basic feature expressions. RGCN can learn more spatial motion information of actions. Features with different temporal resolutions are then modulated in the temporal and spatial dimensions and aggregated into features with rich discriminative temporal information for final classification. Skeleton‐based human action recognition is gaining significant attention and finding widespread application in various fields, such as virtual reality and human‐computer interaction systems. Recent studies have highlighted the effectiveness of graph convolutional network (GCN) based methods in this task, leading to a remarkable improvement in prediction accuracy. However, most GCN‐based methods overlook the varying contributions of self, centripetal and centrifugal subsets. Besides, only a single‐scale temporal feature is adopted, and the multi‐temporal scale information is ignored. To this end, firstly, in order to differentiate the importance of different skeleton subsets, we develop a refinement graph convolution, which can adaptively learn a weight for each subset feature. Secondly, a multi‐temporal scale aggregation module is proposed to extract more discriminative temporal dynamic information. Furthermore, a multi‐temporal scale aggregation refinement graph convolutional network (MTSA‐RGCN) is proposed, and four‐stream structure is also adopted in this paper, which can comprehensively model complementary features and eventually achieves a significant performance boost. In the empirical experiments, the performance of our approach has been greatly improved on both NTU‐RGB+D 60 and NTU‐RGB+D 120 datasets, compared to other state‐of‐the‐art methods.

Structural Knowledge Distillation for Efficient Skeleton-Based Action Recognition

Enhancing Action Recognition from Low-Quality Skeleton Data via Part-Level Knowledge Distillation

Multi-Scale Enhanced Active Learning for Skeleton-Based Action Recognition

Temporal Refinement Graph Convolutional Network for Skeleton-based Action Recognition

Learning Discriminative Representations for Skeleton Based Action Recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

Multi‐temporal scale aggregation refinement graph convolutional network for skeleton‐based action recognition

Asymmetric information-regularized learning for skeleton-based action recognition

Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognition

Skeleton-Based Action Recognition With Low-Level Features of Adaptive Graph Convolutional Networks

Skeleton-Based Action Recognition With Directed Graph Neural Networks

Richly Activated Graph Convolutional Network for Robust Skeleton-Based Action Recognition

Effective skeleton topology and semantics-guided adaptive graph convolution network for action recognition

DSDC-GCN: Decoupled Static-Dynamic Co-occurrence Graph Convolutional Networks for Skeleton-Based Action Recognition

An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition

Optimized Skeleton-based Action Recognition via Sparsified Graph Regression

Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition

A light-weight skeleton human action recognition model with knowledge distillation for edge intelligent surveillance applications

Skeleton Based Action Recognition using a Stacked Denoising Autoencoder with Constraints of Privileged Information

Part-aware Prototypical Graph Network for One-shot Skeleton-based Action Recognition

Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning