Abstract:Skeleton-based action recognition methods using complete human skeletons have achieved remarkable performance, but the performance of these methods could significantly deteriorate when critical joints or frames of the skeleton sequence are occluded or disrupted. However, the acquisition of incomplete and noisy human skeletons is inevitable in realistic environments. In order to strengthen the robustness of action recognition model, we propose an I mproved S patial T emporal G raph C onvolutional N etwork ( IST-GCN ) model, including three modules, namely Multi-dimension Adaptive Graph Convolutional Network (Md-AGCN), Enhanced Attention Mechanism (EAM) and Multi-Scale Temporal Convolutional Network (MS-TCN). Specifically, the Md-AGCN module can first adaptively adjust the graph structure according to different layers and the spatial dimension, temporal dimension, and channel dimension of different action samples to establish corresponding connections for long-range joints with dependencies. Then, the EAM module can focus on important information based on spatial domain, temporal domain and channel to further strengthen the dependencies between important joints. Finally, the MS-TCN module is used to enlarge the receptive field to extract more latent temporal dependencies. The comprehensive experiments on NTU-RGB+D and NTU-RGB+D 120 datasets demonstrate that our approach possesses outstanding performance in terms of both accuracy and robustness when skeleton samples are incomplete and noisy compared with the state-of-the-art (SOTA) approach. Moreover, the parameters and computational complexity of our model are far less than those of the existing approaches.

Mini-TKAGCN: a Lightweight Graph Convolutional Network Via Temporal Kernel Attention for Skeleton-Based Action Recognition

Graph transformer network with temporal kernel attention for skeleton-based action recognition

Temporal-Aware Graph Convolution Network for Skeleton-based Action Recognition.

Graph-Temporal LSTM Networks for Skeleton-Based Action Recognition

Temporal Attention-Augmented Graph Convolutional Network for Efficient Skeleton-Based Human Action Recognition

TFC-GCN: Lightweight Temporal Feature Cross-Extraction Graph Convolutional Network for Skeleton-Based Action Recognition

GAS-GCN: Gated Action-Specific Graph Convolutional Networks for Skeleton-Based Action Recognition.

Temporal‐enhanced graph convolution network for skeleton‐based action recognition

Kernel Attention Based Multi-scale Adaptive Graph Convolutional Neural Network for Skeleton-Based

Temporal Refinement Graph Convolutional Network for Skeleton-based Action Recognition

Multi-Scale Adaptive Aggregate Graph Convolutional Network for Skeleton-Based Action Recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

Temporal segment graph convolutional networks for skeleton-based action recognition

Skeleton-based Human Action Recognition via Large-kernel Attention Graph Convolutional Network

Adaptive Attention Memory Graph Convolutional Networks for Skeleton-Based Action Recognition

Spatial-Temporal Adaptive Graph Convolutional Network for Skeleton-Based Action Recognition.

TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potential

Temporal Enhanced Multi-Stream Graph Convolutional Nerual Networks For Skeleton-Based Action Recognition

Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition.

Temporal Graph Modeling for Skeleton-based Action Recognition

Multi-Scale Mixed Dense Graph Convolution Network for Skeleton-Based Action Recognition.