Abstract:Skeleton-based action recognition methods using complete human skeletons have achieved remarkable performance, but the performance of these methods could significantly deteriorate when critical joints or frames of the skeleton sequence are occluded or disrupted. However, the acquisition of incomplete and noisy human skeletons is inevitable in realistic environments. In order to strengthen the robustness of action recognition model, we propose an I mproved S patial T emporal G raph C onvolutional N etwork ( IST-GCN ) model, including three modules, namely Multi-dimension Adaptive Graph Convolutional Network (Md-AGCN), Enhanced Attention Mechanism (EAM) and Multi-Scale Temporal Convolutional Network (MS-TCN). Specifically, the Md-AGCN module can first adaptively adjust the graph structure according to different layers and the spatial dimension, temporal dimension, and channel dimension of different action samples to establish corresponding connections for long-range joints with dependencies. Then, the EAM module can focus on important information based on spatial domain, temporal domain and channel to further strengthen the dependencies between important joints. Finally, the MS-TCN module is used to enlarge the receptive field to extract more latent temporal dependencies. The comprehensive experiments on NTU-RGB+D and NTU-RGB+D 120 datasets demonstrate that our approach possesses outstanding performance in terms of both accuracy and robustness when skeleton samples are incomplete and noisy compared with the state-of-the-art (SOTA) approach. Moreover, the parameters and computational complexity of our model are far less than those of the existing approaches.

Enhanced Skeleton Visualization for View Invariant Human Action Recognition.

3D Action Recognition Using Multi-Temporal Skeleton Visualization.

Spatio-Temporal Attention Deep Network for Skeleton Based View-Invariant Human Action Recognition

Shifting Perspective to See Difference: A Novel Multi-View Method for Skeleton Based Action Recognition

View Adaptive Recurrent Neural Networks for High Performance Human Action Recognition from Skeleton Data

Skeleton based action recognition using translation-scale invariant image mapping and multi-scale deep cnn

A Novel View Attention Network for Skeleton Based Human Action Recognition*

3D Action Recognition Using Data Visualization and Convolutional Neural Networks.

Skeleton Focused Human Activity Recognition in RGB Video

View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognition

Fusing Shape and Motion Matrices for View Invariant Action Recognition Using 3D Skeletons

An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition

Spatio–Temporal Image Representation of 3D Skeletal Movements for View-Invariant Action Recognition with Deep Convolutional Neural Networks

Action Recognition with Domain Invariant Features of Skeleton Image

Skeleton-Indexed Deep Multi-Modal Feature Learning for High Performance Human Action Recognition

Skeleton-based action recognition by part-aware graph convolutional networks

Skeleton Image Representation for 3D Action Recognition based on Tree Structure and Reference Joints

Skepxels: Spatio-temporal Image Representation of Human Skeleton Joints for Action Recognition

Multiple temporal scale aggregation graph convolutional network for skeleton-based action recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

Skeleton edge motion networks for human action recognition