Abstract:To provide accessible, intelligent, and efficient remote access such as the internet of things, rehabilitation, autonomous driving, virtual games, and healthcare, human action recognition (HAR) has gained much attention among computer vision researchers. Several methods have already been addressed to ensure effective and efficient action recognition based on different perspectives including data modalities, feature design, network configuration, and application domains. In this article, we design a new deep learning model by integrating criss-cross attention and edge convolution to extract discriminative features from the skeleton sequence for action recognition. The attention mechanism is applied in spatial and temporal directions to pursue the intra- and inter-frame relationships. Then, several edge convolutional layers are conducted to explore the geometric relationships among the neighboring joints in the human body. The proposed model is dynamically updated after each layer by recomputing the graph on the basis of k-nearest joints for learning local and global information in action sequences. We used publicly available benchmark skeleton datasets such as UTD-MHAD (University of Texas at Dallas multimodal human action dataset) and MSR-Action3D (Microsoft action 3D) to evaluate the proposed method. We also investigated the proposed method with different configurations of network architectures to assure effectiveness and robustness. The proposed method achieved average accuracies of 99.53% and 95.64% on the UTD-MHAD and MSR-Action3D datasets, respectively, outperforming state-of-the-art methods.

Applied Human Action Recognition Network Based on SNSP Features

Action Recognition Using Interrelationships of 3D Joints and Frames Based on Angle Sine Relation and Distance Features Using Interrelationships

Human Action Recognition of Spatiotemporal Parameters for Skeleton Sequences Using MTLN Feature Learning Framework

Dynamic Edge Convolutional Neural Network for Skeleton-Based Human Action Recognition

Human Action Recognition Based on Kinematic Similarity in Real Time.

Joints-Centered Spatial-Temporal Features Fused Skeleton Convolution Network for Action Recognition

Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition

3d Human Action Recognition Based On The Spatial-Temporal Moving Skeleton Descriptor

Relation-mining Self-Attention Network for Skeleton-Based Human Action Recognition.

Semantic-guided multi-scale human skeleton action recognition

Spatio-Temporal Attention Deep Network for Skeleton Based View-Invariant Human Action Recognition

Spatiotemporal Progressive Inward-Outward Aggregation Network for skeleton-based action recognition

Skeleton-based Human Action Recognition by Fusing Attention Based Three-Stream Convolutional Neural Network and SVM.

Human Action Recognition Using Key Poses and Atomic Motions

Human Action Recognition in Unconstrained Trimmed Videos Using Residual Attention Network and Joints Path Signature.

Action Recognition Based on Multi-Level Topological Channel Attention of Human Skeleton

CNN-BASED ACTION RECOGNITION USING ADAPTIVE MULTISCALE DEPTH MOTION MAPS AND STABLE JOINT DISTANCE MAPS

Skeleton edge motion networks for human action recognition

Self-Attention Network for Skeleton-based Human Action Recognition

Keypoints-based Multimodal Network for Robust Human Action Recognition

Deep learning-based multi-view 3D-human action recognition using skeleton and depth data