Abstract:Action recognition is essential for many human-centered applications in the Internet of Things (IoT). Especially, in the Internet of Medical Things (IoMT), action recognition shows great importance in surgical assistance, patient monitoring, etc. Recently, 3-D skeleton sequence-based action recognition draws broad attention. It is a challenging task that needs effective modeling on intraframe skeleton representations and interframe temporal dynamics. Standard long short-term memory (LSTM)-based models are widely used for sequence modeling due to its long-term memory, yet they are unable to fully model the relationship between different body joints or persons to extract crucial co-occurrence features from different levels. To handle this shortcoming, we propose an attention-based multilevel co-occurrence graph convolutional LSTM (AMCGC-LSTM). By integrating graph convolutional networks (GCNs) into LSTM, the proposed model is capable of leveraging body structural information from skeletons and strengthening the multilevel co-occurrence (MC) feature learning. Specifically, we first design the spatial attention module for feature enhancement of key joints from skeleton inputs. Second, we design MC memory units coupled with GCN to automatically model the spatial relationship between joints, and simultaneously capture the co-occurrence features from different joints, persons, and frames. Finally, we construct aggregated features of MCs (AFMCs) from MC memory units to better represent the intraframe action context encoding, and leverage a concurrent LSTM (Co-LSTM) to further model their temporal dynamics for action recognition. Our model significantly outperforms mainstream methods on NTU RGB+D 60/120 data set, mutual action subset of NTU RGB+D 60/120 data set, and Northewestern-UCLA data set.

Energy-Based Global Ternary Image for Action Recognition Using Sole Depth Sequences

3D Action Recognition Using Multi-scale Energy-based Global Ternary Image

Entropy Guided Attention Network for Weakly-Supervised Action Localization.

3D Action Recognition Using Multi-Temporal Depth Motion Maps and Fisher Vector

Action Recognition from Depth Sequences Using Weighted Fusion of 2D and 3D Auto-Correlation of Gradients Features

3D Action Recognition Using Multi-Temporal Skeleton Visualization.

Action Recognition In Rgb-D Egocentric Videos

Energy-Guided Temporal Segmentation Network for Multimodal Human Action Recognition

Human action recognition using Adaptive Hierarchical Depth Motion Maps and Gabor filter

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Recognizing actions using depth motion maps-based histograms of oriented gradients

Learning Informative Pairwise Joints with Energy-Based Temporal Pyramid for 3D Action Recognition

Trear: Transformer-Based RGB-D Egocentric Action Recognition

Grouped Temporal Enhancement Module for Human Action Recognition

Multi-Temporal Depth Motion Maps-Based Local Binary Patterns for 3-D Human Action Recognition

Empowering Efficient Spatio-Temporal Learning with a 3D CNN for Pose-Based Action Recognition

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

Attention-Based Multilevel Co-Occurrence Graph Convolutional LSTM for 3-D Action Recognition

3D human action analysis and recognition through GLAC descriptor on 2D motion and static posture images

Deep Convolutional Neural Networks for Action Recognition Using Depth Map Sequences

Global Context-Aware Attention LSTM Networks for 3D Action Recognition.