Abstract:Action recognition is essential for many human-centered applications in the Internet of Things (IoT). Especially, in the Internet of Medical Things (IoMT), action recognition shows great importance in surgical assistance, patient monitoring, etc. Recently, 3-D skeleton sequence-based action recognition draws broad attention. It is a challenging task that needs effective modeling on intraframe skeleton representations and interframe temporal dynamics. Standard long short-term memory (LSTM)-based models are widely used for sequence modeling due to its long-term memory, yet they are unable to fully model the relationship between different body joints or persons to extract crucial co-occurrence features from different levels. To handle this shortcoming, we propose an attention-based multilevel co-occurrence graph convolutional LSTM (AMCGC-LSTM). By integrating graph convolutional networks (GCNs) into LSTM, the proposed model is capable of leveraging body structural information from skeletons and strengthening the multilevel co-occurrence (MC) feature learning. Specifically, we first design the spatial attention module for feature enhancement of key joints from skeleton inputs. Second, we design MC memory units coupled with GCN to automatically model the spatial relationship between joints, and simultaneously capture the co-occurrence features from different joints, persons, and frames. Finally, we construct aggregated features of MCs (AFMCs) from MC memory units to better represent the intraframe action context encoding, and leverage a concurrent LSTM (Co-LSTM) to further model their temporal dynamics for action recognition. Our model significantly outperforms mainstream methods on NTU RGB+D 60/120 data set, mutual action subset of NTU RGB+D 60/120 data set, and Northewestern-UCLA data set.

3D Action Recognition Using Data Visualization and Convolutional Neural Networks.

3D Action Recognition Using Multi-Temporal Skeleton Visualization.

Skeleton-Based Human Action Recognition Using Spatial Temporal 3D Convolutional Neural Networks

Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks

Two-Stream 3D Convolutional Neural Network for Skeleton-Based Action Recognition

A New Representation of Skeleton Sequences for 3D Action Recognition

Action Recognition Based on Joint Trajectory Maps with Convolutional Neural Networks

Skeleton-based Action Recognition Using LSTM and CNN

Spatio–Temporal Image Representation of 3D Skeletal Movements for View-Invariant Action Recognition with Deep Convolutional Neural Networks

A Survey on 3D Skeleton-Based Action Recognition Using Learning Method

End-to-end Learning of Deep Convolutional Neural Network for 3D Human Action Recognition

Deep spatiotemporal LSTM network with temporal pattern feature for 3D human action recognition

A Fine-to-Coarse Convolutional Neural Network for 3D Human Action Recognition

Skeleton-Based Square Grid for Human Action Recognition With 3D Convolutional Neural Network

Attention-Based Multilevel Co-Occurrence Graph Convolutional LSTM for 3-D Action Recognition

Self-Supervised 3D Action Representation Learning With Skeleton Cloud Colorization

Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networks

Exploiting deep residual networks for human action recognition from skeletal data

Deep Convolutional Neural Networks for Action Recognition Using Depth Map Sequences

3D Convolutional Neural Network for Action Recognition.

Part-wise Spatio-temporal Attention Driven CNN-based 3D Human Action Recognition