Abstract:Action recognition is essential for many human-centered applications in the Internet of Things (IoT). Especially, in the Internet of Medical Things (IoMT), action recognition shows great importance in surgical assistance, patient monitoring, etc. Recently, 3-D skeleton sequence-based action recognition draws broad attention. It is a challenging task that needs effective modeling on intraframe skeleton representations and interframe temporal dynamics. Standard long short-term memory (LSTM)-based models are widely used for sequence modeling due to its long-term memory, yet they are unable to fully model the relationship between different body joints or persons to extract crucial co-occurrence features from different levels. To handle this shortcoming, we propose an attention-based multilevel co-occurrence graph convolutional LSTM (AMCGC-LSTM). By integrating graph convolutional networks (GCNs) into LSTM, the proposed model is capable of leveraging body structural information from skeletons and strengthening the multilevel co-occurrence (MC) feature learning. Specifically, we first design the spatial attention module for feature enhancement of key joints from skeleton inputs. Second, we design MC memory units coupled with GCN to automatically model the spatial relationship between joints, and simultaneously capture the co-occurrence features from different joints, persons, and frames. Finally, we construct aggregated features of MCs (AFMCs) from MC memory units to better represent the intraframe action context encoding, and leverage a concurrent LSTM (Co-LSTM) to further model their temporal dynamics for action recognition. Our model significantly outperforms mainstream methods on NTU RGB+D 60/120 data set, mutual action subset of NTU RGB+D 60/120 data set, and Northewestern-UCLA data set.

A Skeleton-based Action Recognition System for Medical Condition Detection

MC-LSTM: Real-Time 3D Human Action Detection System for Intelligent Healthcare Applications

Lidar-Based Action-Recognition Algorithm for Medical Quality Control

Efficient Skeleton-Based Action Recognition Via Multi-Stream Depthwise Separable Convolutional Neural Network

SkelMamba: A State Space Model for Efficient Skeleton Action Recognition of Neurological Disorders

Skeleton-based Action Recognition Using LSTM and CNN

View Adaptive Recurrent Neural Networks for High Performance Human Action Recognition from Skeleton Data

Skeleton-based Human Action Recognition by Fusing Attention Based Three-Stream Convolutional Neural Network and SVM.

Skeleton-based Human Action Recognition via Large-kernel Attention Graph Convolutional Network

An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition

View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognition

Action Recognition Based on 3D Skeleton and RGB Frame Fusion

Skeleton-Based Human Action Recognition with Global Context-Aware Attention LSTM Networks

Skeleton-Indexed Deep Multi-Modal Feature Learning for High Performance Human Action Recognition

Skeleton-based Attention-Aware Spatial-Temporal Model for Action Detection and Recognition.

Spatio-Temporal Attention Deep Network for Skeleton Based View-Invariant Human Action Recognition

Dynamic Edge Convolutional Neural Network for Skeleton-Based Human Action Recognition

Skeleton-Based Action Recognition Based on Distance Vector and Multihigh View Adaptive Networks

Action Recognition Based on Multi-Level Topological Channel Attention of Human Skeleton

Attention-Based Multilevel Co-Occurrence Graph Convolutional LSTM for 3-D Action Recognition

Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates