Abstract:(1) A novel 2D human skeleton action recognition model with spatial constraints, named 2D‐SCHAR, is introduced to address the ambiguity and uncertainty associated with human action recognition in 2D surveillance videos. (2) These issues stem from the absence of depth information in the action data, thus we concentrate on two main challenges: depth estimation and spatial transformation, to enhance recognition accuracy. (3) The depth estimation component aims to reconstruct 3D action data from 2D inputs, while the spatial transformation employs spatial constraints to adjust and rectify the 3D action data. Human actions are predominantly presented in 2D format in video surveillance scenarios, which hinders the accurate determination of action details not apparent in 2D data. Depth estimation can aid human action recognition tasks, enhancing accuracy with neural networks. However, reliance on images for depth estimation requires extensive computational resources and cannot utilise the connectivity between human body structures. Besides, the depth information may not accurately reflect actual depth ranges, necessitating improved reliability. Therefore, a 2D human skeleton action recognition method with spatial constraints (2D‐SCHAR) is introduced. 2D‐SCHAR employs graph convolution networks to process graph‐structured human action skeleton data comprising three parts: depth estimation, spatial transformation, and action recognition. The initial two components, which infer 3D information from 2D human skeleton actions and generate spatial transformation parameters to correct abnormal deviations in action data, support the latter in the model to enhance the accuracy of action recognition. The model is designed in an end‐to‐end, multitasking manner, allowing parameter sharing among these three components to boost performance. The experimental results validate the model's effectiveness and superiority in human skeleton action recognition.

Seq2seq Model for Human Action Recognition Based on Skeleton and Two-Layer Bidirectional LSTM

Explorations of Skeleton Features for LSTM-based Action Recognition

Human Action Recognition of Spatiotemporal Parameters for Skeleton Sequences Using MTLN Feature Learning Framework

Multi-view Multi-modal Approach Based on 5S-CNN and BiLSTM Using Skeleton, Depth and RGB Data for Human Activity Recognition

A Skeleton-based Action Recognition System for Medical Condition Detection

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Human Skeleton Action Recognition Based on Monocular Depth Estimation

An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data

Human skeleton behavior recognition model based on multi-object pose estimation with spatiotemporal semantics

2D human skeleton action recognition with spatial constraints

Online Robust Action Recognition Based on a Hierarchical Model

Action Recognition Based on Global Optimal Similarity Measuring

An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition

Skeleton-based Action Recognition Using LSTM and CNN

DB-LSTM: Densely-connected Bi-directional LSTM for Human Action Recognition

Semantic-guided multi-scale human skeleton action recognition

Skeleton-based action recognition with hierarchical spatial reasoning and temporal stack learning network

Dynamic Edge Convolutional Neural Network for Skeleton-Based Human Action Recognition

Skeleton-Based Human Action Recognition with Global Context-Aware Attention LSTM Networks

Learning Explicit Shape And Motion Evolution Maps For Skeleton-Based Human Action Recognition

Skeleton based action recognition using translation-scale invariant image mapping and multi-scale deep cnn