Abstract:(1) A novel 2D human skeleton action recognition model with spatial constraints, named 2D‐SCHAR, is introduced to address the ambiguity and uncertainty associated with human action recognition in 2D surveillance videos. (2) These issues stem from the absence of depth information in the action data, thus we concentrate on two main challenges: depth estimation and spatial transformation, to enhance recognition accuracy. (3) The depth estimation component aims to reconstruct 3D action data from 2D inputs, while the spatial transformation employs spatial constraints to adjust and rectify the 3D action data. Human actions are predominantly presented in 2D format in video surveillance scenarios, which hinders the accurate determination of action details not apparent in 2D data. Depth estimation can aid human action recognition tasks, enhancing accuracy with neural networks. However, reliance on images for depth estimation requires extensive computational resources and cannot utilise the connectivity between human body structures. Besides, the depth information may not accurately reflect actual depth ranges, necessitating improved reliability. Therefore, a 2D human skeleton action recognition method with spatial constraints (2D‐SCHAR) is introduced. 2D‐SCHAR employs graph convolution networks to process graph‐structured human action skeleton data comprising three parts: depth estimation, spatial transformation, and action recognition. The initial two components, which infer 3D information from 2D human skeleton actions and generate spatial transformation parameters to correct abnormal deviations in action data, support the latter in the model to enhance the accuracy of action recognition. The model is designed in an end‐to‐end, multitasking manner, allowing parameter sharing among these three components to boost performance. The experimental results validate the model's effectiveness and superiority in human skeleton action recognition.

3D-LSR: A New Model for Skeletal Representation and Segmentation

3d Human Action Recognition Based On The Spatial-Temporal Moving Skeleton Descriptor

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Effective Active Skeleton Representation for Low Latency Human Action Recognition

Using the Representation of 3D Skeleton Snippet for Human Action Recognition

An effective representation for action recognition with human skeleton joints

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

2D human skeleton action recognition with spatial constraints

3D Human Activity Recognition Using Skeletal Data from RGBD Sensors.

Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning

A New Representation of Skeleton Sequences for 3D Action Recognition

Explorations of Skeleton Features for LSTM-based Action Recognition

3D Action Recognition Using Multi-Temporal Skeleton Visualization.

Action Recognition Based on Global Optimal Similarity Measuring

Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks

Action Recognition Scheme Based on Skeleton Representation with DS-LSTM Network.

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

Spatio–Temporal Image Representation of 3D Skeletal Movements for View-Invariant Action Recognition with Deep Convolutional Neural Networks

Multisource Learning for Skeleton-Based Action Recognition Using Deep LSTM and CNN

A Survey on 3D Skeleton-Based Action Recognition Using Learning Method

Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition