Abstract:(1) A novel 2D human skeleton action recognition model with spatial constraints, named 2D‐SCHAR, is introduced to address the ambiguity and uncertainty associated with human action recognition in 2D surveillance videos. (2) These issues stem from the absence of depth information in the action data, thus we concentrate on two main challenges: depth estimation and spatial transformation, to enhance recognition accuracy. (3) The depth estimation component aims to reconstruct 3D action data from 2D inputs, while the spatial transformation employs spatial constraints to adjust and rectify the 3D action data. Human actions are predominantly presented in 2D format in video surveillance scenarios, which hinders the accurate determination of action details not apparent in 2D data. Depth estimation can aid human action recognition tasks, enhancing accuracy with neural networks. However, reliance on images for depth estimation requires extensive computational resources and cannot utilise the connectivity between human body structures. Besides, the depth information may not accurately reflect actual depth ranges, necessitating improved reliability. Therefore, a 2D human skeleton action recognition method with spatial constraints (2D‐SCHAR) is introduced. 2D‐SCHAR employs graph convolution networks to process graph‐structured human action skeleton data comprising three parts: depth estimation, spatial transformation, and action recognition. The initial two components, which infer 3D information from 2D human skeleton actions and generate spatial transformation parameters to correct abnormal deviations in action data, support the latter in the model to enhance the accuracy of action recognition. The model is designed in an end‐to‐end, multitasking manner, allowing parameter sharing among these three components to boost performance. The experimental results validate the model's effectiveness and superiority in human skeleton action recognition.

Enhancing 3D Human Skeleton Key-point Detection through Weakly Supervised Learning and Multi-level Attention Mechanisms

Mmskeleton: 3D Human Skeleton Estimation Using Millimeter Wave Radar Sparse Point Clouds

Human Skeleton Point Detection Based on Super Resolution

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

Skeleton-Aware 3d Human Shape Reconstruction From Point Clouds

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

PointSkelCNN: Deep Learning-Based 3D Human Skeleton Extraction from Point Clouds

Physical Key Point Detection Algorithm Based on Multi-scale Feature Fusion.

Unsupervised 3D Keypoint Discovery with Multi-View Geometry

Boosting Monocular 3D Human Pose Estimation with Part Aware Attention

Spatial Focus Attention for Fine-Grained Skeleton-Based Action Tasks

Using Human Skeleton Point Repair Methods to Improve the Accuracy of Multi-person Interactive Activity Recognition

Enhanced Multi-Scale Attention-Driven 3D Human Reconstruction from Single Image

Multi-Human Pose Estimation by Deep Learning-Based Sequential Approach for Human Keypoint Position and Human Body Detection

SkeletonPose: Exploiting Human Skeleton Constraint for 3D Human Pose Estimation

Body Part Level Attention Model for Skeleton-Based Action Recognition

Weakly Supervised Adversarial Learning for 3D Human Pose Estimation from Point Clouds

Point2Skeleton: Learning Skeletal Representations from Point Clouds

Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition

MSAN: Multi-stage Human Pose Estimation Universal Network Based on Attention Mechanism

2D human skeleton action recognition with spatial constraints