Abstract:The authors introduce a novel Temporal Channel Reconfiguration Multi‐Graph Convolution Network (TRMGCN) that addresses limitations in existing methods for skeleton‐based action recognition by introducing the Temporal Channel Fusion with Guidance (TCFG) module for capturing crucial temporal information and the Top‐Down Attention Multi‐graph Independent Convolution (TD‐MIG) for learning topological graph features. TRMGCN demonstrates advanced performance on large‐scale datasets (NTU‐RGB + D60 and 120) and exhibits strong generalisation capabilities on the smaller dataset NW‐UCLA. Skeleton‐based action recognition has received much attention and achieved remarkable achievements in the field of human action recognition. In time series action prediction for different scales, existing methods mainly focus on attention mechanisms to enhance modelling capabilities in spatial dimensions. However, this approach strongly depends on the local information of a single input feature and fails to facilitate the flow of information between channels. To address these issues, the authors propose a novel Temporal Channel Reconfiguration Multi‐Graph Convolution Network (TRMGCN). In the temporal convolution part, the authors designed a module called Temporal Channel Fusion with Guidance (TCFG) to capture important temporal information within channels at different scales and avoid ignoring cross‐spatio‐temporal dependencies among joints. In the graph convolution part, the authors propose Top‐Down Attention Multi‐graph Independent Convolution (TD‐MIG), which uses multi‐graph independent convolution to learn the topological graph feature for different length time series. Top‐down attention is introduced for spatial and channel modulation to facilitate information flow in channels that do not establish topological relationships. Experimental results on the large‐scale datasets NTU‐RGB + D60 and 120, as well as UAV‐Human, demonstrate that TRMGCN exhibits advanced performance and capabilities. Furthermore, experiments on the smaller dataset NW‐UCLA have indicated that the authors' model possesses strong generalisation abilities.

Thermal infrared action recognition with two-stream shift Graph Convolutional Network

Privacy-Preserving 3D Skeleton-Based Video Action Recognition Via Graph Convolution Network

A real-time algorithm for human action recognition in RGB and thermal video

Global Temporal Representation based CNNs for Infrared Action Recognition

Fall Detection Method for Infrared Videos Based on Spatial-Temporal Graph Convolutional Network

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition.

Pose-Guided Robust Action Recognition for Outdoor Internet of Things

Richly Activated Graph Convolutional Network for Robust Skeleton-Based Action Recognition

Learning Spatiotemporal Features for Infrared Action Recognition with 3D Convolutional Neural Networks

Action Recognition Based on Temporal Skeleton Analysis: a New Method for IoT Scenarios

Real-World Graph Convolution Networks (RW-GCNs) for Action Recognition in Smart Video Surveillance

Graph transformer network with temporal kernel attention for skeleton-based action recognition

SparseShift-GCN: High precision skeleton-based action recognition

Temporal Attention-Augmented Graph Convolutional Network for Efficient Skeleton-Based Human Action Recognition

A motion-aware and temporal-enhanced Spatial–Temporal Graph Convolutional Network for skeleton-based human action segmentation

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Action Recognition Based on Multi-Level Topological Channel Attention of Human Skeleton

Multi-view graph convolution network for the recognition of human action with spatial and temporal occlusion problems

Spatio-Temporal Attention Deep Network for Skeleton Based View-Invariant Human Action Recognition

Temporal channel reconfiguration multi‐graph convolution network for skeleton‐based action recognition