Abstract:The authors introduce a novel Temporal Channel Reconfiguration Multi‐Graph Convolution Network (TRMGCN) that addresses limitations in existing methods for skeleton‐based action recognition by introducing the Temporal Channel Fusion with Guidance (TCFG) module for capturing crucial temporal information and the Top‐Down Attention Multi‐graph Independent Convolution (TD‐MIG) for learning topological graph features. TRMGCN demonstrates advanced performance on large‐scale datasets (NTU‐RGB + D60 and 120) and exhibits strong generalisation capabilities on the smaller dataset NW‐UCLA. Skeleton‐based action recognition has received much attention and achieved remarkable achievements in the field of human action recognition. In time series action prediction for different scales, existing methods mainly focus on attention mechanisms to enhance modelling capabilities in spatial dimensions. However, this approach strongly depends on the local information of a single input feature and fails to facilitate the flow of information between channels. To address these issues, the authors propose a novel Temporal Channel Reconfiguration Multi‐Graph Convolution Network (TRMGCN). In the temporal convolution part, the authors designed a module called Temporal Channel Fusion with Guidance (TCFG) to capture important temporal information within channels at different scales and avoid ignoring cross‐spatio‐temporal dependencies among joints. In the graph convolution part, the authors propose Top‐Down Attention Multi‐graph Independent Convolution (TD‐MIG), which uses multi‐graph independent convolution to learn the topological graph feature for different length time series. Top‐down attention is introduced for spatial and channel modulation to facilitate information flow in channels that do not establish topological relationships. Experimental results on the large‐scale datasets NTU‐RGB + D60 and 120, as well as UAV‐Human, demonstrate that TRMGCN exhibits advanced performance and capabilities. Furthermore, experiments on the smaller dataset NW‐UCLA have indicated that the authors' model possesses strong generalisation abilities.

Multi-View Time-Series Hypergraph Neural Network for Action Recognition

Spatial-Temporal Hypergraph Neural Network based on Attention Mechanism for Multi-view Data Action Recognition

Spatial-temporal hypergraph based on dual-stage attention network for multi-view data lightweight action recognition

Multi-view graph convolution network for the recognition of human action with spatial and temporal occlusion problems

Graph-Temporal LSTM Networks for Skeleton-Based Action Recognition

Hypergraph-based Multi-View Action Recognition using Event Cameras

Skeleton-Based Action Recognition Based on Distance Vector and Multihigh View Adaptive Networks

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Hypergraph Neural Network for Skeleton-Based Action Recognition

Dynamic Spatial-temporal Hypergraph Convolutional Network for Skeleton-based Action Recognition

Multi-Scale Spatial Temporal Graph Convolutional Network for Skeleton-Based Action Recognition

Multi-Scale Adaptive Graph Convolution Network for Skeleton-Based Action Recognition

Viewpoint Guided Multi-Stream Neural Network for Skeleton Action Recognition

Learning Multi-Granular Spatio-Temporal Graph Network for Skeleton-based Action Recognition

Multiple temporal scale aggregation graph convolutional network for skeleton-based action recognition

View-Adaptive Graph Neural Network for Action Recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

A Graph Learning Based Multi-Modal Video Action Recognition

Temporal channel reconfiguration multi‐graph convolution network for skeleton‐based action recognition

Channel attention and multi-scale graph neural networks for skeleton-based action recognition