Abstract:The authors introduce a novel Temporal Channel Reconfiguration Multi‐Graph Convolution Network (TRMGCN) that addresses limitations in existing methods for skeleton‐based action recognition by introducing the Temporal Channel Fusion with Guidance (TCFG) module for capturing crucial temporal information and the Top‐Down Attention Multi‐graph Independent Convolution (TD‐MIG) for learning topological graph features. TRMGCN demonstrates advanced performance on large‐scale datasets (NTU‐RGB + D60 and 120) and exhibits strong generalisation capabilities on the smaller dataset NW‐UCLA. Skeleton‐based action recognition has received much attention and achieved remarkable achievements in the field of human action recognition. In time series action prediction for different scales, existing methods mainly focus on attention mechanisms to enhance modelling capabilities in spatial dimensions. However, this approach strongly depends on the local information of a single input feature and fails to facilitate the flow of information between channels. To address these issues, the authors propose a novel Temporal Channel Reconfiguration Multi‐Graph Convolution Network (TRMGCN). In the temporal convolution part, the authors designed a module called Temporal Channel Fusion with Guidance (TCFG) to capture important temporal information within channels at different scales and avoid ignoring cross‐spatio‐temporal dependencies among joints. In the graph convolution part, the authors propose Top‐Down Attention Multi‐graph Independent Convolution (TD‐MIG), which uses multi‐graph independent convolution to learn the topological graph feature for different length time series. Top‐down attention is introduced for spatial and channel modulation to facilitate information flow in channels that do not establish topological relationships. Experimental results on the large‐scale datasets NTU‐RGB + D60 and 120, as well as UAV‐Human, demonstrate that TRMGCN exhibits advanced performance and capabilities. Furthermore, experiments on the smaller dataset NW‐UCLA have indicated that the authors' model possesses strong generalisation abilities.

Feature Pyramid Graph Convolutional Networks for Temporal Action Detection

Temporal adaptive feature pyramid network for action detection

A New Temporal Deconvolutional Pyramid Network For Action Detection

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

A motion-aware and temporal-enhanced Spatial–Temporal Graph Convolutional Network for skeleton-based human action segmentation

Temporal Pyramid Pooling-Based Convolutional Neural Network for Action Recognition

Dual-Excitation Spatial–Temporal Graph Convolution Network for Skeleton-Based Action Recognition

Involving Distinguished Temporal Graph Convolutional Networks for Skeleton-Based Temporal Action Segmentation

Temporal segment graph convolutional networks for skeleton-based action recognition

Dynamic spatial-temporal topology graph network for skeleton-based action recognition

TFC-GCN: Lightweight Temporal Feature Cross-Extraction Graph Convolutional Network for Skeleton-Based Action Recognition

Temporal Pyramid Network for Action Recognition

Multi-Scale Spatial Temporal Graph Convolutional Network for Skeleton-Based Action Recognition

Pyramidal Graph Convolutional Network for Skeleton-Based Human Action Recognition

Densely Connected and Multiple Temporal Graph Convolution Networks for Skeleton-based Action Recognition

Temporal Enhanced Multi-Stream Graph Convolutional Nerual Networks For Skeleton-Based Action Recognition

Multiple temporal scale aggregation graph convolutional network for skeleton-based action recognition

Spatial-temporal hypergraph based on dual-stage attention network for multi-view data lightweight action recognition

Priori separation graph convolution with long-short term temporal modeling for skeleton-based action recognition

Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition

Temporal channel reconfiguration multi‐graph convolution network for skeleton‐based action recognition