Abstract:Graph convolutional networks have been widely used for skeleton-based action recognition due to their excellent modeling ability of non-Euclidean data. As the graph convolution is a local operation, it can only utilize the short-range joint dependencies and short-term trajectory but fails to directly model the distant joints relations and long-range temporal information that are vital to distinguishing various actions. To solve this problem, we present a multi-scale spatial graph convolution (MS-GC) module and a multi-scale temporal graph convolution (MT-GC) module to enrich the receptive field of the model in spatial and temporal dimensions. Concretely, the MS-GC and MT-GC modules decompose the corresponding local graph convolution into a set of sub-graph convolution, forming a hierarchical residual architecture. Without introducing additional parameters, the features will be processed with a series of sub-graph convolutions, and each node could complete multiple spatial and temporal aggregations with its neighborhoods. The final equivalent receptive field is accordingly enlarged, which is capable of capturing both short- and long-range dependencies in spatial and temporal domains. By coupling these two modules as a basic block, we further propose a multi-scale spatial temporal graph convolutional network (MST-GCN), which stacks multiple blocks to learn effective motion representations for action recognition. The proposed MST-GCN achieves remarkable performance on three challenging benchmark datasets, NTU RGB+D, NTU-120 RGB+D and Kinetics-Skeleton, for skeleton-based action recognition.

Spatial-Temporal Graph Convolutional Networks for Action Recognition with Adjacency Matrix Generation Network

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition.

Enhanced Adjacency Matrix-Based Lightweight Graph Convolution Network for Action Recognition

Attention adjacency matrix based graph convolutional networks for skeleton-based action recognition

A New Adjacency Matrix Configuration in GCN-based Models for Skeleton-based Action Recognition

Spatial‐temporal Slowfast Graph Convolutional Network for Skeleton‐based Action Recognition

Multi-Scale Spatial Temporal Graph Convolutional Network for Skeleton-Based Action Recognition

Graph Instinctive Attention Convolutional Network for Skeleton-Based Action Recognition.

Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition

Densely Connected and Multiple Temporal Graph Convolution Networks for Skeleton-based Action Recognition

Adaptive Attention Memory Graph Convolutional Networks for Skeleton-Based Action Recognition

Adaptive Hyper-Graph Convolution Network for Skeleton-based Human Action Recognition with Virtual Connections

Multi-Stage Attention-Enhanced Sparse Graph Convolutional Network for Skeleton-Based Action Recognition

DD-GCN: Directed Diffusion Graph Convolutional Network for Skeleton-based Human Action Recognition

Multi-Scale Adaptive Aggregate Graph Convolutional Network for Skeleton-Based Action Recognition

Multi-Scale Spatial-Temporal Self-Attention Graph Convolutional Networks for Skeleton-based Action Recognition

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Feature reconstruction graph convolutional network for skeleton-based action recognition

DeGCN: Deformable Graph Convolutional Networks for Skeleton-Based Action Recognition

Graph-aware transformer for skeleton-based action recognition