Abstract:Skeleton representation has attracted a great deal of attention recently as an extremely robust feature for human action recognition. However, its non-Euclidean structural characteristics raise new challenges for conventional solutions. Recent studies have shown that there is a native superiority in modeling spatiotemporal skeleton information with a Graph Convolutional Network (GCN). Nevertheless, the skeleton graph modeling normally focuses on the physical adjacency of the elements of the human skeleton sequence, which contrasts with the requirement to provide a perceptually meaningful representation. To address this problem, in this paper, we propose a perceptually-enriched graph learning method by introducing innovative features to spatial and temporal skeleton graph modeling. For the spatial information modeling, we incorporate a Local-Global Graph Convolutional Network (LG-GCN) that builds a multifaceted spatial perceptual representation. This helps to overcome the limitations caused by over-reliance on the spatial adjacency relationships in the skeleton. For temporal modeling, we present a Region-Aware Graph Convolutional Network (RA-GCN), which directly embeds the regional relationships conveyed by a skeleton sequence into a temporal graph model. This innovation mitigates the deficiency of the original skeleton graph models. In addition, we strengthened the ability of the proposed channel modeling methods to extract multi-scale representations. These innovations result in a lightweight graph convolutional model, referred to as Graph2Net, that simultaneously extends the spatial and temporal perceptual fields, and thus enhances the capacity of the graph model to represent skeleton sequences. We conduct extensive experiments on NTU-RGB+D 60&120, Northwestern-UCLA, and Kinetics-400 datasets to show that our results surpass the performance of several mainstream methods while limiting the model complexity and computational ov-rhead.

Benchmarking Sensitivity of Continual Graph Learning for Skeleton-Based Action Recognition

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Graph2Net: Perceptually-Enriched Graph Learning for Skeleton-Based Action Recognition

SelfGCN: Graph Convolution Network With Self-Attention for Skeleton-Based Action Recognition

Feedback Graph Convolutional Network for Skeleton-Based Action Recognition

Continual Learning on Graphs: Challenges, Solutions, and Opportunities

Reinforced Continual Learning for Graphs

Continual Graph Learning: A Survey

Dual-domain Graph Convolutional Networks for Skeleton-Based Action Recognition

E-CGL: An Efficient Continual Graph Learner

Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition.

Feature reconstruction graph convolutional network for skeleton-based action recognition

Cross-Scale Spatiotemporal Refinement Learning for Skeleton-Based Action Recognition

Learning Heterogeneous Spatial-Temporal Context for Skeleton-Based Action Recognition.

Attention-Guided and Topology-Enhanced Shift Graph Convolutional Network for Skeleton-Based Action Recognition

Graph Convolutional Hourglass Networks for Skeleton-Based Action Recognition.

Learning Multi-Granular Spatio-Temporal Graph Network for Skeleton-based Action Recognition

GLTA-GCN: Global-Local Temporal Attention Graph Convolutional Network for Unsupervised Skeleton-Based Action Recognition

CLoG: Benchmarking Continual Learning of Image Generation Models

Skeleton-based Action Recognition via Adaptive Cross-Form Learning

PB-GCN: Progressive binary graph convolutional networks for skeleton-based action recognition