Abstract:Skeleton-based action recognition task has drawn much attention for many years. Graph Convolutional Network (GCN) has proved its effectiveness in this task. However, how to improve the model's robustness to different human actions and how to make effective use of features produced by the network are main topics needed to be further explored. Human actions are time series sequence, meaning that temporal information is a key factor to model the representation of data. The ranges of body parts involved in small actions (e.g. raise a glass or shake head) and big actions (e.g. walking or jumping) are diverse. It's crucial for the model to generate and utilize more features that can be adaptive to a wider range of actions. Furthermore, feature channels are specific with the action class, the model needs to weigh their importance and pay attention to more related ones. To address these problems, in this work, we propose a two-stream channel-wise dense connection GCN (2s-CDGCN). Specifically, the skeleton data was extracted and processed into spatial and temporal information for better feature representation. A channel-wise attention module was used to select and emphasize the more useful features generated by the network. Moreover, to ensure maximum information flow, dense connection was introduced to the network structure, which enables the network to reuse the skeleton features and generate more information adaptive and related to different human actions. Our model has shown its ability to improve the accuracy of human action recognition task on two large datasets, NTU-RGB+D and Kinetics. Extensive evaluations were conducted to prove the effectiveness of our model.

Accommodating Self-attentional Heterophily Topology into High- and Low-pass Graph Convolutional Network for Skeleton-based Action Recognition

Adaptive Hyper-Graph Convolution Network for Skeleton-based Human Action Recognition with Virtual Connections

Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition.

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Dynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

SelfGCN: Graph Convolution Network With Self-Attention for Skeleton-Based Action Recognition

Part-Wise Adaptive Topology Graph Convolutional Network for Skeleton-Based Action Recognition

Hypergraph Neural Network for Skeleton-Based Action Recognition

Multi-Scale Spatial-Temporal Self-Attention Graph Convolutional Networks for Skeleton-based Action Recognition

Attention-Guided and Topology-Enhanced Shift Graph Convolutional Network for Skeleton-Based Action Recognition

Channel-Wise Dense Connection Graph Convolutional Network for Skeleton-Based Action Recognition

Multi-Stage Attention-Enhanced Sparse Graph Convolutional Network for Skeleton-Based Action Recognition

Attentional weighting strategy-based dynamic GCN for skeleton-based action recognition

Pyramidal Graph Convolutional Network for Skeleton-Based Human Action Recognition

Skeleton-Based Action Recognition With Low-Level Features of Adaptive Graph Convolutional Networks

Attention adjacency matrix based graph convolutional networks for skeleton-based action recognition

Densely Connected and Multiple Temporal Graph Convolution Networks for Skeleton-based Action Recognition

Skeleton action recognition via graph convolutional network with self-attention module

Overcoming Topology Agnosticism: Enhancing Skeleton-Based Action Recognition through Redefined Skeletal Topology Awareness

Combining channel-wise joint attention and temporal attention in graph convolutional networks for skeleton-based action recognition