Action recognition algorithm based on skeleton graph with multiple features and improved adjacency matrix
Shanqing Zhang,Shuheng Jiao,Yujie Chen,Jiayi Xu
DOI: https://doi.org/10.1049/ipr2.13245
IF: 2.3
2024-10-10
IET Image Processing
Abstract:We propose a novel human action recognition algorithm that leverages multiple features of the skeleton graph, such as local differential features, multi‐ scale edge features, nodal features and nodal motion features. We also design an improved adjacency matrix that captures the logical adjacency information between nodes, which enhances the graph convolutional operators. Our algorithm can effectively extract the discriminative and robust features from the skeleton graph, and achieve state‐of‐the‐art performances on four standard datasets: NTU RGB‐D 60, NTU RGB‐D 120, Kinetics, and Northwestern‐UCLA. Although graph convolutional networks have achieved good performances in skeleton‐graph‐based action recognition, there are still some problems which include the incomplete utilization of skeleton graph features and the lacking of logical adjacency information between nodes in adjacency matrix. In this article, a human action recognition algorithm is proposed based on multiple features from the skeleton graph to solve these problems. More specifically, an improved adjacency matrix is constructed to make full use of the multiple skeleton graph features. These features include local differential features, multi‐scale edge features, features of the original skeleton graph, nodal features, and nodal motion features. Extensive results are conducted on four standard datasets (NTU RGB‐D 60, NTU RGB‐D 120, Kinetics, and Northwestern‐UCLA). The experimental results show that the proposed algorithm outperforms the SOTA action recognition algorithms.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology