Abstract:Abstract In the action recognition field based on the characteristics of human skeleton joint points, the selection of keyframes in the skeleton sequence is a significant issue, which directly affects the action recognition accuracy. In order to improve the effectiveness of keyframes selection, this paper proposes inflection point frames, and transforms keyframes selection into a multi-objective optimization problem based on it. First, the pose features are extracted from the input skeleton joint point data, which used to construct the pose feature vector of each frame in time sequence; then, the inflection point frames in the sequence are determined according to the flow of momentum of each body part. Next, the pose feature vectors are input into the keyframes multi-objective optimization model, with the fusion of domain information and the number of keyframes; finally, the output keyframes are input to the action classifier. To verify the effectiveness of the method, the MSR-Action3D, the UTKinect-Action and Florence3D-Action, and the 3 public datasets, are chosen for simulation experiments and the results show that the keyframes sequence obtained by this method can significantly improve the accuracy of multiple action classifiers, and the average recognition accuracy of the three data sets can reach 94.6%, 97.6% and 94.2% respectively. Besides, combining the optimized keyframes with deep learning classifier on the NTU RGB + D dataset can make the accuracies reaching 83.2% and 93.7%.

Human action recognition method based on key frame and skeleton information*

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

Action Recognition Based on Global Optimal Similarity Measuring

Study on Human Body Action Recognition.

Improved Key Poses Model for Skeleton-Based Action Recognition.

Human Activity Recognition Using Dynamic Representation and Matching of Skeleton Feature Sequences from RGB-D Images

Human Action Recognition Based on Human Skeleton Hu Invariant Moments Combined with Human Geometrical Characteristics

Human Action Recognition Based on Kinematic Similarity in Real Time.

Using the Representation of 3D Skeleton Snippet for Human Action Recognition

An optimization method of human skeleton keyframes selection for action recognition

Human Action Recognition Based on Depth Images from Microsoft Kinect

Human motion recognition using three-dimensional skeleton model based on RGBD vision system

Skeleton-based human action recognition using multiple sequence alignment

Human Action Recognition Using Key-Frame Attention-Based LSTM Networks

Human Action Recognition Based on the Sequence of Key Points

3d Human Action Recognition Based On The Spatial-Temporal Moving Skeleton Descriptor

Human Action Recognition Using Key Poses and Atomic Motions

An effective representation for action recognition with human skeleton joints

3D Human Activity Recognition Using Skeletal Data from RGBD Sensors.

Human Actions Segmentation and Matching Based on 3D Skeleton Model

Human Action Recognition Using Multi-Layer Codebooks of Key Poses and Atomic Motions