Abstract:Tennis has becoming an increasingly popular sport throughout the world. Tennis motion recognition based on 3D video has attracted more and more attention in recent years. The algorithm based on dynamic time warping takes into account the timing sequence information of movements and can solve the uncertainty of human movement at temporal level. By increasing the training samples, the efficiency will decrease accordingly. This work presents a tennis action recognition framework based on action standard sequence. The 3D action video samples are incorporated into action sequences by feature extraction, wherein the action standard sequences are encoded as a sequence averaging optimization problem under the dynamic time normalization metric. The dynamic time normalization barycenter averaging algorithm (DBA) is leveraged to solve this problem. For the tennis scenery with significant differences in the action categories, we study the standard sequence learning of multiple actions, and accordingly propose a DBA-K-means clustering algorithm for unsupervised learning. Herein, a human tennis action recognition by integrating feature optimization and image similarity is proposed. The three dimensional reduction methods, including principal component analysis (PCA),PCA + Pearson, and PCA+ Spearman, were compared to prove that PCA+ Pearson correlation coefficient had the best dimensional reduction effect. Meanwhile, the global feature eight-star model is combined with the local feature HOG feature after dimensionally reduced to fully represent human movements. The similarity between pairwise adjacent frames of images was calculated. The statistical weight of single frame SVM classification results within a discriminant period is adaptively allocated, and finally the body pose recognition results are classified twice. Experiments on standard data set KTH show that the recognition accuracy of this algorithm is 94.5%, which is better than other methods. It has a good application value in the field of video human motion recognition. Also, we have demonstrated that this method can further improve the efficiency and accuracy of action recognition. Effective feature extraction is beneficial to improve the accuracy of subsequent human action recognition.

Time-ordered Spatial-Temporal Interest Points for Human Action Classification.

Salient Pairwise Spatio-Temporal Interest Points for Real-Time Activity Recognition.

Action classification by exploring directional co-occurrence of weighted stips

Learning Directional Co-Occurrence for Human Action Classification

Learning spatio-temporal co-occurrence correlograms for efficient human action classification

Recognizing human actions using a new descriptor based on spatial-temporal interest points and weighted-output classifier.

Action Recognition Via Cumulative Histogram of Multiple Features

Human action classification based on sequential bag-of-words model

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Sequential Bag-of-Words Model for Human Action Classification.

Deep Spatial/temporal-level feature engineering for Tennis-based action recognition

Spatio-Temporal Proximity Distribution Kernels for Action Recognition

Making Full Use of Spatial-Temporal Interest Points: an AdaBoost Approach for Action Recognition

Detecting Human Action As the Spatio-Temporal Tube of Maximum Mutual Information

3D R Transform on Spatio-temporal Interest Points for Action Recognition

Robust 3D Action Recognition Through Sampling Local Appearances and Global Distributions.

Spatiotemporal interest point detector exploiting appearance and motion-variation information

On Using Temporal Features to Create More Accurate Human-Activity Classifiers

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Spatio-Temporal Adaptive Network with Bidirectional Temporal Difference for Action Recognition

A survey on deep learning-based spatio-temporal action detection