Abstract:Tennis has becoming an increasingly popular sport throughout the world. Tennis motion recognition based on 3D video has attracted more and more attention in recent years. The algorithm based on dynamic time warping takes into account the timing sequence information of movements and can solve the uncertainty of human movement at temporal level. By increasing the training samples, the efficiency will decrease accordingly. This work presents a tennis action recognition framework based on action standard sequence. The 3D action video samples are incorporated into action sequences by feature extraction, wherein the action standard sequences are encoded as a sequence averaging optimization problem under the dynamic time normalization metric. The dynamic time normalization barycenter averaging algorithm (DBA) is leveraged to solve this problem. For the tennis scenery with significant differences in the action categories, we study the standard sequence learning of multiple actions, and accordingly propose a DBA-K-means clustering algorithm for unsupervised learning. Herein, a human tennis action recognition by integrating feature optimization and image similarity is proposed. The three dimensional reduction methods, including principal component analysis (PCA),PCA + Pearson, and PCA+ Spearman, were compared to prove that PCA+ Pearson correlation coefficient had the best dimensional reduction effect. Meanwhile, the global feature eight-star model is combined with the local feature HOG feature after dimensionally reduced to fully represent human movements. The similarity between pairwise adjacent frames of images was calculated. The statistical weight of single frame SVM classification results within a discriminant period is adaptively allocated, and finally the body pose recognition results are classified twice. Experiments on standard data set KTH show that the recognition accuracy of this algorithm is 94.5%, which is better than other methods. It has a good application value in the field of video human motion recognition. Also, we have demonstrated that this method can further improve the efficiency and accuracy of action recognition. Effective feature extraction is beneficial to improve the accuracy of subsequent human action recognition.

3D Convolutional Networks for Action Recognition: Application to Sport Gesture Recognition

Sport Action Recognition with Siamese Spatio-Temporal CNNs: Application to Table Tennis

Learning SpatioTemporal and Motion Features in a Unified 2D Network for Action Recognition

Human Action Recognition Using Deep Learning Methods.

Deep Spatial/temporal-level feature engineering for Tennis-based action recognition

Analytical Model of Action Fusion in Sports Tennis Teaching by Convolutional Neural Networks

3D Convolutional Neural Network for Action Recognition.

Basketball technique action recognition using 3D convolutional neural networks

Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networks

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Short-Term Temporal Convolutional Networks for Dynamic Hand Gesture Recognition

Gesture recognition based on deep deformable 3D convolutional neural networks

Design of National Sports Action Feature Extraction System Based on Convolutional Neural Network

2D versus 3D Convolutional Spiking Neural Networks Trained with Unsupervised STDP for Human Action Recognition

Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognition

RGB Video Based Tennis Action Recognition Using a Deep Historical Long Short-Term Memory

Empowering Efficient Spatio-Temporal Learning with a 3D CNN for Pose-Based Action Recognition

Learning to Recognize 3D Human Action from A New Skeleton-based Representation Using Deep Convolutional Neural Networks

3D Action Recognition Using Data Visualization and Convolutional Neural Networks.

An Attention Enhanced Spatial–Temporal Graph Convolutional LSTM Network for Action Recognition in Karate

Spatiotemporal Multimodal Learning With 3D CNNs for Video Action Recognition