Abstract:Action recognition is one of the challenging video understanding tasks in computer vision. Although there has been extensive research in the task of classifying coarse-grained actions, existing methods are still limited in differentiating actions with low inter-class and high intra-class variation. Particularly, the table tennis sport that involves shots of high inter-class similarity, subtle variations, occlusion, and view-point variations. While a few datasets have been available for event spotting and shot recognition, these benchmarks are mostly recorded in a constrained environment with a clear view/perception of shots executed by players. In this paper, we introduce a Table tennis shots 1.0 dataset consisting of 9000 videos of 6 fine-grained actions collected in an unconstrained manner to analyze the performance of both players. To effectively recognize these different types of table tennis shots, we propose an adaptive temporal aggregation method that can handle the temporal interactions concerning the subtle variations among shots and low inter-class variations. Our method consists of two components, namely, (i) feature extraction module and (ii) temporal aggregation network. The feature extraction module is a 3D convolutional neural network (3D-CNN) that captures the spatial and temporal characteristics of table tennis shots. Here we propose to replace the final global average pooling layer (GAP) with the temporal aggregation network to overcome the loss of motion information due to averaging of temporal features. This temporal aggregation network utilizes the attention mechanism of bidirectional encoder representations from Transformers (BERT) to model the significant temporal interactions among the shots effectively. We demonstrate that our proposed approach improves the performance of existing 3D-CNN methods by ≈ 10% on the Table tennis shots 1.0 dataset.

Memory Augmented Deep Generative models for Forecasting the Next Shot Location in Tennis

Memory Augmented Deep Generative models for Forecasting the Next Shot Location in Tennis

Forecasting the Next Shot Location in Tennis Using Fine-Grained Spatiotemporal Tracking Data

Predicting Shot Locations in Tennis Using Spatiotemporal Data

Classification of Tennis Shots with a Neural Network Approach

Learning Three Dimensional Tennis Shots Using Graph Convolutional Networks

Hybrid LSTM and GAN model for action recognition and prediction of lawn tennis sport activities

Space-Time VON CRAMM: Evaluating Decision-Making in Tennis with Variational generatiON of Complete Resolution Arcs via Mixture Modeling

One-shot Learning with Memory-Augmented Neural Networks

Predicting Shot Making in Basketball Learnt from Adversarial Multiagent Trajectories

Computational Analysis of Table Tennis Matches from Real-Time Videos Using Deep Learning.

Who You Play Affects How You Play: Predicting Sports Performance Using Graph Attention Networks With Temporal Convolution

Forecasting Future Action Sequences with Neural Memory Networks

ShuttleSHAP: A Turn-Based Feature Attribution Approach for Analyzing Forecasting Models in Badminton

Construction of Sports Training Performance Prediction Model Based on a Generative Adversarial Deep Neural Network Algorithm

How Is the Stroke? Inferring Shot Influence in Badminton Matches via Long Short-term Dependencies

Where Will Players Move Next? Dynamic Graphs and Hierarchical Fusion for Movement Forecasting in Badminton

Adaptive temporal aggregation for table tennis shot recognition

Supervised Learning for Table Tennis Match Prediction

Learning to Generate with Memory

RGB Video Based Tennis Action Recognition Using a Deep Historical Long Short-Term Memory