Abstract:The objective of action quality assessment is to score sports videos. However, most existing works focus only on video dynamic information (i.e., motion information) but ignore the specific postures that an athlete is performing in a video, which is important for action assessment in long videos. In this work, we present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. To learn more discriminative representations for videos, we not only learn the video dynamic information but also focus on the static postures of the detected athletes in specific frames, which represent the action quality at certain moments, along with the help of the proposed hybrid dynamic-static architecture. Moreover, we leverage a context-aware attention module consisting of a temporal instance-wise graph convolutional network unit and an attention unit for both streams to extract more robust stream features, where the former is for exploring the relations between instances and the latter for assigning a proper weight to each instance. Finally, we combine the features of the two streams to regress the final video score, supervised by ground-truth scores given by experts. Additionally, we have collected and annotated the new Rhythmic Gymnastics dataset, which contains videos of four different types of gymnastics routines, for evaluation of action quality assessment in long videos. Extensive experimental results validate the efficacy of our proposed method, which outperforms related approaches. The codes and dataset are available at \url{<a class="link-external link-https" href="https://github.com/lingan1996/ACTION-NET" rel="external noopener nofollow">this https URL</a>}.

Assessing Action Quality via Attentive Spatio-Temporal Convolutional Networks.

A Channel-Wise Spatial-Temporal Aggregation Network for Action Recognition

Learning SpatioTemporal and Motion Features in a Unified 2D Network for Action Recognition

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Spatio-Temporal Attention Networks for Action Recognition and Detection

Fine-Grained Spatio-Temporal Parsing Network for Action Quality Assessment

Hierarchical Graph Convolutional Networks for Action Quality Assessment

TSA-Net: Tube Self-Attention Network for Action Quality Assessment

STCA: an action recognition network with spatio-temporal convolution and attention

Joint Network based Attention for Action Recognition

Using Spatial‐Temporal Attention for Video Quality Evaluation

Real-time spatiotemporal action localization algorithm using improved CNNs architecture

Assessing action quality with semantic-sequence performance regression and densely distributed sample weighting

Attention-based Temporal Weighted Convolutional Neural Network for Action Recognition

Deep Neural Networks for End-to-End Spatiotemporal Video Quality Prediction and Aggregation

Unified Spatio-Temporal Attention Networks for Action Recognition in Videos.

SSTA-Net: Self-supervised Spatio-Temporal Attention Network for Action Recognition.

Action recognition using attention-based spatio-temporal VLAD networks and adaptive video sequences optimization

Actionness Estimation Using Hybrid Fully Convolutional Networks

Learning and fusing multiple hidden substages for action quality assessment