Abstract:The objective of action quality assessment is to score sports videos. However, most existing works focus only on video dynamic information (i.e., motion information) but ignore the specific postures that an athlete is performing in a video, which is important for action assessment in long videos. In this work, we present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. To learn more discriminative representations for videos, we not only learn the video dynamic information but also focus on the static postures of the detected athletes in specific frames, which represent the action quality at certain moments, along with the help of the proposed hybrid dynamic-static architecture. Moreover, we leverage a context-aware attention module consisting of a temporal instance-wise graph convolutional network unit and an attention unit for both streams to extract more robust stream features, where the former is for exploring the relations between instances and the latter for assigning a proper weight to each instance. Finally, we combine the features of the two streams to regress the final video score, supervised by ground-truth scores given by experts. Additionally, we have collected and annotated the new Rhythmic Gymnastics dataset, which contains videos of four different types of gymnastics routines, for evaluation of action quality assessment in long videos. Extensive experimental results validate the efficacy of our proposed method, which outperforms related approaches. The codes and dataset are available at \url{<a class="link-external link-https" href="https://github.com/lingan1996/ACTION-NET" rel="external noopener nofollow">this https URL</a>}.

Auto-Encoding Score Distribution Regression for Action Quality Assessment.

Exploiting SDAE Model for Recommendations

Uncertainty-Aware Score Distribution Learning for Action Quality Assessment

Uncertainty-Driven Action Quality Assessment

Interpretable Long-term Action Quality Assessment

Assessing action quality with semantic-sequence performance regression and densely distributed sample weighting

Gaussian guided frame sequence encoder network for action quality assessment

Group-aware Contrastive Regression for Action Quality Assessment

Localization-assisted Uncertainty Score Disentanglement Network for Action Quality Assessment

2M-AF: A Strong Multi-Modality Framework for Human Action Quality Assessment with Self-supervised Representation Learning

A Comprehensive Survey of Action Quality Assessment: Method and Benchmark

Dual-referenced assistive network for action quality assessment

End-to-end Action Quality Assessment with Action Parsing Transformer

GAIA: Rethinking Action Quality Assessment for AI-Generated Videos

Likert Scoring with Grade Decoupling for Long-term Action Assessment

FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessment

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

RICA2: Rubric-Informed, Calibrated Assessment of Actions

Continual Action Assessment via Task-Consistent Score-Discriminative Feature Distribution Modeling

Hierarchical Graph Convolutional Networks for Action Quality Assessment

MAGR: Manifold-Aligned Graph Regularization for Continual Action Quality Assessment