Abstract:In the volleyball game, estimating the 3D pose of the spiker is very valuable for training and analysis, because the spiker's technique level determines the scoring or not of a round. The development of computer vision provides the possibility for the acquisition of the 3D pose. Most conventional pose estimation works are data-dependent methods, which mainly focus on reaching a high level on the dataset with the controllable scene, but fail to get good results in the wild real volleyball competition scene because of the lack of large labelled data, abnormal pose, occlusion and overlap. To refine the inaccurate estimated pose, this paper proposes a motion-aware and data-independent method based on a calibrated multi-camera system for a real volleyball competition scene. The proposed methods consist of three key components: 1) By utilizing the relationship of multi-views, an irrelevant projection based potential joint restore approach is proposed, which refines the wrong pose of one view with the other three views projected information to reduce the influence of occlusion and overlap. 2) Instead of training with a large amount labelled data, the proposed motion-aware method utilizes the similarity of specific motion in sports to achieve construct a spike model. Based on the spike model, joint and trajectory matching is proposed for coarse refinement. 3) To finely refine, a point distribution based posterior decision network is proposed. While expanding the receptive field, the pose estimation task is decomposed into a classification decision problem, which greatly avoids the dependence on a large amount of labelled data. The experimental dataset videos with four synchronous camera views are from a real game, the Game of 2014 Japan Inter High School of Men Volleyball. The experiment result achieves 76.25%, 81.89%, and 86.13% success rate at the 30mm, 50mm, and 70mm error range, respectively. Since the proposed refinement framework is based on a real volleyball competition, it is expected to be applied in the volleyball analysis.

Sports Camera Pose Refinement Using an Evolution Strategy

ESC: Evolutionary Stitched Camera Calibration in the Wild

Real-Time Camera Pose Estimation for Sports Fields

Sports Camera Calibration via Synthetic Data

AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance

Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration

Iterative Optimisation with an Innovation CNN for Pose Refinement

Deep Key Frame Extraction for Sport Training

Robust Camera Motion Estimation in Video Sequences

Pose Estimation for Swimmers in Video Surveillance

Single-Stage Pose Estimation and Joint Angle Extraction Method for Moving Human Body

Learning to Refine Human Pose Estimation

Using synthetic camera poses for camera calibration in soccer videos

Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognition

Motion Capture from Pan-Tilt Cameras with Unknown Orientation

Fast 3D Pose Refinement with RGB Images

Robust Camera Pose Refinement for Multi-Resolution Hash Encoding

Iterative Pose Refinement for Object Pose Estimation Based on RGBD Data

The Unreasonable Effectiveness of Pre-Trained Features for Camera Pose Refinement

Leveraging Positional Encoding for Robust Multi-Reference-Based Object 6D Pose Estimation

Motion-aware and data-independent model based multi-view 3D pose refinement for volleyball spike analysis