Abstract:Player pose estimation is particularly important for sports because it provides more accurate monitoring of athlete movements and performance, recognition of player actions, analysis of techniques, and evaluation of action execution accuracy. All of these tasks are extremely demanding and challenging in sports that involve rapid movements of athletes with inconsistent speed and position changes, at varying distances from the camera with frequent occlusions, especially in team sports when there are more players on the field. A prerequisite for recognizing the player's actions on the video footage and comparing their poses during the execution of an action is the detection of the player's pose in each element of an action or technique. First, a 2D pose of the player is determined in each video frame, and converted into a 3D pose, then using the tracking method all the player poses are grouped into a sequence to construct a series of elements of a particular action. Considering that action recognition and comparison depend significantly on the accuracy of the methods used to estimate and track player pose in real-world conditions, the paper provides an overview and analysis of the methods that can be used for player pose estimation and tracking using a monocular camera, along with evaluation metrics on the example of handball scenarios. We have evaluated the applicability and robustness of 12 selected 2-stage deep learning methods for 3D pose estimation on a public and a custom dataset of handball jump shots for which they have not been trained and where never-before-seen poses may occur. Furthermore, this paper proposes methods for retargeting and smoothing the 3D sequence of poses that have experimentally shown a performance improvement for all tested models. Additionally, we evaluated the applicability and robustness of five state-of-the-art tracking methods on a public and a custom dataset of a handball training recorded with a monocular camera. The paper ends with a discussion apostrophizing the shortcomings of the pose estimation and tracking methods, reflected in the problems of locating key skeletal points and generating poses that do not follow possible human structures, which consequently reduces the overall accuracy of action recognition.

A Survey on 3D Hand Pose Estimation: Cameras, Methods, and Datasets

A Survey of Deep Learning-based Hand Pose Estimation

3D Hand Pose Tracking and Estimation Using Stereo Matching.

Depth-Based 3D Hand Pose Estimation: from Current Achievements to Future Goals

Simultaneous 3D Hand Detection and Pose Estimation Using Single Depth Images

Applying 3D Human Hand Pose Estimation to Teleoperation

Survey on 3D Hand Gesture Recognition

Local and Global Point Cloud Reconstruction for 3D Hand Pose Estimation

3D Articulated Hand Tracking Based on Behavioral Model

A Hand Pose Tracking Benchmark From Stereo Matching

BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis

A Survey on Monocular 3D Human Pose Estimation

3D Hand Pose Estimation in Everyday Egocentric Images

A Comparison of Directional Distances for Hand Pose Estimation

A 3D Hand Attitude Estimation Method for Fixed Hand Posture Based on Dual-View RGB Images

Recent Advances in 3D Human Pose Estimation: From Optimization to Implementation and Beyond

Deep Learning Methods for 3D Human Pose Estimation under Different Supervision Paradigms: A Survey

3-D Hand Pose Estimation from Kinect's Point Cloud Using Appearance Matching

Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects

Estimation of 3D Human Hand Poses with Structured Pose Prior

3D Pose Estimation and Tracking in Handball Actions Using a Monocular Camera