Abstract:Player pose estimation is particularly important for sports because it provides more accurate monitoring of athlete movements and performance, recognition of player actions, analysis of techniques, and evaluation of action execution accuracy. All of these tasks are extremely demanding and challenging in sports that involve rapid movements of athletes with inconsistent speed and position changes, at varying distances from the camera with frequent occlusions, especially in team sports when there are more players on the field. A prerequisite for recognizing the player's actions on the video footage and comparing their poses during the execution of an action is the detection of the player's pose in each element of an action or technique. First, a 2D pose of the player is determined in each video frame, and converted into a 3D pose, then using the tracking method all the player poses are grouped into a sequence to construct a series of elements of a particular action. Considering that action recognition and comparison depend significantly on the accuracy of the methods used to estimate and track player pose in real-world conditions, the paper provides an overview and analysis of the methods that can be used for player pose estimation and tracking using a monocular camera, along with evaluation metrics on the example of handball scenarios. We have evaluated the applicability and robustness of 12 selected 2-stage deep learning methods for 3D pose estimation on a public and a custom dataset of handball jump shots for which they have not been trained and where never-before-seen poses may occur. Furthermore, this paper proposes methods for retargeting and smoothing the 3D sequence of poses that have experimentally shown a performance improvement for all tested models. Additionally, we evaluated the applicability and robustness of five state-of-the-art tracking methods on a public and a custom dataset of a handball training recorded with a monocular camera. The paper ends with a discussion apostrophizing the shortcomings of the pose estimation and tracking methods, reflected in the problems of locating key skeletal points and generating poses that do not follow possible human structures, which consequently reduces the overall accuracy of action recognition.

Efficient 3D Position Estimation in Badminton Scene.

Real-time Accurate Ball Trajectory Estimation with "asynchronous" Stereo Camera System for Humanoid Ping-Pong Robot.

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

MonoTrack: Shuttle trajectory reconstruction from monocular badminton video

Tracking Players in a Badminton Court by Two Cameras

Extracting 3D information from broadcast soccer video

A General Framework for 3d Soccer Ball Estimation and Tracking

Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Vision-based movement recognition reveals badminton player footwork using deep learning and binocular positioning

Estimation of control area in badminton doubles with pose information from top and back view drone videos

A Badminton Recognition and Tracking System Based on Context Multi-feature Fusion

Robust 3D Human Pose Estimation from Single Images or Video Sequences

A New Method To Calculate The Camera Focusing Area And Player Position On Playfield In Soccer Video

3D Pose Estimation and Tracking in Handball Actions Using a Monocular Camera

Research on Badminton Teaching Technology Based on Human Pose Estimation Algorithm

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

Visual Tracking Of Players Through Occlusions In Low Resolution

Extracting spatial knowledge from track and field broadcasts for monocular 3D human pose estimation