Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Human Motion Capture Data Retrieval and Segmentation Technology for Professional Sports Training

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Performance-Driven Motion Retrieval and its Usability Evaluation

Human motion segmentation using collaborative representations of 3D skeletal sequences.

A Motion-based User Interface for the Control of Virtual Humans Performing Sports.

Visualization of movements in sports training based on multimedia information processing technology

MV-Sports: A Motion and Vision Sensor Integration-Based Sports Analysis System

A System for Analyzing and Indexing Human-Motion Databases

Motion retrieval based on movement notation language: Motion Capture and Retrieval

Human motion retrieval based on freehand sketch

Human Motion Capture Using Wireless Inertial Sensors

SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videos

Motion Capture Technology in Sports Scenarios: A Survey

A group of novel approaches and a toolkit for motion capture data reusing

Multi-view Human Motion Capture with an Improved Deformation Skin Model

Segmentation of Human Motion Capture Data Based on Laplasse Eigenmaps.

The Selecting Optimal Ball-Receiving Body Parts Using Pose Sequence Analysis and Sports Biomechanics

Human Motion Tracking Using 3D Image Features with a Long Short-Term Memory Mechanism Model—An Example of Forward Reaching

A Semantic Feature for Human Motion Retrieval

Human Motion Capture Using Color Markers

Research and Implementation of the Sports Analysis System Based on 3D Image Technology