Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

A Novel Automatic Tracking Method of Moving Image Sequence Marker Points Uses Kinect and Wireless Network Technology

Design of a cerebral palsy rehabilitation training system based on Kinect motion interactive mode

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

A Sports Training System Based on Kinect Intelligent Wearable Device

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

A New Kinect-Based Posture Recognition Method in Physical Sports Training Based on Urban Data

Real-time Detecting System of High Knee Movement Based on Kinect

Kinect Body Sensor Technology-Based Quantitative Assessment Method for Basketball Teaching

Innovative Application of Computer Vision and Motion Tracking Technology in Sports Training

Human Motion Capture Using Wireless Inertial Sensors

Using a Kinect Sensor to Acquire Biological Motion: Toolbox and Evaluation.

A new approach for tracking human body movements by kinect sensor

Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks

The Application of Human–Computer Interaction Technology Fused With Artificial Intelligence in Sports Moving Target Detection Education for College Athlete

Trajectory Tracking of Joint Based on Kinect

Motion Capture Technology in Sports Scenarios: A Survey

Markerless Motion Capture and Biomechanical Analysis Pipeline

Video Analysis of Belt and Road Sports Events Based on Wireless Network and Artificial Intelligence Technology

Multiple Kinect based system to monitor and analyze key performance indicators of physical training

Weight Training Analysis of Sportsmen with Kinect Bioinformatics for Form Improvement

Visualization of movements in sports training based on multimedia information processing technology