Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Projection Analysis Optimization for Human Transition Motion Estimation

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

A Convex Optimization Approach for Online Human Walking Motion Adaptation

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Motion Imitation of a Humanoid Robot Via Pose Estimation

[Eicosanoids released in vitro by human alveolar macrophages from normal subjects and asthmatics].

Predicting Missing Markers In Human Motion Capture Using L1-Sparse Representation

Real-time Controllable Motion Transition for Characters.

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

3D Human Motion Synthesis Based on Nonlinear Manifold Learning

An Optimization Based Framework for Human Pose Estimation

Learning Semantic Latent Directions for Accurate and Controllable Human Motion Prediction

Articulated Human Motion Tracking by Sequential Annealed Particle Swarm Optimization.

Human motion tracking by temporal-spatial local gaussian process experts

Physics-based Scene Layout Generation from Human Motion

Efficient Human Motion Reconstruction from Monocular Videos with Physical Consistency Loss.

Motion Diffusion-Guided 3D Global HMR from a Dynamic Camera

Efficient 3D Recovery of Human Motion in Monocular Video

Motion Transition with Balance Control

Physics-Guided Human Motion Capture with Pose Probability Modeling