Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Multiview 3-D Human Motion Tracking with Information Fusion Sampling

Human Tracking Using Improved Sample-Based Joint Probabilistic Data Association Filter.

Error Sensitive Gaussian Particle Filter and Its Evaluation for Contour Tracking

3D head tracking using SIFT-based registration and scale invariant view-based appearance model

Three-dimensional head pose tracking using registration and multi-scale appearance model

Tracking an Object over 200 FPS with the Fusion of Prior Probability and Kalman Filter

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Tracking Generic Human Motion Via Fusion of Low- and High-Dimensional Approaches

Two-camera-based Human Motion Capture

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

3D Human Motion Tracking Combining Part Segmentation and Particle Filter

Multi-object Tracking Via MHT with Multiple Information Fusion in Surveillance Video

Improving 3D Zebrafish Tracking with Multi-View Data Fusion and Global Association

Multiview human pose estimation with unconstrained motions

Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking

A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signals

Markerless Shape and Motion Capture From Multiview Video Sequences

A Multi-cue Fusion Algorithm for Visual Tracking of Human Motion