Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Pose And Motion Estimation From Vision Based On The First-Order Interpolation Filter

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

Gaussian Particle Filter Based Pose and Motion Estimation

Motion Imitation of a Humanoid Robot Via Pose Estimation

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Real-time Accurate Ball Trajectory Estimation with "asynchronous" Stereo Camera System for Humanoid Ping-Pong Robot.

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Robust Camera Motion Estimation in Video Sequences

3D motion estimation from a stereo image sequence using dual-sequential-Kalman-filter

Motion Recovery Using the Image Interpolation Algorithm and an RGB-D Camera

Three-dimensional motion estimation by straight-line and endpoint optical flow

An Application Of Unscented Kalman Filter For Pose And Motion Estimation Based On Monocular Vision

Monocular Vision-Based Iterative Pose Estimation Algorithm from Corresponding Feature Points

Vision Based Real-Time Pose Estimation for Intelligent Vehicles

Fast Binocular Depth Inference via Bidirectional Motion Based Interpolation

Linear Model for 3d Motion Estimation and Shape Reconstruction Based on the Straight-Line Optical Flow

Fast vision-based pose estimation iterative algorithm

Structure and Motion for Intelligent Vehicles Using an Uncalibrated Two-Camera System

Real time pose estimation based on extended Kalman filter for binocular camera

Visualizing and Quantifying Small and Nonstationary Structural Motions in Video Measurement.

Stereovision-based Initial Pose Estimation Relative to Non-Cooperative Space Target