Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Period information detection from motion capture data

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Periodicity Detection of Local Motion.

Recognition of human periodic movements from unstructured information using a motion-based frequency domain approach

A System for Analyzing and Indexing Human-Motion Databases

A probabilistic approach to detect mixed periodic patterns from moving object data

Periodic Motion Detection with ROI-based Similarity Measure and Extrema-Based Reference Selection

Using a Kinect Sensor to Acquire Biological Motion: Toolbox and Evaluation.

A Real-Time Upper Limb Motion Estimation System

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

PERIODICITY DETECTION OF LOCAL MOTION ( WedPmPO 1 ) Author ( s ) : Xiaofeng Tong

Locally weighted PCA regression to recover missing markers in human motion data.

Human Motion Capture Data Retrieval and Segmentation Technology for Professional Sports Training

Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis

Motion Capture Data Analysis in the Instantaneous Frequency-Domain Using Hilbert-Huang Transform

Measuring Accurate Body Parameters Of Dressed Humans With Large-Scale Motion Using A Kinect Sensor

Intelligent Techniques for Processing and Management of Motion Data

Learning realistic human actions from movies.

Leveraging Two Kinect Sensors for Accurate Full-Body Motion Capture

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Non-Periodic Lower-Limb Motion Recognition with Noncontact Capacitive Sensing