Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Pose Measurement of Small-Size Aircraft Based on Machine Vision

Pose Alignment of Aircraft Structures with Distance Sensors and CCD Cameras

A measurement method of motion parameters in aircraft ground tests using computer vision

Position and pose measurement technology of space combination ground experiment based on machine vision

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Posture Alignment and Joining Test System for Large Aircraft Fuselages

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Large-Scale Aircraft Pose Estimation System Based on Depth Cameras

Research on the Pose Error Compensation Technology for the Mass and Centroid Measurement of Large-Sized Aircraft Based on Kinematics

Optical and Dynamic Measuring System for Movement Data of Aircraft Structural Parts

Height Estimation Method for Landing of Small Unmanned Helicopter Based on Monocular Vision

Close-range Optical Measurement of Aircraft's 3D Attitude and Accuracy Evaluation

Novel Pose Measurement with Optimized Principal Component Analysis for Unknown Spacecraft Based on Point Cloud

Optical Probe Pose Estimation in the Vision Measurement

Measurement Approach for the Pose of Flanges in Cabin Assemblies through Distributed Vision

Study on the Technologies of Rapid Three-dimensional Optical Measurement and Modeling for Large Airplane

A Combined Measurement Method for Large-Size Aerospace Components

A Ground Target Positioning Method Facing Small UAVs

Adaptive Positioning of Large-Scale Aircraft Components Using a Simplified Image-Based Visual Servoing Via Online Measurement of Ball-Head Center

Bidirectional Closed Cloud Control for Stereo Vision Measurement Based on Multi-Source Data

Pose measurement method for non-cooperative space vehicle using multiple non-overlapping cameras