Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

3D Upper Limb Motion Modeling and Estimation Using Wearable Micro-sensors

Wearable Sensors for 3D Upper Limb Motion Modeling and Ubiquitous Estimation

Human Motion Capture Using Wireless Inertial Sensors

Ubiquitous Human Body Motion Capture Using Micro-Sensors

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

A Scalable and Wearable Self-Sensing IMU Sensor Network for Personalized Human Motion and Deformation Capture

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

A wearable motion capture device able to detect dynamic motion of human limbs

A Real-Time Upper Limb Motion Estimation System

3D Deformation Capture Via a Configurable Self-Sensing IMU Sensor Network

Markerless Motion Capture Using Appearance and Inertial Data

Articulated-model based upper-limb pose estimation

A Method to Extract Motion Velocities of Limb and Trunk in Human Locomotion

Whole-Body Human Kinematics Estimation using Dynamical Inverse Kinematics and Contact-Aided Lie Group Kalman Filter

Sensor network oriented human motion capture via wearable intelligent system

Human upper limb dynamic motion measurement based on multi-dimensional video system

Motion Reconstruction from Sparse Accelerometer Data Using PLSR

Leveraging Two Kinect Sensors for Accurate Full-Body Motion Capture

Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile

Development of a Hybrid Motion Capture Method Using MYO Armband with Application to Teleoperation

Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture