Abstract:Motion parameters measurement is essential for understanding animal behavior, exploring the laws of object motion, and studying control methods. Nowadays, advanced computer vision based on machine learning technology supports markerless object tracking in 2D videos. However, due to the fact that all objects move in three-dimensional space, this paper introduces a method of measuring motion parameters using 3D pose estimation. First, an enhanced iterative bundle adjustment algorithm is proposed for multi-camera calibration in a multi-camera vision system by adding two control parameters, which dramatically reduces the reprojection error of multi-camera calibration and lays the foundation for high-precision triangulation. Then, a new spatiotemporal loss function is proposed, which considers the relationship between key points that do not constitute limbs, thereby improving triangulation accuracy. The new multi-camera calibration algorithm is evaluated on ChArUco and 3D pose estimation for metronome, planet pendulum, human hand, Koi, and cheetah. The experimental results show that: (1) the two hyper-parameters in the enhanced iterative bundle adjustment algorithm effectively suppress the influence of noise and play a good role in reducing the reprojection error of multi-camera calibration; (2) the spatiotemporal loss function has a strong constraining ability, the time loss can stabilize high frame rate video triangulation to maintain accuracy, while the space loss can improve the accuracy of triangulation for more complex structures; (3) multi-view data fusion is also conducive to improving the accuracy of triangulation. Moreover, the method was successfully applied to some actual measurement scenes: (1) the accurate measurement of the frequency of a metronome; and (2) the success measurement of the movement of a Koi, which conforms to the basic model of fish swimming. Some dynamic measurement results are displayed at https://github.com/wux024/AdamPose .

Integration of image sensing and acceleration sensors for calligrapher behavior measurement

Pen-based gesture design and recognition for sketch editing

Pen motion attitude measurement using accelerometer and gyroscope

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Enable Traditional Laptops with Virtual Writing Capability Leveraging Acoustic Signals.

VPad: Virtual Writing Tablet for Laptops Leveraging Acoustic Signals

Handwriting-Assistant

3D Intuitive Gesture Interaction via Motion Sensing

Handwriting-Assistant: Reconstructing Continuous Strokes with Millimeter-level Accuracy via Attachable Inertial Sensors

Translational Tracking Algorithm with Pen-Based MEMS Device

Controlling Non-Touch Screens as Touch Screens Using Airpen, a Writing Tool with In-Air Gesturing Mode

Evaluating Brush Movements for Chinese Calligraphy: a Computer Vision Based Approach

Gesture Recognition with a 3-D Accelerometer

3D Articulated Hand Tracking Based on Behavioral Model

Toward Force-Based Signature Verification: A Pen-Type Sensor and Preliminary Validation

On Sensor Management of Calligraphic Robot

Flexible Capacitive Three-Dimensional Force Sensor for Hand Motion Capture and Handwriting Recognition

&Amp;#x03bc;imu-Based Handwriting Recognition Calibration by Optical Tracking

Detection of Finger Motion Gesture Based on Accelerometer

Self-Calibration Method and Pose Domain Determination of a Light-Pen in a 3D Vision Coordinate Measurement System

Markerless Human-Manipulator Interface with Vibration Feedback Using Multi-sensors.