Abstract:Hand-eye calibration is an important step in controlling a vision-guided robot in applications like part assembly, bin picking and inspection operations etc. Many methods for estimating hand-eye transformations have been proposed in literature with varying degrees of complexity and accuracy. However, the success of a vision-guided application is highly impacted by the accuracy the hand-eye calibration of the vision system with the robot. The level of this accuracy depends on several factors such as rotation and translation noise, rotation and translation motion range that must be considered during calibration. Previous studies and benchmarking of the proposed algorithms have largely been focused on the combined effect of rotation and translation noise. This study provides insight on the impact of rotation and translation noise acting in isolation on the hand-eye calibration accuracy. This deviates from the most common method of assessing hand-eye calibration accuracy based on pose noise (combined rotation and translation noise). We also evaluated the impact of the robot motion range used during the hand-eye calibration operation which is rarely considered. We provide quantitative evaluation of our study using six commonly used algorithms from an implementation perspective. We comparatively analyse the performance of these algorithms through simulation case studies and experimental validation using the Universal Robot's UR5e physical robots. Our results show that these different algorithms perform differently when the noise conditions vary rather than following a general trend. For example, the simultaneous methods are more resistant to rotation noise, whereas the separate methods are better at dealing with translation noise. Additionally, while increasing the robot rotation motion span during calibration enhances the accuracy of the separate methods, it has a negative effect on the simultaneous methods. Conversely, increasing the translation motion range improves the accuracy of simultaneous methods but degrades the accuracy of the separate methods. These findings suggest that those conditions should be considered when benchmarking algorithms or performing a calibration process for enhanced accuracy.

Feasibility of the Hand–Eye Algorithm in Sensor-to-Sensor Calibration of Wearable Devices

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

A novel functional calibration method for real-time elbow joint angles estimation with magnetic-inertial sensors

Novel Adaptive Sensor Fusion Methodology for Hand Pose Estimation with Multileap Motion

Inertial Measurement Unit Sensor-to-Segment Calibration Comparison for Sport-Specific Motion Analysis

Comparison of Six Sensor Fusion Algorithms with Electrogoniometer Estimation of Wrist Angle in Simulated Work Tasks

Self-Contained and Automatic Calibration of a Multi-Fingered Hand Using Only Pairwise Contact Measurements

Autonomous Robot Calibration for Hand-Eye Coordination

Improved Estimation of Elbow Flexion Angle from IMU Measurements Using Anatomical Constraints

Uncalibrated Hand-Eye Coordination Based HRI on Humanoid Robot

Hand-Eye Camera Calibration with an Optical Tracking System

Accuracy evaluation of hand-eye calibration techniques for vision-guided robots

Shoulder Range of Motion Measurement Using Inertial Measurement Unit-Validation with a Robot Arm

Robot self‐calibration using actuated 3D sensors

Counting Finger and Wrist Movements Using Only a Wrist-Worn, Inertial Measurement Unit: Toward Practical Wearable Sensing for Hand-Related Healthcare Applications

A Simultaneous Optimization Method of Calibration and Measurement for a Typical Hand–Eye Positioning System

Submillimeter-Accurate Markerless Hand–Eye Calibration Based on a Robot's Flange Features

Sensor-Movement-Robust Angle Estimation for 3-DoF Lower Limb Joints Without Calibration

Hand-Eye Calibration Technology of Intelligent Picking Robot Using Multiple Photoelectric Sensor Information Fusion

Measurement Accuracy of an Upper Limb Tracking System Based on Two Hillcrest Labs BNO080 IMU Sensors: An Environmental Assessment

Self-Calibrated Multi-Sensor Wearable for Hand Tracking and Modeling