Abstract:Hand-eye calibration is an important step in controlling a vision-guided robot in applications like part assembly, bin picking and inspection operations etc. Many methods for estimating hand-eye transformations have been proposed in literature with varying degrees of complexity and accuracy. However, the success of a vision-guided application is highly impacted by the accuracy the hand-eye calibration of the vision system with the robot. The level of this accuracy depends on several factors such as rotation and translation noise, rotation and translation motion range that must be considered during calibration. Previous studies and benchmarking of the proposed algorithms have largely been focused on the combined effect of rotation and translation noise. This study provides insight on the impact of rotation and translation noise acting in isolation on the hand-eye calibration accuracy. This deviates from the most common method of assessing hand-eye calibration accuracy based on pose noise (combined rotation and translation noise). We also evaluated the impact of the robot motion range used during the hand-eye calibration operation which is rarely considered. We provide quantitative evaluation of our study using six commonly used algorithms from an implementation perspective. We comparatively analyse the performance of these algorithms through simulation case studies and experimental validation using the Universal Robot's UR5e physical robots. Our results show that these different algorithms perform differently when the noise conditions vary rather than following a general trend. For example, the simultaneous methods are more resistant to rotation noise, whereas the separate methods are better at dealing with translation noise. Additionally, while increasing the robot rotation motion span during calibration enhances the accuracy of the separate methods, it has a negative effect on the simultaneous methods. Conversely, increasing the translation motion range improves the accuracy of simultaneous methods but degrades the accuracy of the separate methods. These findings suggest that those conditions should be considered when benchmarking algorithms or performing a calibration process for enhanced accuracy.

An Adaptive Selection of Motion for Online Hand-Eye Calibration

An approach to improve online hand-eye calibration

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

A Simultaneous Optimization Method of Calibration and Measurement for a Typical Hand–Eye Positioning System

A Method to Improve the Accuracy of Hand-Eye Calibration Based on Data Filtering and Parameters Optimization

Online Kinematic Calibration of Robot Manipulator Based on Neural Network

Next-Best-View Selection for Robot Eye-in-Hand Calibration

On-Line Self-Calibration Method For Unattended Manipulators Based On Gaussian Motion Model And Visual System

Accuracy evaluation of hand-eye calibration techniques for vision-guided robots

Performance analysis of neural network-based uncalibrated hand-eye coordination

Robot–Camera Calibration in Tightly Constrained Environment Using Interactive Perception

Calibration-Free Robotic Eye-Hand Coordination Based on an Auto Disturbance-Rejection Controller

A Computationally Efficient Method for Hand–eye Calibration

Motion-based extrinsic sensor-to-sensor calibration: Effect of reference frame selection for new and existing methods

Online Serial Manipulator Calibration Based on Multisensory Process Via Extended Kalman and Particle Filters.

Hand-Eye Calibration Based on Screw Motions

Online robot calibration based on hybrid sensors using Kalman Filters

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Adaptive Control Algorithm for Uncalibrated Position-based Visual Servoing

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable Rendering and Space Exploration