Abstract:Hand-eye calibration, as a fundamental task in vision-based robotic systems, aims to estimate the transformation matrix between the coordinate frame of the camera and the robot flange. Most approaches to hand-eye calibration rely on external markers or human assistance. We proposed Look at Robot Base Once (LRBO), a novel methodology that addresses the hand-eye calibration problem without external calibration objects or human support, but with the robot base. Using point clouds of the robot base, a transformation matrix from the coordinate frame of the camera to the robot base is established as I=AXB. To this end, we exploit learning-based 3D detection and registration algorithms to estimate the location and orientation of the robot base. The robustness and accuracy of the method are quantified by ground-truth-based evaluation, and the accuracy result is compared with other 3D vision-based calibration methods. To assess the feasibility of our methodology, we carried out experiments utilizing a low-cost structured light scanner across varying joint configurations and groups of experiments. The proposed hand-eye calibration method achieved a translation deviation of 0.930 mm and a rotation deviation of 0.265 degrees according to the experimental results. Additionally, the 3D reconstruction experiments demonstrated a rotation error of 0.994 degrees and a position error of 1.697 mm. Moreover, our method offers the potential to be completed in 1 second, which is the fastest compared to other 3D hand-eye calibration methods. Code is released at <a class="link-external link-http" href="http://github.com/leihui6/LRBO" rel="external noopener nofollow">this http URL</a>.

Autonomous Robot Calibration for Hand-Eye Coordination

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

Simultaneous Intrinsic And Extrinsic Calibration Of A Visual-Odometric Sensor System

Automatic self-contained calibration of an industrial dual-arm robot with cameras using self-contact, planar constraints, and self-observation

Robot self‐calibration using actuated 3D sensors

Automatic Eye-in-Hand Calibration using EKF

A Vision-Based Fully-Automatic Calibration Method for Hand-Eye Serial Robot

A Simultaneous Hand-Eye Calibration Method for Hybrid Eye-in-Hand/Eye-to-Hand System

Uncalibrated Hand-Eye Coordination Based HRI on Humanoid Robot

Self-calibration from image derivatives for active vision systems

Automatic Robot Hand-Eye Calibration Enabled by Learning-Based 3D Vision

Robot Hand-Eye Calibration using Structure-from-Motion

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Self-Contained and Automatic Calibration of a Multi-Fingered Hand Using Only Pairwise Contact Measurements

A novel multidimensional uncalibration method applied to six-axis manipulators

Multi-Camera Hand-Eye Calibration for Human-Robot Collaboration in Industrial Robotic Workcells

Simultaneous Robot–world and Hand–eye Calibration Based on a Pair of Dual Equations

Simultaneous Calibration of the Hand-Eye, Flange-Tool and Robot-Robot Relationship in Dual-Robot Collaboration Systems

3D stereo estimation and fully automated learning of eye-hand coordination in humanoid robots

Hand-eye Calibration of Dual Mechanical Arms of Explosive Ordnance Disposal Robot

Next-Best-View Selection for Robot Eye-in-Hand Calibration