Abstract:Hand-eye calibration, as a fundamental task in vision-based robotic systems, aims to estimate the transformation matrix between the coordinate frame of the camera and the robot flange. Most approaches to hand-eye calibration rely on external markers or human assistance. We proposed Look at Robot Base Once (LRBO), a novel methodology that addresses the hand-eye calibration problem without external calibration objects or human support, but with the robot base. Using point clouds of the robot base, a transformation matrix from the coordinate frame of the camera to the robot base is established as I=AXB. To this end, we exploit learning-based 3D detection and registration algorithms to estimate the location and orientation of the robot base. The robustness and accuracy of the method are quantified by ground-truth-based evaluation, and the accuracy result is compared with other 3D vision-based calibration methods. To assess the feasibility of our methodology, we carried out experiments utilizing a low-cost structured light scanner across varying joint configurations and groups of experiments. The proposed hand-eye calibration method achieved a translation deviation of 0.930 mm and a rotation deviation of 0.265 degrees according to the experimental results. Additionally, the 3D reconstruction experiments demonstrated a rotation error of 0.994 degrees and a position error of 1.697 mm. Moreover, our method offers the potential to be completed in 1 second, which is the fastest compared to other 3D hand-eye calibration methods. Code is released at <a class="link-external link-http" href="http://github.com/leihui6/LRBO" rel="external noopener nofollow">this http URL</a>.

EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable Rendering and Space Exploration

EasyHeC++: Fully Automatic Hand-Eye Calibration with Pretrained Image Models

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

Automatic Robot Hand-Eye Calibration Enabled by Learning-Based 3D Vision

Multi-Camera Hand-Eye Calibration for Human-Robot Collaboration in Industrial Robotic Workcells

RegHEC: Hand-Eye Calibration via Simultaneous Multi-view Point Clouds Registration of Arbitrary Object

Latent Space Representations for Marker-Less Realtime Hand-Eye Calibration

GBEC: Geometry-Based Hand-Eye Calibration

Active Hand-Eye Calibration Via Online Accuracy-Driven Next-Best-view Selection

A Simple and Generic Method for Real-time Accurate Hand-eye Calibration Using a 3D Vision Sensor

A Simultaneous Hand-Eye Calibration Method for Hybrid Eye-in-Hand/Eye-to-Hand System

A Computationally Efficient Method for Hand–eye Calibration

New Self-Calibration Approach to Space Robots Based on Hand-Eye Vision

Robotic Hand-Eye Calibration With Depth Camera: A Sphere Model Approach

A Graph-based Optimization Framework for Hand-Eye Calibration for Multi-Camera Setups

Hand-Eye Calibration Technology of Intelligent Picking Robot Using Multiple Photoelectric Sensor Information Fusion

A Method to Improve the Accuracy of Hand-Eye Calibration Based on Data Filtering and Parameters Optimization

Economical Precise Manipulation and Auto Eye-Hand Coordination with Binocular Visual Reinforcement Learning

Industrial Robot Hand-Eye Calibration Combining Data Augmentation and Actor-Critic Network

A Complete Analytical Solution to Hand-Eye Calibration Using Quaternions and Eigenvector-Eigenvalue Identity

Hand-Eye Calibration of IMU and Camera Without External Equipments