Abstract:Hand-eye calibration, as a fundamental task in vision-based robotic systems, aims to estimate the transformation matrix between the coordinate frame of the camera and the robot flange. Most approaches to hand-eye calibration rely on external markers or human assistance. We proposed Look at Robot Base Once (LRBO), a novel methodology that addresses the hand-eye calibration problem without external calibration objects or human support, but with the robot base. Using point clouds of the robot base, a transformation matrix from the coordinate frame of the camera to the robot base is established as I=AXB. To this end, we exploit learning-based 3D detection and registration algorithms to estimate the location and orientation of the robot base. The robustness and accuracy of the method are quantified by ground-truth-based evaluation, and the accuracy result is compared with other 3D vision-based calibration methods. To assess the feasibility of our methodology, we carried out experiments utilizing a low-cost structured light scanner across varying joint configurations and groups of experiments. The proposed hand-eye calibration method achieved a translation deviation of 0.930 mm and a rotation deviation of 0.265 degrees according to the experimental results. Additionally, the 3D reconstruction experiments demonstrated a rotation error of 0.994 degrees and a position error of 1.697 mm. Moreover, our method offers the potential to be completed in 1 second, which is the fastest compared to other 3D hand-eye calibration methods. Code is released at <a class="link-external link-http" href="http://github.com/leihui6/LRBO" rel="external noopener nofollow">this http URL</a>.

Automatic estimation of the object pose for industrial robots

Industrial robot pose estimation using three-dimensional registration

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

Motion Imitation of a Humanoid Robot Via Pose Estimation

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Efficient Encoding and Aligning Viewpoints for 6D Pose Estimation of Unseen Industrial Parts

RGB-D-Based Pose Estimation of Workpieces with Semantic Segmentation and Point Cloud Registration

CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single Camera

A Visual SLAM With Tightly-Coupled Integration of Multi-Object Tracking for Production Workshop

A Positioning System Based on Monocular Vision for Industrial Robots

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Research on Model-Free 6D Object Pose Estimation Based on Vision 3D Matching.

A high-accuracy pose measurement system for robotic automated assembly in large-scale space

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping

Automatic Robot Hand-Eye Calibration Enabled by Learning-Based 3D Vision

Application of 3D Vision Intelligent Calibration and Imaging Technology for Industrial Robots

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Fast and Accurate Pose Estimation for Industrial Workpieces Robotic Picking

Partially Calibrated Camera Based Pose Estimation Of Mobile Robots With Application To Visual Tracking