Abstract:This paper presents a method for hand-eye camera calibration via an optical tracking system (OTS) faciltating robotic applications. The camera pose cannot be directly tracked via the OTS. Because of this, a transformation matrix between a marker-plate pose, tracked via the OTS, and the camera pose needs to be estimated. To this end, we evaluate two different approaches for hand-eye calibration. In the first approach, the camera is in a fixed position and a 2D calibration plate is displaced. In the second approach, the camera is also fixed, but now a 3D calibration object is moved. The first step of our method consists of collecting N views of the marker-plate pose and the calibration plates, acquired via OTS. This is achieved by keeping the camera fixed and moving the calibration plate, while taking a picture of the calibration plate using the camera. A dataset is constructed that contains marker-plate poses and the relative camera poses. Afterwards, the transformation matrix is then computed, following a least-squares minimization. Accuracy in hand-eye calibration is computed in terms of re-projection error, calculated based on camera homography transformations. For both approaches, we measure the changes in accuracy as a function of the number of poses used for each calibration, while we define the minimum number of poses required to obtain a good camera calibration. Results of the experiments show similar performances for the two evaluated methods, achieving a median value of the re-projection error at N = 25 poses of 0.76 mm for the 2D calibration plate and 0.70 mm for the 3D calibration object. Also, we have found that minimally 15 poses are required to achieve a good camera calibration.

EYE-IN-HAND 3D ROBOTIC VISUAL TRACKING WITHOUT CALIBRATION

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Simultaneous Intrinsic And Extrinsic Calibration Of A Visual-Odometric Sensor System

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Automatic Robot Hand-Eye Calibration Enabled by Learning-Based 3D Vision

Robot self‐calibration using actuated 3D sensors

Uncalibrated Visual Servoing Design for Competitive Networked Robots

A novel multidimensional uncalibration method applied to six-axis manipulators

Vision-based Adaptive Tracking Control of Uncertain Nonholonomic Mobile Robots

Hand-eye calibration method with a three-dimensional-vision sensor considering the rotation parameters of the robot pose

Using Neural Network Technique in Vision-based Robot Curve Tracking

Improved Calibration of Eye-in-Hand Robotic Vision System Based on Binocular Sensor

Using Neural Network Technique Invision-Based RobotCurveTracking

Economical Precise Manipulation and Auto Eye-Hand Coordination with Binocular Visual Reinforcement Learning

Visual Trajectory Tracking of Wheeled Mobile Robots with Uncalibrated Camera Extrinsic Parameters.

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Robot–Camera Calibration in Tightly Constrained Environment Using Interactive Perception

Accurate Real‐time 3D Gaze Tracking Using a Lightweight Eyeball Calibration

Hand-Eye Camera Calibration with an Optical Tracking System