Abstract:This study proposes a multidimensional uncalibrated technique for tracking and grasping dynamic targets by a robotic arm in the eye-in-hand mode. This method avoids complex and cumbersome calibration processes, enabling machine vision tasks to be adaptively applied in a variety of complex environments, which solved the problem of traditional calibration methods being unstable in complex environments. The specific method used in this study is first, in the eye-in-hand mode, the robotic arm moves along the x, y , and z axes in sequence, and images are taken before and after each movement. Thereafter, the image Jacobian matrix is calculated from the three (or more) sets of images collected. Finally, the robotic arm converts the target coordinates in the real-time captured images by the camera into coordinates in the robotic arm coordinate system through the image Jacobian matrix and performs real-time tracking. This study tests the dynamic quasi-Newton method for estimating the Jacobian matrix and optimizes the initialization coupling problem using the orthogonal moving method. This optimization scheme significantly shortens the iteration process, making the uncalibrated technology more fully applied in the field of dynamic object tracking. In addition, this study proposes a servo control algorithm with predictive compensation to mitigate or even eliminate the systematic error caused by time delay in dynamic target tracking in robot visual servo systems.

Full-DOF Calibration-Free Robotic Hand-Eye Coordination Based on Fuzzy Neural Network

Uncalibrated robotic hand-eye coordination of full-degree-of-freedoms based on fuzzy neural network

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

Calibration-Free Robotic Eye-Hand Coordination Based on an Auto Disturbance-Rejection Controller

Robotic Calibration-Free Hand-Eye Coordination Based on Auto Disturbances Rejection Controller

Simultaneous Intrinsic And Extrinsic Calibration Of A Visual-Odometric Sensor System

Robotic uncalibrated hand-eye coordination based on the extended state observer

Nonlinear Visual Mapping Model for 3-D Visual Tracking with Uncalibrated Eye-in-hand Robotic System.

UNCALIBRATED 2D ROBOTIC VISUAL TRACKING BASED ON ARTIFICIAL NEURAL NETWORK

Task-independent Robotic Uncalibrated Hand-Eye Coordination Based on the Extended State Observer

A novel multidimensional uncalibration method applied to six-axis manipulators

Performance analysis of neural network-based uncalibrated hand-eye coordination

Autonomous Robot Calibration for Hand-Eye Coordination

Uncalibrated Hand-Eye Coordination Based HRI on Humanoid Robot

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

Convergence Analysis for the Uncalibrated Robotic Hand–eye Coordination Based on the Unmodeled Dynamics Observer

EYE-IN-HAND 3D ROBOTIC VISUAL TRACKING WITHOUT CALIBRATION

A Simultaneous Hand-Eye Calibration Method for Hybrid Eye-in-Hand/Eye-to-Hand System

Performance Investigation and Improvement for the Uncalibrated Hand-Eye Coordination System

Integrating camera calibration and hand-eye calibration into robot vision

3D stereo estimation and fully automated learning of eye-hand coordination in humanoid robots