Abstract:This study proposes a multidimensional uncalibrated technique for tracking and grasping dynamic targets by a robotic arm in the eye-in-hand mode. This method avoids complex and cumbersome calibration processes, enabling machine vision tasks to be adaptively applied in a variety of complex environments, which solved the problem of traditional calibration methods being unstable in complex environments. The specific method used in this study is first, in the eye-in-hand mode, the robotic arm moves along the x, y , and z axes in sequence, and images are taken before and after each movement. Thereafter, the image Jacobian matrix is calculated from the three (or more) sets of images collected. Finally, the robotic arm converts the target coordinates in the real-time captured images by the camera into coordinates in the robotic arm coordinate system through the image Jacobian matrix and performs real-time tracking. This study tests the dynamic quasi-Newton method for estimating the Jacobian matrix and optimizes the initialization coupling problem using the orthogonal moving method. This optimization scheme significantly shortens the iteration process, making the uncalibrated technology more fully applied in the field of dynamic object tracking. In addition, this study proposes a servo control algorithm with predictive compensation to mitigate or even eliminate the systematic error caused by time delay in dynamic target tracking in robot visual servo systems.

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Visual Tracking of Robots in Uncalibrated Environments

A Unified Design Method for Adaptive Visual Tracking Control of Robots with Eye-in-hand/fixed Camera Configuration

Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera

A New Approach to Dynamic Eye-in-Hand Visual Tracking Using Nonlinear Observers

Uncalibrated dynamic visual servoing using line features

Dynamic Eye-in-Hand Visual Servoing with Unknown Target Positions

Visual servoing of robots with uncalibrated robot and camera parameters

Uncalibrated Visual Servoing Of Mobile Manipulators With An Eye-To-Hand Camera

Study on algorithm of dynamic uncalibrated eye-in-hand visual servoing system

Eye-in-Hand Tracking Control of a Free-Floating Space Manipulator

Uncalibrated Image‐Based Visual Servoing of Rigid‐Link Electrically Driven Robotic Manipulators

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Adaptive image-based visual servoing of wheeled mobile robots with fixed camera configuration

Ukf-Based Visual Tracking With Eye-In-Hand Camera

Uncalibrated Fixed-Camera Visual Servoing of Robot Manipulators by Considering the Motor Dynamics

Visual Servoing Tracking Control of Uncalibrated Manipulators with a Moving Feature Point.

A novel multidimensional uncalibration method applied to six-axis manipulators