Abstract:This paper presents the concept and experimental results of a kinematics-based incremental visual servo control approach for robotic manipulators with an eye-in-hand configuration to capture non-cooperative targets autonomously. The vision system is adopted to estimate the real time position and motion of the target by an integrated algorithm of photogrammetry and the adaptive extended Kalman filter. The unknown intercept point of trajectories of the target and the end-effector is dynamically predicted and updated based on the target estimates and is served as the desired position of the end-effector. An incremental control law is developed for the robotic manipulator to avoid multiple solutions of the robotic inverse kinematics. The end-effector is then controlled by the proposed control scheme to approach the dynamically estimated interception point directly. The proposed approach is validated experimentally by custom built robotic manipulator. To demonstrate the effectiveness of the proposed approach, uncertainties, such as, joint flexibility of the robotic manipulator, backlash of actuators, nonlinear target motion, camera mounting bias, etc., have not been considered in the control law. The experimental results show that the predicted minimum tracking time is reduced asymptotically as the end-effector approaches the target, which demonstrate the proposed control scheme is effective and reliable. The advantages of the proposed control approach are: it does not require a robotic dynamic model that most of the existing robotic control based on; it avoids the multiple solution problem in the inverse kinematics; it is insensitive to system uncertainties; and it is much easier for engineering implementation.

Visual Servoing Tracking Control of Uncalibrated Manipulators with a Moving Feature Point.

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

Visual servoing of robots with uncalibrated robot and camera parameters

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Visual Servo Kinematic Control For Robotic Manipulators

Position-based visual servo control of autonomous robotic manipulators

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Visual Tracking of Robots in Uncalibrated Environments

Uncalibrated dynamic visual servoing using line features

Nonlinear Tracking Control for Image-Based Visual Servoing with Uncalibrated Stereo Cameras

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Global Finite-Time Adaptive Control for Uncalibrated Robot Manipulator Based on Visual Servoing.

Trajectory Tracking of Nonholonomic Mobile Robots via Discrete-Time Sliding Mode Controller Based on Uncalibrated Visual Servoing

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Visual Tracking Control for an Uncalibrated Robot System with Unknown Camera Parameters

Adaptive visual servoing control for uncalibrated robot manipulator with uncertain dead-zone constraint

Vision-based Adaptive Tracking Control of Uncertain Nonholonomic Mobile Robots

Adaptive Image-based Visual Servoing of Mobile Manipulator with an Uncalibrated Fixed Camera.