Abstract:This paper presents the concept and experimental results of a kinematics-based incremental visual servo control approach for robotic manipulators with an eye-in-hand configuration to capture non-cooperative targets autonomously. The vision system is adopted to estimate the real time position and motion of the target by an integrated algorithm of photogrammetry and the adaptive extended Kalman filter. The unknown intercept point of trajectories of the target and the end-effector is dynamically predicted and updated based on the target estimates and is served as the desired position of the end-effector. An incremental control law is developed for the robotic manipulator to avoid multiple solutions of the robotic inverse kinematics. The end-effector is then controlled by the proposed control scheme to approach the dynamically estimated interception point directly. The proposed approach is validated experimentally by custom built robotic manipulator. To demonstrate the effectiveness of the proposed approach, uncertainties, such as, joint flexibility of the robotic manipulator, backlash of actuators, nonlinear target motion, camera mounting bias, etc., have not been considered in the control law. The experimental results show that the predicted minimum tracking time is reduced asymptotically as the end-effector approaches the target, which demonstrate the proposed control scheme is effective and reliable. The advantages of the proposed control approach are: it does not require a robotic dynamic model that most of the existing robotic control based on; it avoids the multiple solution problem in the inverse kinematics; it is insensitive to system uncertainties; and it is much easier for engineering implementation.

Eye-in-Hand Tracking Control of a Free-Floating Space Manipulator

Dynamic Eye-in-Hand Visual Servoing with Unknown Target Positions

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Dynamic Visual Tracking with Eye-in-hand Camera

A New Approach to Dynamic Eye-in-Hand Visual Tracking Using Nonlinear Observers

Position-based visual servo control of autonomous robotic manipulators

Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Visual Tracking of Robots in Uncalibrated Environments

A Unified Design Method for Adaptive Visual Tracking Control of Robots with Eye-in-hand/fixed Camera Configuration

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Visual Servo Kinematic Control For Robotic Manipulators

Uncalibrated Visual Servoing for Underwater Vehicle Manipulator Systems with an Eye in Hand Configuration Camera

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

A Motion Planning Method Based Vision Servo For Free-Flying Space Robot Capturing A Tumbling Satellite

Adaptive visual tracking control of uncertain rigid-link electrically driven robotic manipulators with an uncalibrated fixed camera

Ukf-Based Visual Tracking With Eye-In-Hand Camera

Uncalibrated Visual Servoing Of Mobile Manipulators With An Eye-To-Hand Camera