Abstract:This paper presents the concept and experimental results of a kinematics-based incremental visual servo control approach for robotic manipulators with an eye-in-hand configuration to capture non-cooperative targets autonomously. The vision system is adopted to estimate the real time position and motion of the target by an integrated algorithm of photogrammetry and the adaptive extended Kalman filter. The unknown intercept point of trajectories of the target and the end-effector is dynamically predicted and updated based on the target estimates and is served as the desired position of the end-effector. An incremental control law is developed for the robotic manipulator to avoid multiple solutions of the robotic inverse kinematics. The end-effector is then controlled by the proposed control scheme to approach the dynamically estimated interception point directly. The proposed approach is validated experimentally by custom built robotic manipulator. To demonstrate the effectiveness of the proposed approach, uncertainties, such as, joint flexibility of the robotic manipulator, backlash of actuators, nonlinear target motion, camera mounting bias, etc., have not been considered in the control law. The experimental results show that the predicted minimum tracking time is reduced asymptotically as the end-effector approaches the target, which demonstrate the proposed control scheme is effective and reliable. The advantages of the proposed control approach are: it does not require a robotic dynamic model that most of the existing robotic control based on; it avoids the multiple solution problem in the inverse kinematics; it is insensitive to system uncertainties; and it is much easier for engineering implementation.

A Robust Predictor for Image-Based Visual Servoing

Motion Prediction and Object Detection for Image-Based Visual Servoing Systems Using Deep Learning

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Visual Servoing with an Uncalibrated Eye-in-hand Camera

A Learning Approach to Image-Based Visual Servoing with a Bagging Method of Velocity Calculations

A Hierarchical Data-Driven Predictive Control of Image-Based Visual Servoing Systems With Unknown Dynamics

Discrete-Time Visual Servoing Control with Adaptive Image Feature Prediction Based on Manipulator Dynamics

Adaptive Image-Based Visual Servoing with Temporary Loss of the Visual Signal

Robust Predictive Visual Servoing Control for an Inertially Stabilized Platform with Uncertain Kinematics.

Visual servo of uncalibrated eye-in-hand system with time-delay compensation

Visual Servo Kinematic Control For Robotic Manipulators

Adaptive Image-Based Visual Servoing Using Reinforcement Learning with Fuzzy State Coding

Model Predictive Control for Uncalibrated and Constrained Image-Based Visual Servoing Without Joint Velocity Measurements.

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Adaptive Visual Servoing with Imperfect Camera and Robot Parameters

Model Predictive Control for Constrained Image‐Based Visual Servoing in Uncalibrated Environments

A Robust Feature Extraction Method for Image-Based Visual Servoing.

Image-Based Visual Servoing Control of Robot Manipulators Using Hybrid Algorithm with Feature Constraints.

Robust Kalman filtering with long short-term memory for image-based visual servo control

Deep Learning-Based Pose Prediction for Visual Servoing of Robotic Manipulators Using Image Similarity

Adaptive Neural Networks for Image-Based Visual Servoing with Uncertain Parameters