Abstract:Purpose Visual feedback control is a promising solution for robots work in unstructured environments, and this is accomplished by estimation of the time derivative relationship between the image features and the robot moving. While some of the drawbacks associated with most visual servoing (VS) approaches include the vision–motor mapping computation and the robots’ dynamic performance, the problem of designing optimal and more effective VS systems still remains challenging. Thus, the purpose of this paper is to propose and evaluate the VS method for robots in an unstructured environment. Design/methodology/approach This paper presents a new model-free VS control of a robotic manipulator, for which an adaptive estimator aid by network learning is proposed using online estimation of the vision–motor mapping relationship in an environment without the knowledge of statistical noise. Based on the adaptive estimator, a model-free VS schema was constructed by introducing an active disturbance rejection control (ADRC). In our schema, the VS system was designed independently of the robot kinematic model. Findings The various simulations and experiments were conducted to verify the proposed approach by using an eye-in-hand robot manipulator without calibration and vision depth information, which can improve the autonomous maneuverability of the robot and also allow the robot to adapt its motion according to the image feature changes in real time. In the current method, the image feature trajectory was stable in the camera field range, and the robot’s end motion trajectory did not exhibit shock retreat. The results showed that the steady-state errors of image features was within 19.74 pixels, the robot positioning was stable within 1.53 mm and 0.0373 rad and the convergence rate of the control system was less than 7.21 s in real grasping tasks. Originality/value Compared with traditional Kalman filtering for image-based VS and position-based VS methods, this paper adopts the model-free VS method based on the adaptive mapping estimator combination with the ADRC controller, which is effective for improving the dynamic performance of robot systems. The proposed model-free VS schema is suitable for robots’ grasping manipulation in unstructured environments.

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Autonomous Robotic Capture of Non-Cooperative Target by Adaptive Extended Kalman Filter Based Visual Servo

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Visual Servo Kinematic Control For Robotic Manipulators

Position-based visual servo control of autonomous robotic manipulators

Autonomous Robotic Capture of Non-cooperative Target by Vision-based Kinematic Control

Incremental Inverse Kinematics Based Vision Servo for Autonomous Robotic Capture of Non-Cooperative Space Debris

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Vision-based Pose and Motion Estimation of Non-cooperative Target for Space Robotic Manipulators

Dynamic Eye-in-Hand Visual Servoing with Unknown Target Positions

Inverse Kinematics Solving of a Novel Soft Manipulator with Vision and IMU Data

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Autonomous 6-DOF Manipulator Operation for Moving Target by a Capture and Placement Control System

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

A General Visual-Servoing Control Strategy for Active Non-Cooperative Target Tracking of Space Manipulators

Model-free Visual Servoing Based on Active Disturbance Rejection Control and Adaptive Estimator for Robotic Manipulation Without Calibration

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Kinematic-Model-Free Predictive Control for Robotic Manipulator Target Reaching With Obstacle Avoidance

Autonomous Planning and Experiments of Space Robot Based on Hand-eye Measurement

Eye-in-Hand Tracking Control of a Free-Floating Space Manipulator