Abstract:Purpose Visual feedback control is a promising solution for robots work in unstructured environments, and this is accomplished by estimation of the time derivative relationship between the image features and the robot moving. While some of the drawbacks associated with most visual servoing (VS) approaches include the vision–motor mapping computation and the robots’ dynamic performance, the problem of designing optimal and more effective VS systems still remains challenging. Thus, the purpose of this paper is to propose and evaluate the VS method for robots in an unstructured environment. Design/methodology/approach This paper presents a new model-free VS control of a robotic manipulator, for which an adaptive estimator aid by network learning is proposed using online estimation of the vision–motor mapping relationship in an environment without the knowledge of statistical noise. Based on the adaptive estimator, a model-free VS schema was constructed by introducing an active disturbance rejection control (ADRC). In our schema, the VS system was designed independently of the robot kinematic model. Findings The various simulations and experiments were conducted to verify the proposed approach by using an eye-in-hand robot manipulator without calibration and vision depth information, which can improve the autonomous maneuverability of the robot and also allow the robot to adapt its motion according to the image feature changes in real time. In the current method, the image feature trajectory was stable in the camera field range, and the robot’s end motion trajectory did not exhibit shock retreat. The results showed that the steady-state errors of image features was within 19.74 pixels, the robot positioning was stable within 1.53 mm and 0.0373 rad and the convergence rate of the control system was less than 7.21 s in real grasping tasks. Originality/value Compared with traditional Kalman filtering for image-based VS and position-based VS methods, this paper adopts the model-free VS method based on the adaptive mapping estimator combination with the ADRC controller, which is effective for improving the dynamic performance of robot systems. The proposed model-free VS schema is suitable for robots’ grasping manipulation in unstructured environments.

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Incremental Inverse Kinematics Based Vision Servo for Autonomous Robotic Capture of Non-Cooperative Space Debris

Visual Servo Kinematic Control For Robotic Manipulators

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Autonomous Robotic Capture of Non-Cooperative Target by Adaptive Extended Kalman Filter Based Visual Servo

Autonomous Robotic Capture of Non-cooperative Target by Vision-based Kinematic Control

Position-based visual servo control of autonomous robotic manipulators

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Vision-based Pose and Motion Estimation of Non-cooperative Target for Space Robotic Manipulators

Inverse Kinematics Solving of a Novel Soft Manipulator with Vision and IMU Data

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Model-free Visual Servoing Based on Active Disturbance Rejection Control and Adaptive Estimator for Robotic Manipulation Without Calibration

Dynamic Eye-in-Hand Visual Servoing with Unknown Target Positions

Autonomous 6-DOF Manipulator Operation for Moving Target by a Capture and Placement Control System

Collision Avoidance for Redundant Robots in Position-Based Visual Servoing

A Recurrent Neural Network Approach for Visual Servoing of Manipulators

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

Visual Servoing for Robot Manipulators Considering Sensing and Dynamics Limitations

Design of Kinematic Controller for Real-Time Vision Guided Robot Manipulators