Abstract:Purpose Visual feedback control is a promising solution for robots work in unstructured environments, and this is accomplished by estimation of the time derivative relationship between the image features and the robot moving. While some of the drawbacks associated with most visual servoing (VS) approaches include the vision–motor mapping computation and the robots’ dynamic performance, the problem of designing optimal and more effective VS systems still remains challenging. Thus, the purpose of this paper is to propose and evaluate the VS method for robots in an unstructured environment. Design/methodology/approach This paper presents a new model-free VS control of a robotic manipulator, for which an adaptive estimator aid by network learning is proposed using online estimation of the vision–motor mapping relationship in an environment without the knowledge of statistical noise. Based on the adaptive estimator, a model-free VS schema was constructed by introducing an active disturbance rejection control (ADRC). In our schema, the VS system was designed independently of the robot kinematic model. Findings The various simulations and experiments were conducted to verify the proposed approach by using an eye-in-hand robot manipulator without calibration and vision depth information, which can improve the autonomous maneuverability of the robot and also allow the robot to adapt its motion according to the image feature changes in real time. In the current method, the image feature trajectory was stable in the camera field range, and the robot’s end motion trajectory did not exhibit shock retreat. The results showed that the steady-state errors of image features was within 19.74 pixels, the robot positioning was stable within 1.53 mm and 0.0373 rad and the convergence rate of the control system was less than 7.21 s in real grasping tasks. Originality/value Compared with traditional Kalman filtering for image-based VS and position-based VS methods, this paper adopts the model-free VS method based on the adaptive mapping estimator combination with the ADRC controller, which is effective for improving the dynamic performance of robot systems. The proposed model-free VS schema is suitable for robots’ grasping manipulation in unstructured environments.

Visual Servo Kinematic Control For Robotic Manipulators

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Autonomous Robotic Capture of Non-Cooperative Target by Adaptive Extended Kalman Filter Based Visual Servo

Position-based visual servo control of autonomous robotic manipulators

Autonomous Robotic Capture of Non-cooperative Target by Vision-based Kinematic Control

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Incremental Inverse Kinematics Based Vision Servo for Autonomous Robotic Capture of Non-Cooperative Space Debris

Inverse Kinematics Solving of a Novel Soft Manipulator with Vision and IMU Data

Position-Based Visual Servoing Control for Multi-Joint Hydraulic Manipulator

Autonomous 6-DOF Manipulator Operation for Moving Target by a Capture and Placement Control System

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Visual Servoing for Robot Manipulators Considering Sensing and Dynamics Limitations

Model-free Visual Servoing Based on Active Disturbance Rejection Control and Adaptive Estimator for Robotic Manipulation Without Calibration

Image-Based Visual Servoing for Enhanced Cooperation of Dual-Arm Manipulation

Robot manipulation using image-based visual servoing control with robust state estimation

Adaptive Neuro-Filtering Based Visual Servo Control of a Robotic Manipulator

Design of Kinematic Controller for Real-Time Vision Guided Robot Manipulators

Visual Tracking Control of General Robotic Systems