Abstract:Purpose Visual feedback control is a promising solution for robots work in unstructured environments, and this is accomplished by estimation of the time derivative relationship between the image features and the robot moving. While some of the drawbacks associated with most visual servoing (VS) approaches include the vision–motor mapping computation and the robots’ dynamic performance, the problem of designing optimal and more effective VS systems still remains challenging. Thus, the purpose of this paper is to propose and evaluate the VS method for robots in an unstructured environment. Design/methodology/approach This paper presents a new model-free VS control of a robotic manipulator, for which an adaptive estimator aid by network learning is proposed using online estimation of the vision–motor mapping relationship in an environment without the knowledge of statistical noise. Based on the adaptive estimator, a model-free VS schema was constructed by introducing an active disturbance rejection control (ADRC). In our schema, the VS system was designed independently of the robot kinematic model. Findings The various simulations and experiments were conducted to verify the proposed approach by using an eye-in-hand robot manipulator without calibration and vision depth information, which can improve the autonomous maneuverability of the robot and also allow the robot to adapt its motion according to the image feature changes in real time. In the current method, the image feature trajectory was stable in the camera field range, and the robot’s end motion trajectory did not exhibit shock retreat. The results showed that the steady-state errors of image features was within 19.74 pixels, the robot positioning was stable within 1.53 mm and 0.0373 rad and the convergence rate of the control system was less than 7.21 s in real grasping tasks. Originality/value Compared with traditional Kalman filtering for image-based VS and position-based VS methods, this paper adopts the model-free VS method based on the adaptive mapping estimator combination with the ADRC controller, which is effective for improving the dynamic performance of robot systems. The proposed model-free VS schema is suitable for robots’ grasping manipulation in unstructured environments.

Robot manipulation using image-based visual servoing control with robust state estimation

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Robots Visual Servo Control with Features Constraint Employing Kalman-neural-network Filtering Scheme.

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Visual Servo Kinematic Control For Robotic Manipulators

Position-based visual servo control of autonomous robotic manipulators

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Robust Kalman Filtering Cooperated Elman Neural Network Learning For Vision-Sensing-Based Robotic Manipulation With Global Stability

Autonomous Robotic Capture of Non-Cooperative Target by Adaptive Extended Kalman Filter Based Visual Servo

Visual servoing of robots with uncalibrated robot and camera parameters

Adaptive Neuro-Filtering Based Visual Servo Control of a Robotic Manipulator

Model-free Visual Servoing Based on Active Disturbance Rejection Control and Adaptive Estimator for Robotic Manipulation Without Calibration

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

An Image Based Visual Servo Approach with Deep Learning for Robotic Manipulation

Uncalibrated Image‐Based Visual Servoing of Rigid‐Link Electrically Driven Robotic Manipulators

A Neural Controller for Image-Based Visual Servoing of Manipulators with Physical Constraints

Dynamic Jacobian Identification Based on State-Space for Robot Manipulation

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Robust Kalman filtering with long short-term memory for image-based visual servo control

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Image-Based Visual Servoing Control of Robot Manipulators Using Hybrid Algorithm with Feature Constraints.