Abstract:Purpose Visual feedback control is a promising solution for robots work in unstructured environments, and this is accomplished by estimation of the time derivative relationship between the image features and the robot moving. While some of the drawbacks associated with most visual servoing (VS) approaches include the vision–motor mapping computation and the robots’ dynamic performance, the problem of designing optimal and more effective VS systems still remains challenging. Thus, the purpose of this paper is to propose and evaluate the VS method for robots in an unstructured environment. Design/methodology/approach This paper presents a new model-free VS control of a robotic manipulator, for which an adaptive estimator aid by network learning is proposed using online estimation of the vision–motor mapping relationship in an environment without the knowledge of statistical noise. Based on the adaptive estimator, a model-free VS schema was constructed by introducing an active disturbance rejection control (ADRC). In our schema, the VS system was designed independently of the robot kinematic model. Findings The various simulations and experiments were conducted to verify the proposed approach by using an eye-in-hand robot manipulator without calibration and vision depth information, which can improve the autonomous maneuverability of the robot and also allow the robot to adapt its motion according to the image feature changes in real time. In the current method, the image feature trajectory was stable in the camera field range, and the robot’s end motion trajectory did not exhibit shock retreat. The results showed that the steady-state errors of image features was within 19.74 pixels, the robot positioning was stable within 1.53 mm and 0.0373 rad and the convergence rate of the control system was less than 7.21 s in real grasping tasks. Originality/value Compared with traditional Kalman filtering for image-based VS and position-based VS methods, this paper adopts the model-free VS method based on the adaptive mapping estimator combination with the ADRC controller, which is effective for improving the dynamic performance of robot systems. The proposed model-free VS schema is suitable for robots’ grasping manipulation in unstructured environments.

Adapting for Calibration Disturbances: A Neural Uncalibrated Visual Servoing Policy

A Novel Uncalibrated Visual Servoing Controller Baesd on Model-Free Adaptive Control Method with Neural Network

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Model-free Visual Servoing Based on Active Disturbance Rejection Control and Adaptive Estimator for Robotic Manipulation Without Calibration

Robotic Visual-Inertial Calibration via Deep Deterministic Policy Gradient Learning

Adaptive Neural Networks for Image-Based Visual Servoing with Uncertain Parameters

Hybrid Uncalibrated Visual Servoing Control of Harvesting Robots With RGB-D Cameras

Adaptive Neuro-Filtering Based Visual Servo Control of a Robotic Manipulator

Robots Visual Servo Control with Features Constraint Employing Kalman-neural-network Filtering Scheme.

Uncalibrated Adaptive Robot Visual Servoing on Image Space with Parameter Convergence

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Applications of Uncalibrated Image Based Visual Servoing in Micro- and Macroscale Robotics

Model Predictive Control for Uncalibrated Visual Servoing Based on Broyden Estimation

Adaptive Control Algorithm for Uncalibrated Position-based Visual Servoing

Uncalibrated Visual Servoing for Underwater Vehicle Manipulator Systems with an Eye in Hand Configuration Camera

Study on Uncalibrated Visual Servoing Technique

Visual Servoing in Robotic Manufacturing Systems for Accurate Positioning

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Jacobian Estimation with Adaptive Kalman Filter for Uncalibrated Visual Servoing

Uncalibrated Fixed-Camera Visual Servoing of Robot Manipulators by Considering the Motor Dynamics

Visual Servoing Control of Robotics with A Neural Network Estimator Based on Spectral Adaptive Law