Abstract:Automated robotic manufacturing systems require accurate robot positioning. Visual servoing is an increasing popular method to enhance such positioning accuracy. Based on the error signal definition, visual servoing is classified into three approaches, Position Based Visual Servoing (PBVS), Image Based Visual Servoing (IBVS) and Hybrid Visual Servoing (HVS). In this research, firstly, a novel Neural Network (NN) based hand-eye calibration is introduced in PBVS. A MultiLayer Perceptron NN is used to approximate the nonlinear coordinate transform from image coordinates to real world coordinates in visual servoing. The main advantages of NN based hand-eye calibration are that it can solve the hand-eye calibration problem without estimating the hand-eye transformation and can improve the object tracking accuracy as well. The experimental results in an industrial manufacturing robot show that the proposed calibration method outperforms the current solving transformation matrix method and free hand-eye calibration method for 2D object tracking. Secondly, a new approach to switching control of IBVS with laser pointer is proposed. The simple off-the-shelf laser pointer is applied to realize the depth estimation. The proposed system is robust to the camera calibration and hand-eye calibration error, and is object model free as well. Comparing with traditional IBVS, it avoids image singularities and image local minima, and is successful for only partial image features in the field of view. Moreover, the trajectory of the robot end effector is shortened. The experimental results are given to verify the effectiveness of the proposed method in a robotic manufacturing system for assembly

Uncalibrated and Unmodeled Image-Based Visual Servoing of Robot Manipulators Using Zeroing Neural Networks

Adapting for Calibration Disturbances: A Neural Uncalibrated Visual Servoing Policy

Adaptive Neural Networks for Image-Based Visual Servoing with Uncertain Parameters

A Recurrent Neural Network Approach for Visual Servoing of Manipulators

Adaptive Neural Networks-Based Visual Servoing Control for Manipulator with Visibility Constraint and Dead-Zone Input

Visual Servo Kinematic Control For Robotic Manipulators

Robots Visual Servo Control with Features Constraint Employing Kalman-neural-network Filtering Scheme.

Model Predictive Control for Constrained Image‐Based Visual Servoing in Uncalibrated Environments

A Novel Uncalibrated Visual Servoing Controller Baesd on Model-Free Adaptive Control Method with Neural Network

Visual Servoing in Robotic Manufacturing Systems for Accurate Positioning

Adaptive NN Based Visual Servoing Control for Robot Manipulator with Field of View Constraints and Dynamic Uncertainties.

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Image-Based Visual Servoing of Manipulators With Unknown Depth: A Recurrent Neural Network Approach

Robot manipulation using image-based visual servoing control with robust state estimation

Visual Servoing Control of Robotics with A Neural Network Estimator Based on Spectral Adaptive Law

A Neural Controller for Image-Based Visual Servoing of Manipulators with Physical Constraints

Adaptive Neural Network-Based Visual Servoing Control for Manipulator with Unknown Output Nonlinearities

Image Based Visual Servoing Using Takagi-Sugeno Fuzzy Neural Network Controller

An Image Based Visual Servo Approach with Deep Learning for Robotic Manipulation

Model Predictive Control for Uncalibrated and Constrained Image-Based Visual Servoing Without Joint Velocity Measurements.

Artificial neural network based control strategy research and simulation on robot uncalibrated visual servoing system