Abstract:The image-based visual servoing without models of system is challenging since it is hard to fetch an accurate estimation of hand-eye relationship via merely visual measurement. Whereas, the accuracy of estimated hand-eye relationship expressed in local linear format with Jacobian matrix is important to whole system's performance. In this article, we proposed a finite-time controller as well as a Jacobian matrix estimator in a combination of online and offline way. The local linear formulation is formulated first. Then, we use a combination of online and offline method to boost the estimation of the highly coupled and nonlinear hand-eye relationship with data collected via depth camera. A neural network (NN) is pre-trained to give a relative reasonable initial estimation of Jacobian matrix. Then, an online updating method is carried out to modify the offline trained NN for a more accurate estimation. Moreover, sliding mode control algorithm is introduced to realize a finite-time controller. Compared with previous methods, our algorithm possesses better convergence speed. The proposed estimator possesses excellent performance in the accuracy of initial estimation and powerful tracking capabilities for time-varying estimation for Jacobian matrix compared with other data-driven estimators. The proposed scheme acquires the combination of neural network and finite-time control effect which drives a faster convergence speed compared with the exponentially converge ones. Another main feature of our algorithm is that the state signals in system is proved to be semi-global practical finite-time stable. Several experiments are carried out to validate proposed algorithm's performance.

Black-box Modeling of a 2-DOF Manipulator in the Image Plane Using Recurrent Neurofuzzy Networks

Variable Force Tracking Control Via Online Learning

A Neuro-Fuzzy Visual Servoing Controller for an Articulated Manipulator

Visual Servoing Control Based on Fuzzy Behavior and Neural Networks

Adaptive Neural Network-Based Visual Servoing Control for Manipulator with Unknown Output Nonlinearities

A Recurrent Neural Network Approach for Visual Servoing of Manipulators

Adaptive Neural Networks-Based Visual Servoing Control for Manipulator with Visibility Constraint and Dead-Zone Input

Adaptive NN Based Visual Servoing Control for Robot Manipulator with Field of View Constraints and Dynamic Uncertainties.

Adaptive Neuro-Filtering Based Visual Servo Control of a Robotic Manipulator

Visual Servo Kinematic Control For Robotic Manipulators

A Neural Controller for Image-Based Visual Servoing of Manipulators with Physical Constraints

Disturbance-Observer-Based Fuzzy Control for a Robot Manipulator Using an EMG-Driven Neuromusculoskeletal Model

Adaptive Finite-Time Model Estimation and Control for Manipulator Visual Servoing using Sliding Mode Control and Neural Networks

An Image Based Visual Servo Approach with Deep Learning for Robotic Manipulation

Fuzzy Adaptive Model Predictive Control for Image-based Visual Servoing of Robot Manipulators With Kinematic Constraints

Image-Based Visual Servoing of Manipulators With Unknown Depth: A Recurrent Neural Network Approach

Nonlinear Observer-Based Visual Servoing and Vibration Control of Flexible Robotic Manipulators with a Fixed Camera.

Uncalibrated and Unmodeled Image-Based Visual Servoing of Robot Manipulators Using Zeroing Neural Networks

Robust Kalman Filtering Cooperated Elman Neural Network Learning For Vision-Sensing-Based Robotic Manipulation With Global Stability

Vision-based neural predictive tracking control for multi-manipulator systems with parametric uncertainty

Image Based Visual Servoing Using Takagi-Sugeno Fuzzy Neural Network Controller