Abstract:The image-based visual servoing without models of system is challenging since it is hard to fetch an accurate estimation of hand-eye relationship via merely visual measurement. Whereas, the accuracy of estimated hand-eye relationship expressed in local linear format with Jacobian matrix is important to whole system's performance. In this article, we proposed a finite-time controller as well as a Jacobian matrix estimator in a combination of online and offline way. The local linear formulation is formulated first. Then, we use a combination of online and offline method to boost the estimation of the highly coupled and nonlinear hand-eye relationship with data collected via depth camera. A neural network (NN) is pre-trained to give a relative reasonable initial estimation of Jacobian matrix. Then, an online updating method is carried out to modify the offline trained NN for a more accurate estimation. Moreover, sliding mode control algorithm is introduced to realize a finite-time controller. Compared with previous methods, our algorithm possesses better convergence speed. The proposed estimator possesses excellent performance in the accuracy of initial estimation and powerful tracking capabilities for time-varying estimation for Jacobian matrix compared with other data-driven estimators. The proposed scheme acquires the combination of neural network and finite-time control effect which drives a faster convergence speed compared with the exponentially converge ones. Another main feature of our algorithm is that the state signals in system is proved to be semi-global practical finite-time stable. Several experiments are carried out to validate proposed algorithm's performance.

A New Error Model Based on Adjustable Exponential Basis for Image-Based Visual Servoing

An Extended Immersion and Invariance for Acceleration-Level Pseudo-Dynamic Visual Regulation of Mobile Robots

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

An Optimization Based Vision Calibration Method for PTZ Camera's Errors in Model and Execution

Visual Servoing with an Uncalibrated Eye-in-hand Camera

A Exponential Class Of Model-Free Visual Servoing Controllers In The Presence Of Uncertain Camera Calibration

An Exponential Class Of Visual Servoing Controllers In The Presence Of Uncertain Camera Calibration

Visual servo of uncalibrated eye-in-hand system with time-delay compensation

Dynamic Image-Based Output Feedback Control for Visual Servoing of Multirotors

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Adaptive Extremum Seeking Controller Via Nonlinear Variable Gain for Uncertainty Model Multirotor

Image-Based Composite Learning Robot Visual Servoing With an Uncalibrated Eye-to-Hand Camera

Image-Based Visual Servoing for Three Degree-of-Freedom Robotic Arm with Actuator Faults

Adaptive Finite-Time Model Estimation and Control for Manipulator Visual Servoing using Sliding Mode Control and Neural Networks

Discrete-Time Visual Servoing Control with Adaptive Image Feature Prediction Based on Manipulator Dynamics

Kinematic and Joint Compliance Modeling Method to Improve Position Accuracy of a Robotic Vision System

A Hierarchical Data-Driven Predictive Control of Image-Based Visual Servoing Systems With Unknown Dynamics

A Novel Uncalibrated Visual Servoing Controller Baesd on Model-Free Adaptive Control Method with Neural Network

Unified Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Euclidean Reconstruction.

Fully Uncalibrated Image-Based Visual Servoing of 2DOFs Planar Manipulators With a Fixed Camera

A general approach for geometric error modeling of over-constrained hybrid robot