Abstract:AbstractThis paper presents a novel approach for image-based visual servoing of a robot manipulator with an eye-in-hand camera when the camera parameters are not calibrated and the 3-D coordinates of the features are not known. Both point and line features are considered. This paper extends the concept of depth-independent interaction (or image Jacobian) matrix, developed in earlier work for visual servoing using point features and fixed cameras, to the problem using eye-in-hand cameras and point and line features. By using the depth-independent interaction matrix, it is possible to linearly parameterize, by the unknown camera parameters and the unknown coordinates of the features, the closed-loop dynamics of the system. A new algorithm is developed to estimate unknown parameters online by combining the Slotine-Li method with the idea of structure from motion in computer vision. By minimizing the errors between the real and estimated projections of the feature on multiple images captured during motion of the robot, this new adaptive algorithm can guarantee the convergence of the estimated parameters to the real values up to a scale. On the basis of the nonlinear robot dynamics, we proved asymptotic convergence of the image errors by the Lyapunov theory. Experiments have been conducted to demonstrate the performance of the proposed controller.

Adaptive Visual Servoing with Imperfect Camera and Robot Parameters

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Dynamic Visual Servoing of Robots in Uncalibrated Environments

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Visual servoing of robots with uncalibrated robot and camera parameters

Uncalibrated Fixed-Camera Visual Servoing of Robot Manipulators by Considering the Motor Dynamics

Uncalibrated Image‐Based Visual Servoing of Rigid‐Link Electrically Driven Robotic Manipulators

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Adaptive visual servoing using angle and distance

Uncalibrated dynamic visual servoing using line features

Visual servo of uncalibrated eye-in-hand system with time-delay compensation

An Adaptive Controller for Image-Based Visual Servoing of Robot Manipulators

Adaptive Image-based Visual Servoing of Mobile Manipulator with an Uncalibrated Fixed Camera.

Image-Based Composite Learning Robot Visual Servoing With an Uncalibrated Eye-to-Hand Camera

Adaptive image-based visual servoing of wheeled mobile robots with fixed camera configuration

Uncalibrated Adaptive Robot Visual Servoing on Image Space with Parameter Convergence

Adaptive visual servoing control for uncalibrated robot manipulator with uncertain dead-zone constraint

Dynamic Eye-in-Hand Visual Servoing with Unknown Target Positions

Design of A Finite-Time Adaptive Controller for Image-Based Uncalibrated Visual Servo Systems with Uncertainties in Robot and Camera Models.

Adaptive Visual Servoing Using Common Image Features with Unknown Geometric Parameters

Visual Servoing of Flexible Manipulators With Unknown Camera Intrinsic Parameters and Vibration States