Abstract:AbstractThis paper presents a novel approach for image-based visual servoing of a robot manipulator with an eye-in-hand camera when the camera parameters are not calibrated and the 3-D coordinates of the features are not known. Both point and line features are considered. This paper extends the concept of depth-independent interaction (or image Jacobian) matrix, developed in earlier work for visual servoing using point features and fixed cameras, to the problem using eye-in-hand cameras and point and line features. By using the depth-independent interaction matrix, it is possible to linearly parameterize, by the unknown camera parameters and the unknown coordinates of the features, the closed-loop dynamics of the system. A new algorithm is developed to estimate unknown parameters online by combining the Slotine-Li method with the idea of structure from motion in computer vision. By minimizing the errors between the real and estimated projections of the feature on multiple images captured during motion of the robot, this new adaptive algorithm can guarantee the convergence of the estimated parameters to the real values up to a scale. On the basis of the nonlinear robot dynamics, we proved asymptotic convergence of the image errors by the Lyapunov theory. Experiments have been conducted to demonstrate the performance of the proposed controller.

Visual Tracking of Robots in Uncalibrated Environments

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

Uncalibrated Visual Tracking Control Without Visual Velocity.

Adaptive visual tracking control of uncertain rigid-link electrically driven robotic manipulators with an uncalibrated fixed camera

Vision-based Adaptive Tracking Control of Uncertain Nonholonomic Mobile Robots

Visual servoing of robots with uncalibrated robot and camera parameters

Visual Tracking Control for an Uncalibrated Robot System with Unknown Camera Parameters

Vision-based robotic tracking of moving object with dynamic uncertainty

A Unified Design Method for Adaptive Visual Tracking Control of Robots with Eye-in-hand/fixed Camera Configuration

Adaptive visual servoing control for uncalibrated robot manipulator with uncertain dead-zone constraint

UNCALIBRATED 3D ROBOTIC VISUAL TRACKING BASED ON STEREO VISION

Nonlinear Visual Mapping Model for 3-D Visual Tracking with Uncalibrated Eye-in-hand Robotic System.

Visual Tracking Control of General Robotic Systems

Visual Trajectory Tracking of Wheeled Mobile Robots with Uncalibrated Camera Extrinsic Parameters.

Adaptive Visual Servoing with Imperfect Camera and Robot Parameters

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Robust adaptive visual tracking control for uncertain robotic systems with unknown dead-zone inputs.

Uncalibrated Fixed-Camera Visual Servoing of Robot Manipulators by Considering the Motor Dynamics

Resilient adaptive trajectory tracking control for uncalibrated visual servoing systems with unknown actuator failures