Abstract:This paper presents the concept and experimental results of a kinematics-based incremental visual servo control approach for robotic manipulators with an eye-in-hand configuration to capture non-cooperative targets autonomously. The vision system is adopted to estimate the real time position and motion of the target by an integrated algorithm of photogrammetry and the adaptive extended Kalman filter. The unknown intercept point of trajectories of the target and the end-effector is dynamically predicted and updated based on the target estimates and is served as the desired position of the end-effector. An incremental control law is developed for the robotic manipulator to avoid multiple solutions of the robotic inverse kinematics. The end-effector is then controlled by the proposed control scheme to approach the dynamically estimated interception point directly. The proposed approach is validated experimentally by custom built robotic manipulator. To demonstrate the effectiveness of the proposed approach, uncertainties, such as, joint flexibility of the robotic manipulator, backlash of actuators, nonlinear target motion, camera mounting bias, etc., have not been considered in the control law. The experimental results show that the predicted minimum tracking time is reduced asymptotically as the end-effector approaches the target, which demonstrate the proposed control scheme is effective and reliable. The advantages of the proposed control approach are: it does not require a robotic dynamic model that most of the existing robotic control based on; it avoids the multiple solution problem in the inverse kinematics; it is insensitive to system uncertainties; and it is much easier for engineering implementation.

Ukf-Based Visual Tracking With Eye-In-Hand Camera

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Uncalibrated Dynamic Eye-in-hand Visual Tracking of Robots by Observing Unknown Static Objects

Visual Tracking of Robots in Uncalibrated Environments

Autonomous Robotic Capture of Non-Cooperative Target by Adaptive Extended Kalman Filter Based Visual Servo

Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

A Unified Design Method for Adaptive Visual Tracking Control of Robots with Eye-in-hand/fixed Camera Configuration

A New Approach to Dynamic Eye-in-Hand Visual Tracking Using Nonlinear Observers

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Dynamic Visual Tracking with Eye-in-hand Camera

Eye-in-Hand Tracking Control of a Free-Floating Space Manipulator

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Real-time 3D Human Tracking for Mobile Robots with Multisensors

Nonlinear Visual Mapping Model for 3-D Visual Tracking with Uncalibrated Eye-in-hand Robotic System.

EYE-IN-HAND 3D ROBOTIC VISUAL TRACKING WITHOUT CALIBRATION

3D Hand Tracking With Head Mounted Gaze-Directed Camera

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Adaptive visual tracking control of uncertain rigid-link electrically driven robotic manipulators with an uncalibrated fixed camera

Visual Trajectory Tracking of Wheeled Mobile Robots with Uncalibrated Camera Extrinsic Parameters.

A novel multidimensional uncalibration method applied to six-axis manipulators