Abstract:Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mobile robots. The methods are usually classified as image-based visual servo, position-based visual servo, and hybrid visual servo (HVS) control rules. Mobile manipulation enhances the working range and flexibility of robotic arms. However, there is little work on applying visual servo control rules to the motion of the whole mobile manipulation robot. We propose an HVS motion control method for a mobile manipulation robot which combines a six-degree-of-freedom (6-DOF) robotic arm with a nonholonomic mobile base. Based on the kinematic differential equations of the mobile manipulation robot, the global Jacobian matrix of the whole robot is derived, and the HVS control equation is derived using the whole Jacobian matrix combined with position and visual image information. The distance between the gripper and target is calculated through the observation of the marker by a camera mounted on the gripper. The differences between the positions of the markers’ feature points and the expected positions of them in the image coordinate system are also calculated. These differences are substituted into the control equation to obtain the speed control law of each degree of freedom of the mobile manipulation robot. To avoid the position error caused by observation, we also introduce the Kalman filter to correct the positions and orientations of the end of the manipulator. Finally, the proposed algorithm is validated on a mobile manipulation platform consisting of a Bulldog chassis, a UR5 robotic arm, and a ZED camera.

Based on Kalman Filter the Mobile Manipulator Non-calibration Free Dynamic Target Tracking Technology Research

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

A Maneuvering Target Tracking Scheme for Mobile Robot

Mobile Robot Localization with Improved System Model

Position Estimation for a Mobile Robot with Augmented System State

Mobile Target Tracking Based on Hybrid Open-Loop Monocular Vision Motion Control Strategy

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

A novel multidimensional uncalibration method applied to six-axis manipulators

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Vision-based Adaptive Tracking Control of Uncertain Nonholonomic Mobile Robots

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

A Method of Target Tracking Based on Monocular Vision for Mobile Robot in Unknown Environment

Object Tracking Algorithm based on Kalman Filter and Two Level Feature Matching

Stage Actor Tracking Method Based on Kalman Filter.

Monocular Vision Tracking Based on Hybrid Particle Filters for a Person Following Robot

Robot target localization and interactive multi-mode motion trajectory tracking based on adaptive iterative learning

The-Application-of-Servo-Control-Technology-in-Robot-Positioning-and-Tracking-System-via-Heuristic-Algorithm

Adaptive visual servoing control for uncalibrated robot manipulator with uncertain dead-zone constraint

Fully Uncalibrated Image-Based Visual Servoing of 2DOFs Planar Manipulators With a Fixed Camera

Uncalibrated Visual Servoing Design for Competitive Networked Robots