Abstract:Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mobile robots. The methods are usually classified as image-based visual servo, position-based visual servo, and hybrid visual servo (HVS) control rules. Mobile manipulation enhances the working range and flexibility of robotic arms. However, there is little work on applying visual servo control rules to the motion of the whole mobile manipulation robot. We propose an HVS motion control method for a mobile manipulation robot which combines a six-degree-of-freedom (6-DOF) robotic arm with a nonholonomic mobile base. Based on the kinematic differential equations of the mobile manipulation robot, the global Jacobian matrix of the whole robot is derived, and the HVS control equation is derived using the whole Jacobian matrix combined with position and visual image information. The distance between the gripper and target is calculated through the observation of the marker by a camera mounted on the gripper. The differences between the positions of the markers’ feature points and the expected positions of them in the image coordinate system are also calculated. These differences are substituted into the control equation to obtain the speed control law of each degree of freedom of the mobile manipulation robot. To avoid the position error caused by observation, we also introduce the Kalman filter to correct the positions and orientations of the end of the manipulator. Finally, the proposed algorithm is validated on a mobile manipulation platform consisting of a Bulldog chassis, a UR5 robotic arm, and a ZED camera.

A Task-Priority Coordinated Motion Planner Combined with Visual Servo for Mobile Manipulator*

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Position-based visual servo control of autonomous robotic manipulators

Scalable Motion Planning and Task-Oriented Coordination Scheme for Mobile Manipulators in Smart Manufacturing

Position-Based Visual Servoing Control for Multi-Joint Hydraulic Manipulator

Optimization-based Motion Planning of Mobile Manipulator with High Degree of Kinematic Redundancy

Whole-Body Inverse Kinematics and Operation-Oriented Motion Planning for Robot Mobile Manipulation

Cooperative Motion Planning for Mobile Humanoid Robots Based on the Manipulability Map

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

HCDR-based motion planning for mobile manipulators with the continuous trajectory task

A Hierarchical Motion Planning Method for Mobile Manipulator

Design and Analysis of a Whole-Body Controller for a Velocity Controlled Robot Mobile Manipulator

Visual Servo Kinematic Control For Robotic Manipulators

Real-time Whole-body Motion Planning for Mobile Manipulators Using Environment-adaptive Search and Spatial-temporal Optimization

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

A novel coordinated motion planner based on capability map for autonomous mobile manipulator

Motion Planning Towards Tasks for a Mobile Manipulator with Redundant DOFs

Planning Optimal Trajectories for Mobile Manipulators under End-effector Trajectory Continuity Constraint

Motion Planning for a Mobile Manipulator Considering Stability and Task Constraints

Task-Oriented Motion Planning of a Space Manipulator under Multiple Constraints