Abstract:Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mobile robots. The methods are usually classified as image-based visual servo, position-based visual servo, and hybrid visual servo (HVS) control rules. Mobile manipulation enhances the working range and flexibility of robotic arms. However, there is little work on applying visual servo control rules to the motion of the whole mobile manipulation robot. We propose an HVS motion control method for a mobile manipulation robot which combines a six-degree-of-freedom (6-DOF) robotic arm with a nonholonomic mobile base. Based on the kinematic differential equations of the mobile manipulation robot, the global Jacobian matrix of the whole robot is derived, and the HVS control equation is derived using the whole Jacobian matrix combined with position and visual image information. The distance between the gripper and target is calculated through the observation of the marker by a camera mounted on the gripper. The differences between the positions of the markers’ feature points and the expected positions of them in the image coordinate system are also calculated. These differences are substituted into the control equation to obtain the speed control law of each degree of freedom of the mobile manipulation robot. To avoid the position error caused by observation, we also introduce the Kalman filter to correct the positions and orientations of the end of the manipulator. Finally, the proposed algorithm is validated on a mobile manipulation platform consisting of a Bulldog chassis, a UR5 robotic arm, and a ZED camera.

Fuzzy Adaptive Model Predictive Control for Image-based Visual Servoing of Robot Manipulators With Kinematic Constraints

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Discrete-Time Visual Servoing Control with Adaptive Image Feature Prediction Based on Manipulator Dynamics

Image Based Visual Servoing Using Takagi-Sugeno Fuzzy Neural Network Controller

A fuzzy CMAC learning approach to image based visual servoing system

A Hierarchical Data-Driven Predictive Control of Image-Based Visual Servoing Systems With Unknown Dynamics

Position-Based Visual Servoing Control for Multi-Joint Hydraulic Manipulator

Adaptive PID Saturate Output Feedback Control of Robot Manipulators

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

Adaptive Robust Motion Control Of Uncertain Manipulators Through Immersion And Invariance Adaptive Visual Servoing

MPPI-VS: Sampling-Based Model Predictive Control Strategy for Constrained Image-Based and Position-Based Visual Servoing

Dynamic Object Tracking for Quadruped Manipulator with Spherical Image-Based Approach

Adaptive 3D Visual Servoing of a Scara Robot Manipulator with Unknown Dynamic and Vision System Parameters

A Novel Uncalibrated Visual Servoing Controller Baesd on Model-Free Adaptive Control Method with Neural Network

Intelligent Servo Control Strategy for Robot Joints with Incremental Bayesian Fuzzy Broad Learning System

Hybrid Model Predictive Control with Penalty Factor Based on Image-Based Visual Servoing for Constrained Mobile Robots

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Fully Uncalibrated Image-Based Visual Servoing of 2DOFs Planar Manipulators With a Fixed Camera

Practical Velocity Tracking Control of a Parallel Robot Based on Fuzzy Adaptive Algorithm

Takagi-Sugeno Fuzzy Modeling and Control for Effective Robotic Manipulator Motion

Image space trajectory tracking of 6-DOF robot manipulator in assisting visual servoing