Abstract:Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mobile robots. The methods are usually classified as image-based visual servo, position-based visual servo, and hybrid visual servo (HVS) control rules. Mobile manipulation enhances the working range and flexibility of robotic arms. However, there is little work on applying visual servo control rules to the motion of the whole mobile manipulation robot. We propose an HVS motion control method for a mobile manipulation robot which combines a six-degree-of-freedom (6-DOF) robotic arm with a nonholonomic mobile base. Based on the kinematic differential equations of the mobile manipulation robot, the global Jacobian matrix of the whole robot is derived, and the HVS control equation is derived using the whole Jacobian matrix combined with position and visual image information. The distance between the gripper and target is calculated through the observation of the marker by a camera mounted on the gripper. The differences between the positions of the markers’ feature points and the expected positions of them in the image coordinate system are also calculated. These differences are substituted into the control equation to obtain the speed control law of each degree of freedom of the mobile manipulation robot. To avoid the position error caused by observation, we also introduce the Kalman filter to correct the positions and orientations of the end of the manipulator. Finally, the proposed algorithm is validated on a mobile manipulation platform consisting of a Bulldog chassis, a UR5 robotic arm, and a ZED camera.

Hybrid Vision/Force Control of Soft Robot Based on a Deformation Model

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Hybrid Vision-Force Robot Force Control for Tasks on Soft Tissues.

Model and Control of Hybrid Hard-soft Robots Using Model Predictive Control

A Modeling and Data-Driven Control Framework for Rigid-Soft Hybrid Robot with Visual Servoing

Hybrid Motion/Force Control of the Hydraulic Cooperative Manipulator in Constrained Motion

Visual Servoing of Soft Robot Manipulator in Constrained Environments with an Adaptive Controller

Hybrid Visual Servoing Control of a Soft Robot with Compliant Obstacle Avoidance

Visual Servoing Pushing Control of the Soft Robot with Active Pushing Force Regulation

Robust Model-Predictive Deformation Control of a Soft Object by Using a Flexible Continuum Robot

Robot Control Based on Integration of Visual and Force/Torque Sensor Information : Handling of a Deformable Object

Position and Force Hybrid Control of a Flexible Tool Held by a Manipulator Hand

Hybrid Vision-force Control for Human Robot Co-carrying on Ball and Board Systems

Development of an Impedance-based Human-robot Hybrid Interaction System with RNN Force Estimator on Visual Tasks

High-Precision Dynamic Control of Soft Robots with the Physics-Learning Hybrid Modeling Approach

Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators

Real-Time Deformable-Contact-Aware Model Predictive Control for Force-Modulated Manipulation

Design and Implementation of a Hybrid-Driven Soft Robot

Dynamic Hybrid Velocity/force Control of Robot Compliant Motion over Globally Unknown Objects.

Neuro-Fuzzy Hybrid Position/Force Control for a Space Robot with Flexible Dual-Arms.

A Hybrid Position/Force Control Method for a Continuum Robot with Robotic and Environmental Compliance.