Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Collision Avoidance for Redundant Robots in Position-Based Visual Servoing

Visualized Trajectory Planning of Flexible Redundant Robotic Arm Using A Novel Hybrid Algorithm

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Obstacle Avoidance Path Planning of Space Redundant Manipulator Based on a Collision Detection Algorithm

Kinematics-based Incremental Visual Servo for Robotic Capture of Non-Cooperative Target.

Visual Servoing Control of Baxter Robot Arms with Obstacle Avoidance Using Kinematic Redundancy

Position-based visual servo control of autonomous robotic manipulators

Visual Servo Kinematic Control For Robotic Manipulators

Incremental Inverse Kinematics Based Vision Servo for Autonomous Robotic Capture of Non-Cooperative Space Debris

Control a Redundant Robot Using Visual Information. Avoidance Control of a Moving Obstacle.

Collision Avoidance for a Redundant Manipulator in an Unstructured Environment with a Simplified Path Planning and Multiple Self-Organizing Maps

Trajectory Planning for Visual Servoing with Some Constraints

On controlling robots with redundancy in an environment with obstacles

Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target

Obstacle Avoidance for Robot Manipulator

A Human-Safe Control for Collision Avoidance by a Redundant Robot Using Visual Information

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Evolutionary multi-objective trajectory optimization for a redundant robot in Cartesian space considering obstacle avoidance

Multiple-Point Obstacle Avoidance Based on 3D Depth Camera Skeleton Modeling and Virtual Potential Field for the Redundant Manipulator

A Spatial Path Following Method for Hyper-Redundant Manipulators by Step-by-Step Search and Calculating

Approach Movement of Redundant Manipulator Using Stereo Vision