Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Structured Light-Based Visual Servoing for Robotic Pipe Welding Pose Optimization

An automatic calibration algorithm for endoscopic structured light sensors in cylindrical environment

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

Automatic 3D Seam Extraction Method for Welding Robot Based on Monocular Structured Light

Structured light welding seam tracing system based on wheel-pedrail robot

A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor

Visual Servoing Based on Geometric Features by Surface Structured Light

Motion navigation for arc welding robots based on feature mapping in a simulation environment

Seam Tracking of Articulated Robot for Laser Welding Based on Visual Feedback Control

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

A Feature Matching Algorithm Applied to Welding Trajectory Revising

A novel offline programming approach of robot welding for multi-pipe intersection structures based on NSGA-II and measured 3D point-clouds

A 3D seam extraction and tracking method based on binocular structured light sensor

Vision-Aided Robotic Welding: An Approach and a Flexible Implementation

A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision

Point Cloud 3D Weldment Reconstruction and Welding Feature Extraction for Robotic Multi-bead Arc Weld Cladding Path Plaanning

Auto Identification of Weld Seam’s Initial Position for Visual Servoing Weld Robot

Intelligent Guidance Programming of Welding Robot for 3D Curved Welding Seam

Research on Welding Guidance System of Intelligent Perception for Steel Weldment

Robotic Visual Servoing Using Fringe Projection Profilometry

Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy