Abstract:To perform automatic, real-time seam tracking tasks effectively, a robust and accurate seam tracking system must be designed. In this paper, we solve the seam tracking issue using a six-axis welding robot, a line laser sensor and an industrial computer. The processing of welding images is the core of the seam tracking system, which aims to determine the weld feature point in each image. We propose a two-stage weld feature point localization method that combines convolution filter and deep reinforcement learning (CF-DRL) to localize the weld feature point in each welding image robustly and accurately. In the first stage, the weld feature point is roughly tracked using a convolution filter tracker. But the position given by the convolution tracker is sometimes not accurate enough due to the natural gap between visual tracking and seam tracking. Consequently, in the second stage, the weld feature point should be further refined using our trained policy network. Using our two-stage weld feature point localization method, the weld feature points can be determined from noisy images in real time during the welding process. The 3D coordinate values of these points are obtained according to the structured light measurement principle to control the movement of the robot and the torch in real time. A robotic seam tracking system is established based on the equipment and methods mentioned above. Experimental results show that the welding torch runs smoothly with a strong arc light and splash interference. The mean tracking error of our experiments reaches 0.189 mm, which can fulfill actual welding requirements. Several comparison tests have been performed to illustrate the robustness and accuracy of our seam tracking system using our welding image dataset.

Laser Vision Seam Tracking System Based on Image Processing and Continuous Convolution Operator Tracker

A Vision Algorithm for Robot Seam Tracking Based on Laser Ranging

A Seam Tracking System Based on a Laser Vision Sensor

Real-time Seam Tracking Control System Based on Line Laser Visions

Automatic Seam Detection and Tracking System for Robots Based on Laser Vision

Line Laser Visual Servo Control System for Seam Tracking

Laser Vision Seam Automatic Tracking Based on Probability Continuous Model

An On-line Visual Seam Tracking Sensor System During Laser Beam Welding

Research of Laser Vision Seam Detection and Tracking System Based on Depth Hierarchical Feature

A Novel 3D Complex Welding Seam Tracking Method in Symmetrical Robotic MAG Welding Process Using a Laser Vision Sensing

Robotic Seam Tracking System Combining Convolution Filter and Deep Reinforcement Learning

Seam Tracking Investigation Via Striped Line Laser Sensor

Intelligent Perception and Seam Tracking System for Thick Plate Weldments Based on Constant-Focus Optical Path

Arc-Light Based Real-Time Seam Tracking System in Welding Robot

A seam tracing system based on an active optical vision sensor

Seam Tracking of Articulated Robot for Laser Welding Based on Visual Feedback Control

Robotic Seam Tracking System Combining Light-Weight Segmentation Network Design and ADMM-Based Structured Pruning

Robotic Seam Tracking System Combining Lightweight Segmentation Network Design and ADMM-Based Structured Pruning

Robotic Seam Tracking System Based on Vision Sensing and Human-Machine Interaction for Multi-Pass MAG Welding

An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking

Welding Seam Tracking in Robotic Gas Metal Arc Welding