Abstract:To perform automatic, real-time seam tracking tasks effectively, a robust and accurate seam tracking system must be designed. In this paper, we solve the seam tracking issue using a six-axis welding robot, a line laser sensor and an industrial computer. The processing of welding images is the core of the seam tracking system, which aims to determine the weld feature point in each image. We propose a two-stage weld feature point localization method that combines convolution filter and deep reinforcement learning (CF-DRL) to localize the weld feature point in each welding image robustly and accurately. In the first stage, the weld feature point is roughly tracked using a convolution filter tracker. But the position given by the convolution tracker is sometimes not accurate enough due to the natural gap between visual tracking and seam tracking. Consequently, in the second stage, the weld feature point should be further refined using our trained policy network. Using our two-stage weld feature point localization method, the weld feature points can be determined from noisy images in real time during the welding process. The 3D coordinate values of these points are obtained according to the structured light measurement principle to control the movement of the robot and the torch in real time. A robotic seam tracking system is established based on the equipment and methods mentioned above. Experimental results show that the welding torch runs smoothly with a strong arc light and splash interference. The mean tracking error of our experiments reaches 0.189 mm, which can fulfill actual welding requirements. Several comparison tests have been performed to illustrate the robustness and accuracy of our seam tracking system using our welding image dataset.

Automatic Seam Detection of Welding Robots Using Deep Learning

Automatic Seam Detection and Tracking System for Robots Based on Laser Vision

Weld Seam Tracking and Detection Robot Based on Artificial Intelligence Technology

A New Welding Seam Recognition Methodology Based on Deep Learning Model MRCNN

Weld Seam Identification and Tracking of Inspection Robot Based on Deep Learning Network

Weld Seam Detection Based on Visual Saliency for Autonomous Welding Robots.

A Vision Algorithm for Robot Seam Tracking Based on Laser Ranging

An Intelligent Seam Detection Method for Welding Robots Based on Image Guided Point Cloud Registration

Weld Seam Detection Method with Rotational Region Proposal Network.

Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy

Weld Image Recognition Based on Deep Learning

A Robust Detector for Automated Welding Seam Tracking System

Automatic 3D Seam Extraction Method for Welding Robot Based on Monocular Structured Light

Robotic Seam Tracking System Combining Convolution Filter and Deep Reinforcement Learning

A Robust Weld Seam Recognition Method under Heavy Noise Based on Structured-Light Vision

Robust seam tracking via a deep learning framework combining tracking and detection

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

Automatic Identification of Multi-Type Weld Seam Based on Vision Sensor With Silhouette-Mapping

An Adaptive Feature Extraction Algorithm for Multiple Typical Seam Tracking Based on Vision Sensor in Robotic Arc Welding

Acquisition of Weld Seam Dimensional Position Information for Arc Welding Robot Based on Vision Computing.

Multiple weld seam laser vision recognition method based on the IPCE algorithm