Abstract:Purpose The traditional vision system cannot automatically adjust the feature point extraction method according to the type of welding seam. In addition, the robot cannot self-correct the laying position error or machining error. To solve this problem, this paper aims to propose a hierarchical visual model to achieve automatic arc welding guidance. Design/methodology/approach The hierarchical visual model proposed in this paper is divided into two layers: welding seam classification layer and feature point extraction layer. In the welding seam classification layer, the SegNet network model is trained to identify the welding seam type, and the prediction mask is obtained to segment the corresponding point clouds. In the feature point extraction layer, the scanning path is determined by the point cloud obtained from the upper layer to correct laying position error. The feature points extraction method is automatically determined to correct machining error based on the type of welding seam. Furthermore, the corresponding specific method to extract the feature points for each type of welding seam is proposed. The proposed visual model is experimentally validated, and the feature points extraction results as well as seam tracking error are finally analyzed. Findings The experimental results show that the algorithm can well accomplish welding seam classification, feature points extraction and seam tracking with high precision. The prediction mask accuracy is above 90% for three types of welding seam. The proposed feature points extraction method for each type of welding seam can achieve sub-pixel feature extraction. For the three types of welding seam, the maximum seam tracking error is 0.33–0.41 mm, and the average seam tracking error is 0.11–0.22 mm. Originality/value The main innovation of this paper is that a hierarchical visual model for robotic arc welding is proposed, which is suitable for various types of welding seam. The proposed visual model well achieves welding seam classification, feature point extraction and error correction, which improves the automation level of robot welding.

A New Welding Seam Recognition Methodology Based on Deep Learning Model MRCNN

Weld Seam Detection Method with Rotational Region Proposal Network.

Automatic Seam Detection of Welding Robots Using Deep Learning

A Robust Weld Seam Recognition Method under Heavy Noise Based on Structured-Light Vision

Weld Seam Identification and Tracking of Inspection Robot Based on Deep Learning Network

A Vision Algorithm for Robot Seam Tracking Based on Laser Ranging

A Robust Detector for Automated Welding Seam Tracking System

An Adaptive Feature Extraction Algorithm for Multiple Typical Seam Tracking Based on Vision Sensor in Robotic Arc Welding

Multiple weld seam laser vision recognition method based on the IPCE algorithm

Research on Weld Seam Bead Recognition Based on Convolution Neural Network

Automatic Seam Detection and Tracking System for Robots Based on Laser Vision

Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy

Weld Image Recognition Based on Deep Learning

Robotic Seam Tracking System Combining Convolution Filter and Deep Reinforcement Learning

Robust seam tracking via a deep learning framework combining tracking and detection

An Intelligent Seam Detection Method for Welding Robots Based on Image Guided Point Cloud Registration

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

A vision-based method for narrow weld trajectory recognition of arc welding robots

Acquisition of Weld Seam Dimensional Position Information for Arc Welding Robot Based on Vision Computing.

Learning Siamese Networks for Laser Vision Seam Tracking

A hierarchical visual model for robot automatic arc welding guidance