Abstract:Purpose The traditional vision system cannot automatically adjust the feature point extraction method according to the type of welding seam. In addition, the robot cannot self-correct the laying position error or machining error. To solve this problem, this paper aims to propose a hierarchical visual model to achieve automatic arc welding guidance. Design/methodology/approach The hierarchical visual model proposed in this paper is divided into two layers: welding seam classification layer and feature point extraction layer. In the welding seam classification layer, the SegNet network model is trained to identify the welding seam type, and the prediction mask is obtained to segment the corresponding point clouds. In the feature point extraction layer, the scanning path is determined by the point cloud obtained from the upper layer to correct laying position error. The feature points extraction method is automatically determined to correct machining error based on the type of welding seam. Furthermore, the corresponding specific method to extract the feature points for each type of welding seam is proposed. The proposed visual model is experimentally validated, and the feature points extraction results as well as seam tracking error are finally analyzed. Findings The experimental results show that the algorithm can well accomplish welding seam classification, feature points extraction and seam tracking with high precision. The prediction mask accuracy is above 90% for three types of welding seam. The proposed feature points extraction method for each type of welding seam can achieve sub-pixel feature extraction. For the three types of welding seam, the maximum seam tracking error is 0.33–0.41 mm, and the average seam tracking error is 0.11–0.22 mm. Originality/value The main innovation of this paper is that a hierarchical visual model for robotic arc welding is proposed, which is suitable for various types of welding seam. The proposed visual model well achieves welding seam classification, feature point extraction and error correction, which improves the automation level of robot welding.

Weld Seam Detection Method with Rotational Region Proposal Network.

WeldNet: A voxel-based deep learning network for point cloud annular weld seam detection

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

A Deep Meta-Metric Learning Method for Few-Shot Weld Seam Visual Detection

A Visual Weld Edge Recognition Method Based on Light and Shadow Feature Construction Using Directional Lighting

A weld seam feature real-time extraction method of three typical welds based on target detection

Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registration

Robust identification of weld seam based on region of interest operation

Research on Weld Seam Bead Recognition Based on Convolution Neural Network

Multiple weld seam laser vision recognition method based on the IPCE algorithm

Weld Seam Identification and Tracking of Inspection Robot Based on Deep Learning Network

Automatic Detection and Location of Weld Beads With Deep Convolutional Neural Networks

Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks

A vision-based method for narrow weld trajectory recognition of arc welding robots

An image segmentation-based localization method for detecting weld seams

Robust seam tracking via a deep learning framework combining tracking and detection

An efficient and robust complex weld seam feature point extraction method for seam tracking and posture adjustment

A hierarchical visual model for robot automatic arc welding guidance

Seam tracking system based on laser vision and CGAN for robotic multi-layer and multi-pass MAG welding