Abstract:Purpose The traditional vision system cannot automatically adjust the feature point extraction method according to the type of welding seam. In addition, the robot cannot self-correct the laying position error or machining error. To solve this problem, this paper aims to propose a hierarchical visual model to achieve automatic arc welding guidance. Design/methodology/approach The hierarchical visual model proposed in this paper is divided into two layers: welding seam classification layer and feature point extraction layer. In the welding seam classification layer, the SegNet network model is trained to identify the welding seam type, and the prediction mask is obtained to segment the corresponding point clouds. In the feature point extraction layer, the scanning path is determined by the point cloud obtained from the upper layer to correct laying position error. The feature points extraction method is automatically determined to correct machining error based on the type of welding seam. Furthermore, the corresponding specific method to extract the feature points for each type of welding seam is proposed. The proposed visual model is experimentally validated, and the feature points extraction results as well as seam tracking error are finally analyzed. Findings The experimental results show that the algorithm can well accomplish welding seam classification, feature points extraction and seam tracking with high precision. The prediction mask accuracy is above 90% for three types of welding seam. The proposed feature points extraction method for each type of welding seam can achieve sub-pixel feature extraction. For the three types of welding seam, the maximum seam tracking error is 0.33–0.41 mm, and the average seam tracking error is 0.11–0.22 mm. Originality/value The main innovation of this paper is that a hierarchical visual model for robotic arc welding is proposed, which is suitable for various types of welding seam. The proposed visual model well achieves welding seam classification, feature point extraction and error correction, which improves the automation level of robot welding.

Multilayer positioning strategy for tubesheet welding robot based on point cloud model

A novel method for dense point cloud reconstruction and weld seam detection for tubesheet welding robot

A Weld Position Recognition Method Based on Directional and Structured Light Information Fusion in Multi-Layer/Multi-Pass Welding

Multiseam tracking with a portable robotic welding system in unstructured environments

Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

A Method of D-Type Weld Seam Extraction Based on Point Clouds

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

Point Cloud 3D Weldment Reconstruction and Welding Feature Extraction for Robotic Multi-bead Arc Weld Cladding Path Plaanning

A hierarchical visual model for robot automatic arc welding guidance

Path Planning With Automatic Seam Extraction Over Point Cloud Models for Robotic Arc Welding

A novel offline programming approach of robot welding for multi-pipe intersection structures based on NSGA-II and measured 3D point-clouds

An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking

Versatile robotic welding system integrating laser positioning, trajectory fitting and real-time tracking

A Framework for Synchronous Extraction of Multi-Type Steel Mesh Features Based on Measured Point Clouds

A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision

A Feature Matching Algorithm Applied to Welding Trajectory Revising

Welding Strategy for Medium and Thick-Wall Pipes Based on Three-Line Laser

Seam tracking system based on laser vision and CGAN for robotic multi-layer and multi-pass MAG welding

A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot

A point cloud-based welding trajectory planning method for plane welds