Abstract:Purpose The traditional vision system cannot automatically adjust the feature point extraction method according to the type of welding seam. In addition, the robot cannot self-correct the laying position error or machining error. To solve this problem, this paper aims to propose a hierarchical visual model to achieve automatic arc welding guidance. Design/methodology/approach The hierarchical visual model proposed in this paper is divided into two layers: welding seam classification layer and feature point extraction layer. In the welding seam classification layer, the SegNet network model is trained to identify the welding seam type, and the prediction mask is obtained to segment the corresponding point clouds. In the feature point extraction layer, the scanning path is determined by the point cloud obtained from the upper layer to correct laying position error. The feature points extraction method is automatically determined to correct machining error based on the type of welding seam. Furthermore, the corresponding specific method to extract the feature points for each type of welding seam is proposed. The proposed visual model is experimentally validated, and the feature points extraction results as well as seam tracking error are finally analyzed. Findings The experimental results show that the algorithm can well accomplish welding seam classification, feature points extraction and seam tracking with high precision. The prediction mask accuracy is above 90% for three types of welding seam. The proposed feature points extraction method for each type of welding seam can achieve sub-pixel feature extraction. For the three types of welding seam, the maximum seam tracking error is 0.33–0.41 mm, and the average seam tracking error is 0.11–0.22 mm. Originality/value The main innovation of this paper is that a hierarchical visual model for robotic arc welding is proposed, which is suitable for various types of welding seam. The proposed visual model well achieves welding seam classification, feature point extraction and error correction, which improves the automation level of robot welding.

Integrated application model for visual detection of welding quality based on visual neuron under edge-end collaboration

Deep learning assisted vision inspection of resistance spot welds

Autonomous nondestructive evaluation of resistance spot welded joints

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Real-Time Quality Monitoring of Ultrathin Sheets Edge Welding Based on Microvision Sensing and SOCIFS-SVM.

A hierarchical visual model for robot automatic arc welding guidance

Online Quality Inspection of Ultrasonic Composite Welding by Combining Artificial Intelligence Technologies with Welding Process Signatures

Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches

Real-time segmentation network for accurate weld detection in large weldments

Online detection of weld surface defects based on improved incremental learning approach

Deep Learning-Based Defects Detection in Keyhole TIG Welding with Enhanced Vision

Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks

Weld Seam Tracking and Detection Robot Based on Artificial Intelligence Technology

Real-Time CU-Net-Based Welding Quality Inspection Algorithm in Battery Production

A Weld Surface Defect Recognition Method Based on Improved MobileNetV2 Algorithm

Automatic Detection and Location of Weld Beads With Deep Convolutional Neural Networks

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Deep Network-Assisted Quality Inspection of Laser Welding on Power Battery

Semi-supervised transfer learning-based automatic weld defect detection and visual inspection

Automatic Detection of Welding Defects Using Deep Neural Network

Welding Seam Tracking and Inspection Robot Based on Improved YOLOv8s-Seg Model