Abstract:Abstract Online monitoring of the welding process is very important to the development of the modern manufacturing industry. However, monitoring welding defects in real-time and with high accuracy is challenging because welding is inherently a dynamic, non-linear process. In this paper, the forming defects generated during the melt Inert-gas welding of sheet steel as the object of research. We propose a multi-task simultaneous monitoring system for welding defects based on the YOLOv5 model, which can achieve highly accurate simultaneous detection of burn-through and weld deviation defects. Firstly, a passive vision system has been designed that can filter out strong arc light interference. In combination with a self-made camera bracket with flexible adjustment and repeatable positioning, clear images of the molten pool can be acquired. Compared to common methods that require a laser for weld deviation detection, all monitoring tasks can be performed with just one charge coupled device camera, significantly reducing the cost of deploying the system. Secondly, to obtain experimental data closer to the industrial field environment. We simulated different degrees of local and continuous burn-through by changing three parameters: welding current, plate thickness, and lap width. Four different deviations: left, right, and tilt were designed to obtain rich weld deviation image data. Finally, based on the above data, we compared several aspects such as detection speed, recognition accuracy, and loss function. The YOLOv5s model with the smallest model parameters was finally selected as the base model. The results show that our proposed multi-task simultaneous monitoring system achieves an average accuracy of 98.84% for the identification of four molten pool states. Burn-through defect and weld deviation detection with more than 50 frames per second can be achieved in the online detection state. This paper can provide some guidance for the online monitoring of the welding manufacturing process.

Research on welding penetration status monitoring based on Residual-Group convolution model

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

Penetration/keyhole status prediction and model visualization based on deep learning algorithm in plasma arc welding

Weld Joint Penetration State Sequential Identification Algorithm Based on Representation Learning of Weld Images

Real-time segmentation network for accurate weld detection in large weldments

How to Accurately Monitor the Weld Penetration From Dynamic Weld Pool Serial Images Using CNN-LSTM Deep Learning Model?

TIG Stainless Steel Molten Pool Contour Detection and Weld Width Prediction Based on Res-Seg

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Keyhole status prediction based on voting ensemble convolutional neural networks and visualization by Grad-CAM in PAW

Weld Penetration State Identification Based on Time Series Multi-Source Data Fusion

Research on Weld Seam Bead Recognition Based on Convolution Neural Network

Online detection of weld surface defects based on improved incremental learning approach

Prediction of penetration based on plasma plume and spectrum characteristics in laser welding

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

A High-Performance Deep Learning Algorithm for the Automated Optical Inspection of Laser Welding

Penetration prediction of narrow-gap laser welding based on coaxial high dynamic range observation and machine learning

Recognition of weld defects from X-ray images based on improved convolutional neural network

Online identification of burn-through and weld deviation in sheet lap MIG welding based on YOLOv5

An on-line weld inspection method for underwater offshore structure based on an improved deep convolutional network

Automatic Detection and Classification of Natural Weld Defects Using Alternating Magneto-Optical Imaging and ResNet50

A Method of Feature Extraction of Position Detection and Weld Gap for GMAW Seam Tracking System of Fillet Weld With Variable Gaps