Abstract:Abstract Online monitoring of the welding process is very important to the development of the modern manufacturing industry. However, monitoring welding defects in real-time and with high accuracy is challenging because welding is inherently a dynamic, non-linear process. In this paper, the forming defects generated during the melt Inert-gas welding of sheet steel as the object of research. We propose a multi-task simultaneous monitoring system for welding defects based on the YOLOv5 model, which can achieve highly accurate simultaneous detection of burn-through and weld deviation defects. Firstly, a passive vision system has been designed that can filter out strong arc light interference. In combination with a self-made camera bracket with flexible adjustment and repeatable positioning, clear images of the molten pool can be acquired. Compared to common methods that require a laser for weld deviation detection, all monitoring tasks can be performed with just one charge coupled device camera, significantly reducing the cost of deploying the system. Secondly, to obtain experimental data closer to the industrial field environment. We simulated different degrees of local and continuous burn-through by changing three parameters: welding current, plate thickness, and lap width. Four different deviations: left, right, and tilt were designed to obtain rich weld deviation image data. Finally, based on the above data, we compared several aspects such as detection speed, recognition accuracy, and loss function. The YOLOv5s model with the smallest model parameters was finally selected as the base model. The results show that our proposed multi-task simultaneous monitoring system achieves an average accuracy of 98.84% for the identification of four molten pool states. Burn-through defect and weld deviation detection with more than 50 frames per second can be achieved in the online detection state. This paper can provide some guidance for the online monitoring of the welding manufacturing process.

MLD Classification Model of Visual Features of Multi-layer and Multi-pass Molten Pool During Robotic MAG Welding of Medium-Thick Steel Plates

TIG Stainless Steel Molten Pool Contour Detection and Weld Width Prediction Based on Res-Seg

Vision sensing system and detection of backside image of molten pool in laser-MIG hybrid welding

Online identification of burn-through and weld deviation in sheet lap MIG welding based on YOLOv5

Welding Defect Monitoring Based on Multi-Scale Feature Fusion of Molten Pool Videos

A Weld Position Recognition Method Based on Directional and Structured Light Information Fusion in Multi-Layer/Multi-Pass Welding

Multi-Layer Welding Path Correction of Medium-Thick Plate Based on Vision System

Real-Time Recognition of Molten Pools Based on Improved DeepLabV3+ in Keyhole Tungsten Inert Gas Welding Applications

Detection of Backside Width of Molten Pool in Laser-MIG Hybrid Welding

Vision-Based Online Molten Pool Image Acquisition and Assessment for Quality Monitoring in Gas–Metal Arc Welding

Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning

Weld pool image sensor for pulsed MIG welding

Real-time monitoring of weld surface morphology with lightweight semantic segmentation model improved by attention mechanism during laser keyhole welding

Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features

Thermal Field Prediction for Welding Paths in Multi-Layer Gas Metal Arc Welding-Based Additive Manufacturing: A Machine Learning Approach

Detection of reinforcement of multi-bead and multi-layer weld in additive manufacturing based on on-line visual information of weld pool

Vision-based real-time molten pool monitoring for Electron Beam Freeform Fabrication.

Multiple weld seam laser vision recognition method based on the IPCE algorithm

Development of a melt pool characteristics detection platform based on multi-information fusion of temperature fields and photodiode signals in plasma arc welding

Weld seam profile extraction using top-down visual attention and fault detection and diagnosis via EWMA for the stable robotic welding process

Modeling for detecting weld defects based on magneto-optical imaging